-- Logs begin at Fri 2022-05-27 15:22:46 UTC, end at Fri 2022-05-27 16:48:11 UTC. -- May 27 16:07:17.964533 dv-cinder-840493-2-smb systemd[1]: Starting Devstack devstack@keystone.service... May 27 16:07:17.972429 dv-cinder-840493-2-smb devstack@keystone.service[80274]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 27 16:07:17.975502 dv-cinder-840493-2-smb devstack@keystone.service[80274]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri May 27 16:07:17 2022] *** May 27 16:07:17.975502 dv-cinder-840493-2-smb devstack@keystone.service[80274]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 27 16:07:17.975502 dv-cinder-840493-2-smb devstack@keystone.service[80274]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 27 16:07:17.975502 dv-cinder-840493-2-smb devstack@keystone.service[80274]: nodename: dv-cinder-840493-2-smb May 27 16:07:17.975502 dv-cinder-840493-2-smb devstack@keystone.service[80274]: machine: x86_64 May 27 16:07:17.975502 dv-cinder-840493-2-smb devstack@keystone.service[80274]: clock source: unix May 27 16:07:17.975502 dv-cinder-840493-2-smb devstack@keystone.service[80274]: pcre jit disabled May 27 16:07:17.975502 dv-cinder-840493-2-smb devstack@keystone.service[80274]: detected number of CPU cores: 4 May 27 16:07:17.975502 dv-cinder-840493-2-smb devstack@keystone.service[80274]: current working directory: / May 27 16:07:17.975502 dv-cinder-840493-2-smb devstack@keystone.service[80274]: detected binary path: /usr/bin/uwsgi-core May 27 16:07:17.975502 dv-cinder-840493-2-smb devstack@keystone.service[80274]: your processes number limit is 47680 May 27 16:07:17.975502 dv-cinder-840493-2-smb devstack@keystone.service[80274]: your memory page size is 4096 bytes May 27 16:07:17.978909 dv-cinder-840493-2-smb devstack@keystone.service[80274]: detected max file descriptor number: 2048 May 27 16:07:17.978909 dv-cinder-840493-2-smb devstack@keystone.service[80274]: lock engine: pthread robust mutexes May 27 16:07:17.978909 dv-cinder-840493-2-smb devstack@keystone.service[80274]: thunder lock: enabled May 27 16:07:17.978909 dv-cinder-840493-2-smb devstack@keystone.service[80274]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 27 16:07:17.978909 dv-cinder-840493-2-smb devstack@keystone.service[80274]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 27 16:07:18.020443 dv-cinder-840493-2-smb devstack@keystone.service[80274]: Python main interpreter initialized at 0x5601cae409c0 May 27 16:07:18.020443 dv-cinder-840493-2-smb devstack@keystone.service[80274]: python threads support enabled May 27 16:07:18.020443 dv-cinder-840493-2-smb devstack@keystone.service[80274]: your server socket listen backlog is limited to 100 connections May 27 16:07:18.020443 dv-cinder-840493-2-smb devstack@keystone.service[80274]: your mercy for graceful operations on workers is 90 seconds May 27 16:07:18.025425 dv-cinder-840493-2-smb devstack@keystone.service[80274]: mapped 403077 bytes (393 KB) for 2 cores May 27 16:07:18.025425 dv-cinder-840493-2-smb devstack@keystone.service[80274]: *** Operational MODE: preforking *** May 27 16:07:18.025425 dv-cinder-840493-2-smb devstack@keystone.service[80274]: *** uWSGI is running in multiple interpreter mode *** May 27 16:07:18.025425 dv-cinder-840493-2-smb devstack@keystone.service[80274]: spawned uWSGI master process (pid: 80274) May 27 16:07:18.025425 dv-cinder-840493-2-smb devstack@keystone.service[80274]: spawned uWSGI worker 1 (pid: 80288, cores: 1) May 27 16:07:18.025425 dv-cinder-840493-2-smb devstack@keystone.service[80274]: spawned uWSGI worker 2 (pid: 80289, cores: 1) May 27 16:07:18.025425 dv-cinder-840493-2-smb devstack@keystone.service[80274]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 27 16:07:18.021339 dv-cinder-840493-2-smb systemd[1]: Started Devstack devstack@keystone.service. May 27 16:07:23.656300 dv-cinder-840493-2-smb devstack@keystone.service[80288]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 16:07:23.656300 dv-cinder-840493-2-smb devstack@keystone.service[80288]: from cryptography.utils import int_from_bytes May 27 16:07:23.657097 dv-cinder-840493-2-smb devstack@keystone.service[80288]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 16:07:23.657097 dv-cinder-840493-2-smb devstack@keystone.service[80288]: from cryptography.utils import int_from_bytes May 27 16:07:23.701838 dv-cinder-840493-2-smb devstack@keystone.service[80289]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 16:07:23.701838 dv-cinder-840493-2-smb devstack@keystone.service[80289]: from cryptography.utils import int_from_bytes May 27 16:07:23.702380 dv-cinder-840493-2-smb devstack@keystone.service[80289]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 16:07:23.702380 dv-cinder-840493-2-smb devstack@keystone.service[80289]: from cryptography.utils import int_from_bytes May 27 16:07:23.706623 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 27 16:07:23.706826 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 27 16:07:23.707021 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] command line args: [] {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 27 16:07:23.707289 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 27 16:07:23.707469 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] ================================================================================ {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 27 16:07:23.707723 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] admin_token = **** {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.707971 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] config_dir = [] {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.708165 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.708351 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] config_source = [] {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.708549 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] debug = True {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.708759 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.709247 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.709341 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.709548 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.709797 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.710029 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] list_limit = None {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.710210 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] log_config_append = None {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.710439 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.710602 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] log_dir = None {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.710771 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] log_file = None {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.711008 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.711258 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.711504 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.711758 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.711935 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.712113 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.712358 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.712605 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.712842 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.713074 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.713308 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.713543 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.713790 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.714036 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.714334 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.714823 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.62/identity {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.715008 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] publish_errors = False {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.715800 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.716039 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.716217 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.716464 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.716697 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.716932 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] standard_threads = False {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.717162 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.717404 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.717579 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.717756 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] use_journal = False {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.717932 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] use_json = False {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.718113 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] use_stderr = False {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.718319 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] use_syslog = False {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.718557 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.722110 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.722110 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.722110 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.722110 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.722110 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.722110 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.722110 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.722110 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.722110 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.723009 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.723009 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.723009 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.723009 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.723009 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.723009 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.723009 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.723009 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.723009 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.723558 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.723558 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.723558 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.723815 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.723977 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.724233 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.724482 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.724712 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.724944 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.725173 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.725410 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.725659 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.725903 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.726148 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.726369 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.726612 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.726859 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.727098 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.727345 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.727577 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.727816 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.728054 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.728284 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.728518 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.728749 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.728980 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.729219 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.729467 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.729698 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.729935 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.730164 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.730425 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.730677 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.730968 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.731201 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.731438 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.731676 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.731914 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.732152 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.732383 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.732613 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.732864 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.733102 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.733341 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.733576 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.733837 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.734077 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.734332 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.734572 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.734809 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.735081 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.735322 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.735574 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.735825 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.736065 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.736302 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.736538 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.736789 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.737027 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.737264 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.737507 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.737747 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.737983 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.738223 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.738484 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.738721 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.738986 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.741640 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.741640 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.741640 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.741640 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.741640 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.741640 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.741640 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.741640 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.741640 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.742297 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.742297 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.742297 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.742297 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.742297 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.742607 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.742607 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.742864 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.743126 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.743367 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.743599 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] auth.external = None {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.743831 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.744127 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.744362 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.744592 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] auth.password = None {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.744821 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] auth.token = None {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.745059 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.745296 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.745542 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.745773 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.746020 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.746296 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.746553 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.746793 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] credential.caching = True {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.747040 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.747289 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.747538 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.747774 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.748024 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.748261 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.748526 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.748782 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.749020 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.749272 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.749557 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.749808 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.750072 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.750336 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.750595 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.750829 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] federation.caching = True {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.751084 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.751310 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.751554 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.751805 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.760059 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.760059 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.760059 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.760059 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.760059 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.760059 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.760059 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.760059 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] identity.caching = True {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.760059 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.761099 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.761099 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.761099 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.761099 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.761099 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.761099 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.761099 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.761099 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.761570 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 27 16:07:23.761570 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 27 16:07:23.761738 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.761818 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] command line args: [] {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 27 16:07:23.761896 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.762484 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 27 16:07:23.762564 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.762693 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ================================================================================ {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 27 16:07:23.762693 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] admin_token = **** {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.762839 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.762916 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] config_dir = [] {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.762988 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.763058 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.763127 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.763205 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] config_source = [] {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.763288 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.763366 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] debug = True {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.763366 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.763522 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.763602 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.763676 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.763752 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.763824 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.763893 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.763970 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.764116 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.764190 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.764260 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] list_limit = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.764329 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.764399 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] log_config_append = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.764467 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.764544 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.764616 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.764686 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] log_dir = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.764686 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] log_file = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.764811 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.764886 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.764965 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.765042 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.765113 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.765182 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.765256 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.765327 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.765408 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.765479 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.765549 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.765628 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.765709 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.765770 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.765834 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.765905 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.765975 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.766043 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.766112 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.766180 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.766272 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.766357 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.766430 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.766506 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.766577 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.766646 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.766723 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.766801 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.766873 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.766942 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.767018 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.767018 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.767157 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.62/identity {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.767237 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.767314 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] publish_errors = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.767385 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.767462 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.767533 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.767608 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.767680 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.767749 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.767818 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.767894 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.767966 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.768035 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.768133 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.768236 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] standard_threads = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.768324 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.768414 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.768490 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.768562 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.768633 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] ldap.user = None {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.768710 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.768710 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] use_journal = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.768847 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.768921 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] use_json = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.768992 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.769063 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] use_stderr = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.769063 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] use_syslog = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.769190 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.769269 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:07:23.769389 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.769480 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.769559 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.769632 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.769710 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.769710 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.769853 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.769924 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.769994 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.770064 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.770134 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.770212 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.770305 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.770411 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.770495 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.770569 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.770640 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.770710 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.770781 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.770859 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.770933 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.771004 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.771075 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.771146 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.771223 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.771304 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.771377 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.771448 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.771519 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.771590 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.771668 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.771752 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.771825 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.771902 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.771980 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.772054 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.772125 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.772204 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.772277 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.772348 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.772419 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.772490 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.772560 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.772712 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.772788 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.772865 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.772938 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.773008 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.773079 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.773158 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.773231 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.773308 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.773381 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.773452 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.773534 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.773608 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.773745 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.773828 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.773986 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.774075 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.774214 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.774318 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.774476 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.774557 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.774719 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] resource.caching = True {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.774807 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.774951 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.775082 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.775201 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.775339 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.775453 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.775581 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.775708 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.775834 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.775959 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.776088 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.776197 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.776328 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.776439 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.776578 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.776689 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.776817 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.776924 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.777058 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.777148 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.777297 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] role.caching = True {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.777384 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.777550 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] role.driver = sql {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.777630 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.778360 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.779585 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.780275 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.780275 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.780421 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.780496 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.780568 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.780651 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.780651 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.780803 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.780877 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.780877 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.781058 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.781554 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.781554 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.781710 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.781784 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.781784 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.781901 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.781968 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.782029 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.782093 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.782153 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.782153 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.782275 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.782352 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.783069 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.783069 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.783263 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.783348 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.783424 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.783505 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.783505 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.783627 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.783697 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.783768 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.783847 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.783847 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.788200 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.788265 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.788265 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.788383 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.788474 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.788474 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.792951 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.793044 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.793122 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.793122 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.793278 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.793362 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.793437 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.793509 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.793580 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.793651 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.793722 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.793722 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.793850 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.793928 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] token.caching = True {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.793928 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.794048 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.794125 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.794125 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.794260 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.794335 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.794335 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.794463 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.794547 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.794547 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.794690 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.794760 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.794831 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.794890 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.794958 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.795018 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.795089 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.795165 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.795236 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.795307 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.795385 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.795457 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.795528 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.795598 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.795667 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.795737 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.795815 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.795888 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.795958 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.796028 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.796098 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.796157 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] database.connection = **** {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.796227 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.796294 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.796360 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.796433 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.796504 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.796575 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.796645 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.796716 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.796794 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.796868 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.796939 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.797009 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.797079 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.797150 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.797229 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.797302 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.797374 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.797445 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.797514 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.797591 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.797671 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.797745 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.797745 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.797872 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.797942 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.798012 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.798090 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.798090 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.798226 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.798368 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.798446 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.798517 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.798670 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.798747 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.798747 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 27 16:07:23.798865 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.798865 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.798865 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.798865 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.798865 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.798865 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.798865 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] auth.external = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.798865 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.798865 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.799362 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.799434 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] auth.password = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.799790 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] auth.token = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.800165 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.800576 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.800994 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.801396 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.801661 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.801919 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.802160 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.802430 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] credential.caching = True {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.802687 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.802945 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.803201 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.803443 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.803694 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.803935 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.804204 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.804512 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.804762 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.805153 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.805650 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.806264 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.806650 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.806910 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.807180 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.807428 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] federation.caching = True {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.807675 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.807932 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.808190 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.808428 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.808683 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.808955 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.809219 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.809463 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.809726 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.809970 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.810225 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.810489 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] identity.caching = True {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.810743 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.810998 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.811241 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.811488 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.811742 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.811977 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.812218 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.812475 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.812734 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.812969 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.813204 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.813440 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.813694 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.813947 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.814199 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.814487 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.814742 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.815020 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.815267 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.815509 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.815747 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.815989 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.816225 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.816466 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.816726 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.816972 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.817227 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.817463 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.817716 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.817969 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.818213 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.818490 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.818744 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.818980 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.819224 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.819458 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.819703 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.819945 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.820196 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.820440 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.820683 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.820937 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.821192 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.821434 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.821670 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.821924 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.822176 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.822441 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.822685 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.822927 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.823163 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.user = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.823408 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.823673 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.823910 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.824162 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.824414 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.825190 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.825429 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.825664 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.825905 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.826231 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.826560 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.826918 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.827186 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.827318 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80288) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:07:23.827437 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.827518 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80288) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:07:23.827692 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.827773 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80288) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:07:23.827947 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.828201 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.828439 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.828693 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.828952 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.829221 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.829466 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.829706 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.829960 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.830213 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.830483 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.830745 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.830981 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.831234 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.831482 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.831724 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.831966 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.832219 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.832519 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.832759 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.833002 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.833249 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] resource.caching = True {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.833504 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.833758 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.833999 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.834288 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.834532 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.834788 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.835041 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.835286 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.835531 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.835772 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] role.caching = True {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.836026 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] role.driver = sql {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.836262 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.836340 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80288) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:07:23.836516 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.836768 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.837020 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.837272 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.837525 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.837777 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.838027 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.838308 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.838549 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.838802 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.839056 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.839310 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.839561 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.839990 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.840290 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.840547 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.840803 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.841120 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.841324 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.841592 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.841827 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.842086 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.842480 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.842727 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.842967 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.843204 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.843461 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.843722 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.843973 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.844217 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.844459 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.844695 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.844935 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] token.caching = True {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.845177 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.845436 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.845676 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.845936 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.846187 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.846456 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.846708 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.846956 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.847209 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.847450 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.847694 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.847936 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.848186 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.848437 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.848672 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.848936 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.849240 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.849508 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] database.connection = **** {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.849759 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.850011 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.850278 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.850521 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.850761 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.851004 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.851245 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.851491 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.851742 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.851983 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.852231 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.852470 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.852722 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.852961 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.853211 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.853446 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.853692 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.853932 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:07:23.854107 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 27 16:07:23.865186 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80288) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:07:23.865426 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80288) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:07:23.880176 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:07:23.880413 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:07:23.880644 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:07:23.890945 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:07:23.909677 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:07:23.909869 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:07:23.919017 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80288) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:07:23.948833 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:07:23.973317 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80288) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:07:23.973552 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80288) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:07:23.988797 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:07:23.989040 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:07:24.040118 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80288) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:07:24.040264 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:07:24.040348 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80288) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:07:24.040484 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:07:24.040570 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80288) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:07:24.040712 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:07:24.040797 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80288) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:07:24.040936 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:07:24.041023 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80288) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:07:24.041158 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:07:24.041243 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80288) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:07:24.041379 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:07:24.064953 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80288) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:07:24.065165 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:07:24.065254 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80288) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:07:24.065400 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80288) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:07:24.065484 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:07:24.065623 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80288) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:07:24.065709 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:07:24.065839 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80288) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:07:24.065924 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:07:24.066052 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80288) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:07:24.066135 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:07:24.066282 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80288) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:07:24.066369 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:07:24.066506 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:07:24.078157 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80288) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:07:24.078536 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:07:24.090630 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80288) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:07:24.090865 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80288) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:07:24.090951 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:07:24.091095 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80288) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:07:24.091180 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:07:24.091320 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80288) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:07:24.091405 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:07:24.091538 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80288) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:07:24.091622 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:07:24.091751 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80288) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:07:24.091835 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:07:24.091964 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80288) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:07:24.092050 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:07:24.092208 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:07:24.110126 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80288) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.110336 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80288) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 27 16:07:24.110683 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80288) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.110771 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.110887 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80288) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 27 16:07:24.111095 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 27 16:07:24.111180 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80288) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.111405 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80288) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.111662 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80288) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.111743 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.111916 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80288) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.112028 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 27 16:07:24.112516 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.112961 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.113427 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.113898 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.123566 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80288) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.123843 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80288) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.124113 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80288) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.124397 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80288) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.131803 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.132090 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.132361 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.132549 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80288) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 16:07:24.132644 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.135856 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80288) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 16:07:24.136135 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80288) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.136414 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80288) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.136695 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80288) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.136997 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80288) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.137843 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80288) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.138058 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80288) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.138470 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80288) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.138744 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80288) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.139027 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80288) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.139298 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80288) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.141377 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80289) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 16:07:24.144713 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80289) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 16:07:24.145002 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.145291 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.145579 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.145874 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.146141 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.146556 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.146842 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.147121 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.147403 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.147681 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.165645 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80288) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.167349 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80288) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 16:07:24.167627 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80288) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.172923 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80288) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 16:07:24.173202 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80288) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.173484 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80288) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.174166 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.175940 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80289) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 16:07:24.176221 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.181051 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80288) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 16:07:24.181336 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80288) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.181785 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80289) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 16:07:24.182058 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.182404 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.186382 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80288) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 16:07:24.186782 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80288) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.187069 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80288) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.187355 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80288) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.193478 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80288) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.193478 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80288) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.193478 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80288) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.193478 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80288) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.193717 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80289) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 16:07:24.193717 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.195124 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80289) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 16:07:24.195533 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.195829 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.196122 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.196404 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.196683 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.196960 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.197234 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.207611 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80288) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.207889 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80288) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.212609 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80288) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 16:07:24.216305 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80288) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.216601 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80288) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.216954 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.217236 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.221846 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80288) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 16:07:24.221944 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80289) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 16:07:24.225501 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80288) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 16:07:24.225595 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.225889 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.229292 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80288) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.229601 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80288) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.229886 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80288) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.230168 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80288) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.230495 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80288) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.230801 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80288) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.231076 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80289) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 16:07:24.234746 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80289) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 16:07:24.238542 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.238848 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.239148 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.239445 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.239739 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.240040 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.250331 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80288) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 16:07:24.250616 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80288) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.250885 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80288) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.251149 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80288) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.259191 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80288) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.259630 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80289) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 16:07:24.259987 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.260192 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.260460 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.260912 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80288) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.261187 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80288) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.264827 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80288) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 16:07:24.265107 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80288) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.265389 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80288) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.265681 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80288) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.265962 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80288) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.269139 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.270877 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.271159 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.274242 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80289) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 16:07:24.274558 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.274846 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.275129 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.275416 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.280111 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80288) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 16:07:24.280389 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80288) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.280678 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80288) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.280962 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80288) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.281243 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80288) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.281523 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80288) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.281805 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80288) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.289516 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80289) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 16:07:24.289799 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.290083 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.290398 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.290684 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.290962 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.291249 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.299861 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80288) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 16:07:24.303152 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80288) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 16:07:24.306759 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80288) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.308363 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80288) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.310291 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80289) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 16:07:24.310571 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80288) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 16:07:24.310858 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80288) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.311142 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80288) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.313555 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80289) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 16:07:24.316927 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.318546 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80288) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.318647 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.320171 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80288) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 16:07:24.320255 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80289) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 16:07:24.320456 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.320751 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.323430 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80288) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.323729 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80288) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.324012 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80288) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.324292 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80288) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.328761 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.330410 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80289) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 16:07:24.333664 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.333947 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80288) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 16:07:24.334031 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.334233 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.334343 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80288) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.334578 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.334668 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80288) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.342572 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80288) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 16:07:24.342850 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80288) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.343141 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80288) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.343418 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80288) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.343688 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80288) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.343809 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80289) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 16:07:24.343957 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80288) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.344099 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.344244 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80288) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.344488 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.344569 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80288) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.344776 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80288) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.345049 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80288) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.345317 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80288) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.345585 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80288) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.345858 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80288) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.346125 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80288) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.352436 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80289) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 16:07:24.352718 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.353008 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.353290 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.353567 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.353857 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.354177 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.354483 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.354758 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.355045 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.355319 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.355581 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.356391 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.356667 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:07:24.385906 dv-cinder-840493-2-smb devstack@keystone.service[80288]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5601cae409c0 pid: 80288 (default app) May 27 16:07:24.389238 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8029f-65cd-4273-a2f9-afa01096eab4 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:24.389529 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8029f-65cd-4273-a2f9-afa01096eab4 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:24.389805 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8029f-65cd-4273-a2f9-afa01096eab4 None None] PATH_INFO: `/v3` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:24.394133 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1/1] 10.222.0.62 () {50 vars in 791 bytes} [Fri May 27 16:07:24 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:07:24.396163 dv-cinder-840493-2-smb devstack@keystone.service[80289]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5601cae409c0 pid: 80289 (default app) May 27 16:07:33.341148 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9f61b-1531-4863-856c-4bde1c80a7cd None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:33.341694 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9f61b-1531-4863-856c-4bde1c80a7cd None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:33.341694 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9f61b-1531-4863-856c-4bde1c80a7cd None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:33.343198 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 2/2] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:07:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 16:07:33.350491 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd356fa1-ce12-417c-b04f-0535b01b2954 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:33.350879 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd356fa1-ce12-417c-b04f-0535b01b2954 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:33.351068 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd356fa1-ce12-417c-b04f-0535b01b2954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:33.418610 dv-cinder-840493-2-smb devstack@keystone.service[80289]: INFO dbcounter [None req-cd356fa1-ce12-417c-b04f-0535b01b2954 None None] Registered counter for database keystone May 27 16:07:33.440254 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG oslo_db.sqlalchemy.engines [None req-cd356fa1-ce12-417c-b04f-0535b01b2954 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80289) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 16:07:33.446581 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writer thread running {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 16:07:33.623076 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG passlib.handlers.bcrypt [None req-cd356fa1-ce12-417c-b04f-0535b01b2954 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80289) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 27 16:07:33.623422 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG passlib.handlers.bcrypt [None req-cd356fa1-ce12-417c-b04f-0535b01b2954 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80289) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 27 16:07:33.678522 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-cd356fa1-ce12-417c-b04f-0535b01b2954 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:07:33.680116 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-cd356fa1-ce12-417c-b04f-0535b01b2954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:07:33.803191 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1/3] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:07:33 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 456 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 27 16:07:33.976265 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b9f61b-1531-4863-856c-4bde1c80a7cd None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:07:34.047292 dv-cinder-840493-2-smb devstack@keystone.service[80288]: INFO dbcounter [None req-64b9f61b-1531-4863-856c-4bde1c80a7cd None None] Registered counter for database keystone May 27 16:07:34.066440 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG oslo_db.sqlalchemy.engines [None req-64b9f61b-1531-4863-856c-4bde1c80a7cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80288) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 16:07:34.072786 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writer thread running {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 16:07:34.193506 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b9f61b-1531-4863-856c-4bde1c80a7cd None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:07:34.197839 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca10605-f711-48bf-accf-17e145995ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:07:34.198529 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca10605-f711-48bf-accf-17e145995ba6 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:34.198820 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca10605-f711-48bf-accf-17e145995ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:34.199632 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca10605-f711-48bf-accf-17e145995ba6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:34.207734 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca10605-f711-48bf-accf-17e145995ba6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:07:34.259433 dv-cinder-840493-2-smb devstack@keystone.service[80288]: WARNING keystone.common.rbac_enforcer.enforcer [None req-aca10605-f711-48bf-accf-17e145995ba6 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 27 16:07:34.259722 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca10605-f711-48bf-accf-17e145995ba6 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:07:34.269449 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 3/4] 10.222.0.62 () {58 vars in 1324 bytes} [Fri May 27 16:07:33 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 16:07:34.275619 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd356fa1-ce12-417c-b04f-0535b01b2954 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:07:34.290006 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd356fa1-ce12-417c-b04f-0535b01b2954 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:07:34.295093 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d77122-9de2-4fb4-9d8f-549898cd3d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:07:34.296218 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d77122-9de2-4fb4-9d8f-549898cd3d62 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:34.296510 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d77122-9de2-4fb4-9d8f-549898cd3d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:34.296797 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d77122-9de2-4fb4-9d8f-549898cd3d62 admin admin] PATH_INFO: `/v3/projects/793e0b7f54284522b67bc42f3a9f9fdd` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:34.298481 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d77122-9de2-4fb4-9d8f-549898cd3d62 admin admin] RBAC: Authorizing `identity:get_project(project_id=793e0b7f54284522b67bc42f3a9f9fdd)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:07:34.351320 dv-cinder-840493-2-smb devstack@keystone.service[80289]: WARNING keystone.common.rbac_enforcer.enforcer [None req-94d77122-9de2-4fb4-9d8f-549898cd3d62 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 27 16:07:34.351882 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d77122-9de2-4fb4-9d8f-549898cd3d62 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:07:34.356255 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 2/5] 10.222.0.62 () {56 vars in 1207 bytes} [Fri May 27 16:07:34 2022] GET /identity/v3/projects/793e0b7f54284522b67bc42f3a9f9fdd => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:07:36.522524 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc02842-244a-4149-adac-742c5b9e6db6 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:36.523108 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc02842-244a-4149-adac-742c5b9e6db6 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:36.523108 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc02842-244a-4149-adac-742c5b9e6db6 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:36.527299 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 4/6] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:07:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 16:07:36.532686 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c7263d-0e92-4fd2-977b-a20ab1f98934 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:36.533096 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c7263d-0e92-4fd2-977b-a20ab1f98934 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:36.533258 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c7263d-0e92-4fd2-977b-a20ab1f98934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:36.552258 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-34c7263d-0e92-4fd2-977b-a20ab1f98934 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:07:36.553778 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-34c7263d-0e92-4fd2-977b-a20ab1f98934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:07:36.562718 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 3/7] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:07:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 27 16:07:36.584412 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc02842-244a-4149-adac-742c5b9e6db6 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:07:36.596428 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc02842-244a-4149-adac-742c5b9e6db6 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:07:36.600712 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a2eac1-494e-498a-a19b-ad63d9e8d255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:07:36.601339 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2eac1-494e-498a-a19b-ad63d9e8d255 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:36.601627 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2eac1-494e-498a-a19b-ad63d9e8d255 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:36.601910 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2eac1-494e-498a-a19b-ad63d9e8d255 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:36.610113 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a2eac1-494e-498a-a19b-ad63d9e8d255 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:07:36.611925 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a2eac1-494e-498a-a19b-ad63d9e8d255 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:07:36.620617 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 5/8] 10.222.0.62 () {58 vars in 1324 bytes} [Fri May 27 16:07:36 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 27 16:07:36.625844 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c7263d-0e92-4fd2-977b-a20ab1f98934 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:07:36.634743 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c7263d-0e92-4fd2-977b-a20ab1f98934 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:07:36.639613 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36826bd-1068-4bed-b4d8-cbd92f24842c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:07:36.640466 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36826bd-1068-4bed-b4d8-cbd92f24842c admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:36.640754 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36826bd-1068-4bed-b4d8-cbd92f24842c admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:36.641035 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36826bd-1068-4bed-b4d8-cbd92f24842c admin admin] PATH_INFO: `/v3/users/e26f01858edd43d6bd42a1a5a4965a24` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:36.642445 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36826bd-1068-4bed-b4d8-cbd92f24842c admin admin] RBAC: Authorizing `identity:get_user(user_id=e26f01858edd43d6bd42a1a5a4965a24)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:07:36.644277 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36826bd-1068-4bed-b4d8-cbd92f24842c admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:07:36.645814 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 4/9] 10.222.0.62 () {56 vars in 1198 bytes} [Fri May 27 16:07:36 2022] GET /identity/v3/users/e26f01858edd43d6bd42a1a5a4965a24 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:07:38.901859 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfe5ae5-7e8a-44ee-be2e-9c8b3a0833a0 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:38.902488 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfe5ae5-7e8a-44ee-be2e-9c8b3a0833a0 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:38.902583 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfe5ae5-7e8a-44ee-be2e-9c8b3a0833a0 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:38.903925 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 6/10] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:07:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 16:07:38.909140 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6522f939-99d4-4b2b-a135-c83b3c017925 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:38.909539 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6522f939-99d4-4b2b-a135-c83b3c017925 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:38.909708 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6522f939-99d4-4b2b-a135-c83b3c017925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:38.926716 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-6522f939-99d4-4b2b-a135-c83b3c017925 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:07:38.927982 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-6522f939-99d4-4b2b-a135-c83b3c017925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:07:38.929601 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60b627-6f53-42e8-923c-82313cc3d354 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:38.929895 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60b627-6f53-42e8-923c-82313cc3d354 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:38.930456 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60b627-6f53-42e8-923c-82313cc3d354 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:38.931790 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 7/11] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:07:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:07:38.937453 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ecd764-05ae-4051-9398-041087cd6083 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:38.937743 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ecd764-05ae-4051-9398-041087cd6083 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:38.938030 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ecd764-05ae-4051-9398-041087cd6083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:38.976790 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG passlib.handlers.bcrypt [None req-22ecd764-05ae-4051-9398-041087cd6083 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80288) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 27 16:07:38.977216 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG passlib.handlers.bcrypt [None req-22ecd764-05ae-4051-9398-041087cd6083 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80288) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 27 16:07:39.007738 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 5/12] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:07:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:07:39.023537 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-22ecd764-05ae-4051-9398-041087cd6083 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:07:39.025122 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-22ecd764-05ae-4051-9398-041087cd6083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:07:39.030744 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6522f939-99d4-4b2b-a135-c83b3c017925 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:07:39.053659 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:07:39.127342 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 8/13] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:07:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 16:07:39.135288 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6522f939-99d4-4b2b-a135-c83b3c017925 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:07:39.149295 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ecd764-05ae-4051-9398-041087cd6083 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:07:39.168736 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d5ad1-bebc-4673-8ae6-0d1bc105cb1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:07:39.169539 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d5ad1-bebc-4673-8ae6-0d1bc105cb1a None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:39.169829 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d5ad1-bebc-4673-8ae6-0d1bc105cb1a None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:39.170113 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d5ad1-bebc-4673-8ae6-0d1bc105cb1a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:39.181719 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0d5ad1-bebc-4673-8ae6-0d1bc105cb1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:07:39.193791 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-ce0d5ad1-bebc-4673-8ae6-0d1bc105cb1a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:07:39.193791 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:07:39.193791 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:07:39.193791 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:07:39.193791 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:07:39.193791 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:07:39.193791 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:07:39.193791 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:07:39.193791 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:07:39.193791 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:07:39.193791 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:07:39.193791 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:07:39.193791 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:07:39.193791 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:07:39.193791 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:07:39.193791 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:07:39.194915 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:07:39.194915 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:07:39.194915 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:07:39.194915 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:07:39.194915 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:07:39.194915 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:07:39.194915 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:07:39.194915 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:07:39.194915 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:07:39.194915 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:07:39.194915 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:07:39.194915 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:07:39.194915 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:07:39.194915 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:07:39.194915 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:07:39.194915 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:07:39.195808 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:07:39.195808 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:07:39.195808 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:07:39.195808 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:07:39.195808 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:07:39.195808 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:07:39.195808 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:07:39.195808 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:07:39.195808 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:07:39.195808 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:07:39.195808 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:07:39.195808 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:07:39.195808 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 6/14] 10.222.0.62 () {56 vars in 1096 bytes} [Fri May 27 16:07:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:07:39.202033 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d5ad1-bebc-4673-8ae6-0d1bc105cb1a None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:07:39.363999 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ecd764-05ae-4051-9398-041087cd6083 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:07:39.366639 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:07:39.403937 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1142747d-103a-4301-af56-827a19222752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:07:39.404480 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:07:39.404791 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1142747d-103a-4301-af56-827a19222752 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:39.405075 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1142747d-103a-4301-af56-827a19222752 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:39.405346 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1142747d-103a-4301-af56-827a19222752 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:39.422427 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d5ad1-bebc-4673-8ae6-0d1bc105cb1a None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:07:39.456942 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e1790f-ac78-4020-93c7-5b5d3eed43be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:07:39.457614 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e1790f-ac78-4020-93c7-5b5d3eed43be None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:39.457910 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e1790f-ac78-4020-93c7-5b5d3eed43be None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:39.458191 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e1790f-ac78-4020-93c7-5b5d3eed43be None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:39.458979 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e1790f-ac78-4020-93c7-5b5d3eed43be None admin] RBAC: Adding query filter params (name=admin) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:07:39.459294 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e1790f-ac78-4020-93c7-5b5d3eed43be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:07:39.460700 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e1790f-ac78-4020-93c7-5b5d3eed43be None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:07:39.472951 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 7/15] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 16:07:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:07:39.473621 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1142747d-103a-4301-af56-827a19222752 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:07:39.475238 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1142747d-103a-4301-af56-827a19222752 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:07:39.478404 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e1790f-ac78-4020-93c7-5b5d3eed43be None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:07:39.574268 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 9/16] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 16:07:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 27 16:07:39.577282 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e1790f-ac78-4020-93c7-5b5d3eed43be None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:07:39.579738 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1142747d-103a-4301-af56-827a19222752 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:07:39.582405 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:07:39.612959 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae0ef8c-5872-40fd-99c6-da50c4223312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:07:39.613859 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae0ef8c-5872-40fd-99c6-da50c4223312 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:39.614140 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae0ef8c-5872-40fd-99c6-da50c4223312 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:39.614444 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae0ef8c-5872-40fd-99c6-da50c4223312 None admin] PATH_INFO: `/v3/users/e26f01858edd43d6bd42a1a5a4965a24` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:39.615672 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae0ef8c-5872-40fd-99c6-da50c4223312 None admin] RBAC: Authorizing `identity:get_user(user_id=e26f01858edd43d6bd42a1a5a4965a24)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:07:39.617134 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae0ef8c-5872-40fd-99c6-da50c4223312 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:07:39.618796 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 8/17] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 16:07:39 2022] GET /identity/v3/users/e26f01858edd43d6bd42a1a5a4965a24 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:07:39.624607 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae0ef8c-5872-40fd-99c6-da50c4223312 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:07:39.639444 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:07:39.681970 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1142747d-103a-4301-af56-827a19222752 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:07:39.717293 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbfa0e8-2d86-4508-b127-919cf176cfa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:07:39.718086 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbfa0e8-2d86-4508-b127-919cf176cfa7 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:39.718401 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbfa0e8-2d86-4508-b127-919cf176cfa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:39.718683 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbfa0e8-2d86-4508-b127-919cf176cfa7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:39.734079 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae0ef8c-5872-40fd-99c6-da50c4223312 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:07:39.737694 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbfa0e8-2d86-4508-b127-919cf176cfa7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:07:39.739199 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbfa0e8-2d86-4508-b127-919cf176cfa7 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:07:39.760184 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-0cbfa0e8-2d86-4508-b127-919cf176cfa7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:07:39.760184 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:07:39.760184 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:07:39.760184 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:07:39.760184 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:07:39.760184 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:07:39.760184 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:07:39.760184 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:07:39.760184 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:07:39.760184 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:07:39.760184 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:07:39.760184 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:07:39.760184 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:07:39.760184 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:07:39.760184 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:07:39.761044 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:07:39.761044 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:07:39.761044 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:07:39.761044 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:07:39.761044 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:07:39.761044 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:07:39.761044 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:07:39.761044 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:07:39.761044 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:07:39.761044 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:07:39.761044 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:07:39.761044 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:07:39.761044 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:07:39.761044 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:07:39.761044 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:07:39.761044 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:07:39.761044 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:07:39.761844 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:07:39.761844 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:07:39.761844 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:07:39.761844 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:07:39.761844 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 10/18] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:07:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:07:39.767144 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbfa0e8-2d86-4508-b127-919cf176cfa7 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:07:39.769256 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0837d4-e649-4e58-8302-42e5ba3041a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:07:39.770058 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0837d4-e649-4e58-8302-42e5ba3041a9 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:39.770383 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0837d4-e649-4e58-8302-42e5ba3041a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:39.770669 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0837d4-e649-4e58-8302-42e5ba3041a9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:39.771864 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0837d4-e649-4e58-8302-42e5ba3041a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:07:39.773322 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0837d4-e649-4e58-8302-42e5ba3041a9 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:07:39.775122 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 9/19] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:07:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:07:39.781055 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0837d4-e649-4e58-8302-42e5ba3041a9 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:07:39.823157 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:07:39.861701 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:07:39.871325 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbfa0e8-2d86-4508-b127-919cf176cfa7 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:07:39.881313 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0837d4-e649-4e58-8302-42e5ba3041a9 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:07:39.901554 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff6b0ee-0542-4ca3-a9da-44710401c364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:07:39.902747 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6b0ee-0542-4ca3-a9da-44710401c364 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:39.903291 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6b0ee-0542-4ca3-a9da-44710401c364 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:39.903291 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6b0ee-0542-4ca3-a9da-44710401c364 None admin] PATH_INFO: `/v3/domains` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:39.904018 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff6b0ee-0542-4ca3-a9da-44710401c364 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:07:39.904327 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff6b0ee-0542-4ca3-a9da-44710401c364 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:07:39.905727 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff6b0ee-0542-4ca3-a9da-44710401c364 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:07:39.915627 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfa79fa-30e7-47f7-9280-9df9bf445d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:07:39.916287 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa79fa-30e7-47f7-9280-9df9bf445d28 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:39.916579 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa79fa-30e7-47f7-9280-9df9bf445d28 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:39.916864 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa79fa-30e7-47f7-9280-9df9bf445d28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:39.917753 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfa79fa-30e7-47f7-9280-9df9bf445d28 None admin] RBAC: Adding query filter params (role.id=e04fe3eb1f714d74901ac83e33ea8a16, scope.domain.id=default, user.id=e26f01858edd43d6bd42a1a5a4965a24) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:07:39.918071 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfa79fa-30e7-47f7-9280-9df9bf445d28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:07:39.919539 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfa79fa-30e7-47f7-9280-9df9bf445d28 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:07:39.923166 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 11/20] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 16:07:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:07:39.926341 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 10/21] 10.222.0.62 () {56 vars in 1322 bytes} [Fri May 27 16:07:39 2022] GET /identity/v3/role_assignments?user.id=e26f01858edd43d6bd42a1a5a4965a24&scope.domain.id=default&role.id=e04fe3eb1f714d74901ac83e33ea8a16 => generated 233 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:07:42.469338 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091692c9-fbc7-4e6c-8962-97e83cd44615 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:42.469842 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091692c9-fbc7-4e6c-8962-97e83cd44615 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:42.469916 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091692c9-fbc7-4e6c-8962-97e83cd44615 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:42.471267 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 12/22] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:07:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:07:42.483798 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95bddb7-6f70-4f83-9887-1ff8b35a5e6f None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:42.484718 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95bddb7-6f70-4f83-9887-1ff8b35a5e6f None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:42.485213 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95bddb7-6f70-4f83-9887-1ff8b35a5e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:42.511922 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-d95bddb7-6f70-4f83-9887-1ff8b35a5e6f None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:07:42.513460 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-d95bddb7-6f70-4f83-9887-1ff8b35a5e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:07:42.606155 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 11/23] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:07:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:07:42.639998 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091692c9-fbc7-4e6c-8962-97e83cd44615 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:07:42.650069 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da938638-0ca1-43d0-a74f-f4f60732af5a None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:42.650395 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da938638-0ca1-43d0-a74f-f4f60732af5a None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:42.650681 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da938638-0ca1-43d0-a74f-f4f60732af5a None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:42.652164 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 12/24] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:07:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 16:07:42.657611 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a46abe3-3100-48a6-a97b-beb567238eb5 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:42.657907 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a46abe3-3100-48a6-a97b-beb567238eb5 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:42.658196 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a46abe3-3100-48a6-a97b-beb567238eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:42.685275 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-7a46abe3-3100-48a6-a97b-beb567238eb5 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:07:42.686679 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-7a46abe3-3100-48a6-a97b-beb567238eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:07:42.768395 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 13/25] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:07:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 16:07:42.802279 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a46abe3-3100-48a6-a97b-beb567238eb5 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:07:42.802279 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:07:42.883473 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091692c9-fbc7-4e6c-8962-97e83cd44615 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:07:42.908229 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:07:42.940505 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9310fa-4805-4e46-8d0d-d01178a04f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:07:42.941325 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9310fa-4805-4e46-8d0d-d01178a04f08 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:42.941616 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9310fa-4805-4e46-8d0d-d01178a04f08 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:42.941901 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9310fa-4805-4e46-8d0d-d01178a04f08 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:42.960980 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a46abe3-3100-48a6-a97b-beb567238eb5 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:07:42.967279 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9310fa-4805-4e46-8d0d-d01178a04f08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:07:42.984426 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-fc9310fa-4805-4e46-8d0d-d01178a04f08 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:07:42.984426 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:07:42.984426 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:07:42.984426 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:07:42.984426 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:07:42.984426 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:07:42.984426 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:07:42.984426 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:07:42.984426 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:07:42.984426 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:07:42.984426 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:07:42.984426 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:07:42.984426 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:07:42.984426 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:07:42.984426 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:07:42.984426 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:07:42.985448 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:07:42.985448 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:07:42.985448 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:07:42.985448 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:07:42.985448 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:07:42.985448 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:07:42.985448 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:07:42.985448 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:07:42.985448 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:07:42.985448 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:07:42.985448 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:07:42.985448 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:07:42.985448 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:07:42.985448 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:07:42.985448 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:07:42.985448 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:07:42.986311 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:07:42.986311 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:07:42.986311 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:07:42.986311 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:07:42.986311 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:07:42.986311 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:07:42.986311 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:07:42.986311 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:07:42.986311 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:07:42.986311 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:07:42.986311 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:07:42.986311 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:07:42.986882 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 13/26] 10.222.0.62 () {56 vars in 1096 bytes} [Fri May 27 16:07:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:07:42.988019 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc9b0e6-e342-452a-9b73-abc658658733 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:42.988314 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc9b0e6-e342-452a-9b73-abc658658733 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:42.988602 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc9b0e6-e342-452a-9b73-abc658658733 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:42.994172 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 14/27] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:07:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:07:42.995002 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc9b0e6-e342-452a-9b73-abc658658733 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:07:43.004429 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78af795d-a0fb-4b01-9687-e3bc134894e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:07:43.005416 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af795d-a0fb-4b01-9687-e3bc134894e4 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:43.005846 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af795d-a0fb-4b01-9687-e3bc134894e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:43.006278 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af795d-a0fb-4b01-9687-e3bc134894e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:43.017975 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78af795d-a0fb-4b01-9687-e3bc134894e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:07:43.019782 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78af795d-a0fb-4b01-9687-e3bc134894e4 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:07:43.042921 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-78af795d-a0fb-4b01-9687-e3bc134894e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:07:43.042921 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:07:43.042921 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:07:43.042921 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:07:43.042921 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:07:43.042921 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:07:43.042921 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:07:43.042921 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:07:43.042921 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:07:43.042921 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:07:43.042921 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:07:43.042921 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:07:43.042921 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:07:43.042921 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:07:43.042921 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:07:43.043948 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:07:43.043948 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:07:43.043948 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:07:43.043948 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:07:43.043948 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:07:43.043948 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:07:43.043948 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:07:43.043948 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:07:43.043948 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:07:43.043948 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:07:43.043948 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:07:43.043948 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:07:43.043948 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:07:43.043948 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:07:43.043948 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:07:43.043948 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:07:43.043948 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:07:43.044862 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:07:43.044862 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:07:43.044862 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:07:43.044862 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:07:43.046493 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 14/28] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:07:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:07:43.048125 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7a055-651f-4072-801f-695fe04e2fa0 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:43.048587 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7a055-651f-4072-801f-695fe04e2fa0 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:43.048997 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7a055-651f-4072-801f-695fe04e2fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:43.068933 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-71f7a055-651f-4072-801f-695fe04e2fa0 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:07:43.070394 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-71f7a055-651f-4072-801f-695fe04e2fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:07:43.125342 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:07:43.144053 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 15/29] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:07:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:07:43.145142 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f7a055-651f-4072-801f-695fe04e2fa0 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:07:43.216120 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc9b0e6-e342-452a-9b73-abc658658733 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:07:43.257124 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f7a055-651f-4072-801f-695fe04e2fa0 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:07:43.263247 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242f7d7d-3580-46f2-987a-cf0db163a915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:07:43.263935 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f7d7d-3580-46f2-987a-cf0db163a915 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:43.264225 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f7d7d-3580-46f2-987a-cf0db163a915 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:43.264506 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f7d7d-3580-46f2-987a-cf0db163a915 None admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:43.265333 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242f7d7d-3580-46f2-987a-cf0db163a915 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:07:43.265653 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242f7d7d-3580-46f2-987a-cf0db163a915 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:07:43.267191 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242f7d7d-3580-46f2-987a-cf0db163a915 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:07:43.280362 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 15/30] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 16:07:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:07:43.285689 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242f7d7d-3580-46f2-987a-cf0db163a915 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:07:43.296872 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028c969c-e563-4cc5-b5f9-d034c955cc5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:07:43.297942 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c969c-e563-4cc5-b5f9-d034c955cc5b None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:43.298401 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c969c-e563-4cc5-b5f9-d034c955cc5b None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:43.298891 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c969c-e563-4cc5-b5f9-d034c955cc5b None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:43.299919 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028c969c-e563-4cc5-b5f9-d034c955cc5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:07:43.300363 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028c969c-e563-4cc5-b5f9-d034c955cc5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:07:43.302163 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028c969c-e563-4cc5-b5f9-d034c955cc5b None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:07:43.323038 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 16/31] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 16:07:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:07:43.325199 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67000a25-255a-41f4-b1f0-ba7259bcfb80 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:43.325632 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67000a25-255a-41f4-b1f0-ba7259bcfb80 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:43.326057 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67000a25-255a-41f4-b1f0-ba7259bcfb80 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:43.327530 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 17/32] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:07:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:07:43.328455 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67000a25-255a-41f4-b1f0-ba7259bcfb80 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:07:43.330922 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:07:43.396196 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:07:43.407282 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242f7d7d-3580-46f2-987a-cf0db163a915 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:07:43.451977 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb1e160-493e-43c3-887d-f037f97c8437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:07:43.453589 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb1e160-493e-43c3-887d-f037f97c8437 None admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:43.454073 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb1e160-493e-43c3-887d-f037f97c8437 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:43.454558 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb1e160-493e-43c3-887d-f037f97c8437 None admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:43.455930 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb1e160-493e-43c3-887d-f037f97c8437 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:07:43.457997 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb1e160-493e-43c3-887d-f037f97c8437 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:07:43.462592 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67000a25-255a-41f4-b1f0-ba7259bcfb80 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:07:43.501941 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d942aed-af51-4bfa-9434-4db2c1fee3da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:07:43.502957 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d942aed-af51-4bfa-9434-4db2c1fee3da None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:43.503311 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d942aed-af51-4bfa-9434-4db2c1fee3da None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:43.503662 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d942aed-af51-4bfa-9434-4db2c1fee3da None admin] PATH_INFO: `/v3/users/e26f01858edd43d6bd42a1a5a4965a24` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:43.505006 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d942aed-af51-4bfa-9434-4db2c1fee3da None admin] RBAC: Authorizing `identity:get_user(user_id=e26f01858edd43d6bd42a1a5a4965a24)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:07:43.506623 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d942aed-af51-4bfa-9434-4db2c1fee3da None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:07:43.508264 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 18/33] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 16:07:43 2022] GET /identity/v3/users/e26f01858edd43d6bd42a1a5a4965a24 => generated 247 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:07:43.509005 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d942aed-af51-4bfa-9434-4db2c1fee3da None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:07:43.620798 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d942aed-af51-4bfa-9434-4db2c1fee3da None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:07:43.635749 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:07:43.656756 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c94d7d-0212-4684-beef-b2c1ff66c0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:07:43.659455 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c94d7d-0212-4684-beef-b2c1ff66c0e9 None admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:43.659455 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c94d7d-0212-4684-beef-b2c1ff66c0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:43.659455 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c94d7d-0212-4684-beef-b2c1ff66c0e9 None admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:43.659455 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c94d7d-0212-4684-beef-b2c1ff66c0e9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:07:43.660315 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c94d7d-0212-4684-beef-b2c1ff66c0e9 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:07:43.702929 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 16/34] 10.222.0.62 () {60 vars in 1131 bytes} [Fri May 27 16:07:43 2022] POST /identity/v3/roles => generated 219 bytes in 422 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:07:43.705296 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f2a22-96cd-49cf-aecc-da71b33f4abf None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:43.705846 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f2a22-96cd-49cf-aecc-da71b33f4abf None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:43.706364 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f2a22-96cd-49cf-aecc-da71b33f4abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:43.727309 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-3c6f2a22-96cd-49cf-aecc-da71b33f4abf None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:07:43.729474 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-3c6f2a22-96cd-49cf-aecc-da71b33f4abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:07:43.811374 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 17/35] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:07:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:07:43.812831 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6f2a22-96cd-49cf-aecc-da71b33f4abf None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:07:43.847151 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:07:43.928787 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6f2a22-96cd-49cf-aecc-da71b33f4abf None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:07:43.968053 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e0ad45-fa42-42f0-8e2b-52f34cbe72a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:07:43.969161 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e0ad45-fa42-42f0-8e2b-52f34cbe72a4 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:43.969699 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e0ad45-fa42-42f0-8e2b-52f34cbe72a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:43.970543 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e0ad45-fa42-42f0-8e2b-52f34cbe72a4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:43.972030 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e0ad45-fa42-42f0-8e2b-52f34cbe72a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:07:43.973621 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e0ad45-fa42-42f0-8e2b-52f34cbe72a4 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:07:43.973898 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 19/36] 10.222.0.62 () {60 vars in 1141 bytes} [Fri May 27 16:07:43 2022] POST /identity/v3/projects => generated 301 bytes in 465 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:07:43.975051 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c94d7d-0212-4684-beef-b2c1ff66c0e9 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:07:43.975558 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 18/37] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:07:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:07:43.976782 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6c7d6-0300-4ce3-b45c-6ddef8c6478f None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:43.977071 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6c7d6-0300-4ce3-b45c-6ddef8c6478f None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:43.977348 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6c7d6-0300-4ce3-b45c-6ddef8c6478f None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:43.978731 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 19/38] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:07:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:07:43.984222 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff6c7d6-0300-4ce3-b45c-6ddef8c6478f None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:07:44.121678 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:07:44.121863 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c94d7d-0212-4684-beef-b2c1ff66c0e9 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:07:44.144599 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff6c7d6-0300-4ce3-b45c-6ddef8c6478f None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:07:44.164723 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c86594-8e03-4a76-bccd-c8ce6158aa11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:07:44.165429 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c86594-8e03-4a76-bccd-c8ce6158aa11 None admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:44.165724 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c86594-8e03-4a76-bccd-c8ce6158aa11 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:44.166013 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c86594-8e03-4a76-bccd-c8ce6158aa11 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:44.166875 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c86594-8e03-4a76-bccd-c8ce6158aa11 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:07:44.169265 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c86594-8e03-4a76-bccd-c8ce6158aa11 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:07:44.206805 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b65f98d-e5a9-473a-becd-8dbe26088987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:07:44.207636 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b65f98d-e5a9-473a-becd-8dbe26088987 None admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:44.207932 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b65f98d-e5a9-473a-becd-8dbe26088987 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:44.208274 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b65f98d-e5a9-473a-becd-8dbe26088987 None admin] PATH_INFO: `/v3/domains/default/users/e26f01858edd43d6bd42a1a5a4965a24/roles/e04fe3eb1f714d74901ac83e33ea8a16` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:44.210853 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b65f98d-e5a9-473a-becd-8dbe26088987 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=e26f01858edd43d6bd42a1a5a4965a24, role_id=e04fe3eb1f714d74901ac83e33ea8a16)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:07:44.212505 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b65f98d-e5a9-473a-becd-8dbe26088987 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:07:44.318109 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 20/39] 10.222.0.62 () {58 vars in 1361 bytes} [Fri May 27 16:07:43 2022] PUT /identity/v3/domains/default/users/e26f01858edd43d6bd42a1a5a4965a24/roles/e04fe3eb1f714d74901ac83e33ea8a16 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:07:44.319436 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df482e-3955-4fa0-b681-a044389fd433 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:44.319732 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df482e-3955-4fa0-b681-a044389fd433 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:44.320013 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df482e-3955-4fa0-b681-a044389fd433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:44.340249 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-13df482e-3955-4fa0-b681-a044389fd433 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:07:44.341498 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-13df482e-3955-4fa0-b681-a044389fd433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:07:44.360157 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 20/40] 10.222.0.62 () {60 vars in 1131 bytes} [Fri May 27 16:07:43 2022] POST /identity/v3/roles => generated 225 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:07:44.395845 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b5ff34-2735-4422-a6d1-7ae327d47e30 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:44.396150 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b5ff34-2735-4422-a6d1-7ae327d47e30 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:44.396440 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b5ff34-2735-4422-a6d1-7ae327d47e30 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:44.398277 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 21/41] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:07:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:07:44.405423 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdfdbc4-6521-42e5-ba9e-b87aeb6b92d4 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:44.406091 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdfdbc4-6521-42e5-ba9e-b87aeb6b92d4 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:44.406751 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdfdbc4-6521-42e5-ba9e-b87aeb6b92d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:44.429235 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-3cdfdbc4-6521-42e5-ba9e-b87aeb6b92d4 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:07:44.431711 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-3cdfdbc4-6521-42e5-ba9e-b87aeb6b92d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:07:44.432892 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 21/42] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:07:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:07:44.455908 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13df482e-3955-4fa0-b681-a044389fd433 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:07:44.474751 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:07:44.523694 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 22/43] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:07:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 16:07:44.550201 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdfdbc4-6521-42e5-ba9e-b87aeb6b92d4 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:07:44.558908 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:07:44.575702 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13df482e-3955-4fa0-b681-a044389fd433 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:07:44.624446 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e2c329-633f-47e7-b06e-f4fdc902984e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:07:44.625408 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e2c329-633f-47e7-b06e-f4fdc902984e None admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:44.625704 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e2c329-633f-47e7-b06e-f4fdc902984e None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:44.625982 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e2c329-633f-47e7-b06e-f4fdc902984e None admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:44.629090 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e2c329-633f-47e7-b06e-f4fdc902984e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:07:44.629199 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e2c329-633f-47e7-b06e-f4fdc902984e None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:07:44.669759 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdfdbc4-6521-42e5-ba9e-b87aeb6b92d4 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:07:44.689888 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 22/44] 10.222.0.62 () {60 vars in 1131 bytes} [Fri May 27 16:07:44 2022] POST /identity/v3/roles => generated 223 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:07:44.707704 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33cfeb8-f230-4dc6-baf3-60d002dff014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:07:44.708829 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33cfeb8-f230-4dc6-baf3-60d002dff014 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:44.709354 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33cfeb8-f230-4dc6-baf3-60d002dff014 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:44.709776 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33cfeb8-f230-4dc6-baf3-60d002dff014 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:44.711515 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33cfeb8-f230-4dc6-baf3-60d002dff014 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:07:44.713244 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33cfeb8-f230-4dc6-baf3-60d002dff014 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:07:44.715921 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 23/45] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:07:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:07:44.721755 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e2c329-633f-47e7-b06e-f4fdc902984e None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:07:44.834412 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e2c329-633f-47e7-b06e-f4fdc902984e None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:07:44.880426 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcfb579-75c7-41be-ab86-070cec5097b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:07:44.881119 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcfb579-75c7-41be-ab86-070cec5097b5 None admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:44.881411 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcfb579-75c7-41be-ab86-070cec5097b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:44.881696 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcfb579-75c7-41be-ab86-070cec5097b5 None admin] PATH_INFO: `/v3/projects` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:44.882473 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcfb579-75c7-41be-ab86-070cec5097b5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:07:44.883937 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcfb579-75c7-41be-ab86-070cec5097b5 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:07:44.980425 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:07:44.987298 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 23/46] 10.222.0.62 () {60 vars in 1141 bytes} [Fri May 27 16:07:44 2022] POST /identity/v3/projects => generated 312 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:07:46.601505 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247981c-b799-4314-ae1b-fe55a5d91b1c None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:46.602052 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247981c-b799-4314-ae1b-fe55a5d91b1c None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:46.602052 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247981c-b799-4314-ae1b-fe55a5d91b1c None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:46.603466 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 24/47] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:07:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:07:46.609009 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59777fc5-bc4d-4c1f-9af7-7f30300a87e9 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:46.609396 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59777fc5-bc4d-4c1f-9af7-7f30300a87e9 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:46.609576 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59777fc5-bc4d-4c1f-9af7-7f30300a87e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:46.626575 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-59777fc5-bc4d-4c1f-9af7-7f30300a87e9 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:07:46.627770 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-59777fc5-bc4d-4c1f-9af7-7f30300a87e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:07:46.693358 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 24/48] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:07:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:07:46.715953 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c247981c-b799-4314-ae1b-fe55a5d91b1c None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:07:46.741873 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:07:46.817663 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c247981c-b799-4314-ae1b-fe55a5d91b1c None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:07:46.850799 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19c2d89-1061-4104-b59e-5a522dad5b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:07:46.851650 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19c2d89-1061-4104-b59e-5a522dad5b46 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:46.851880 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19c2d89-1061-4104-b59e-5a522dad5b46 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:46.852158 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19c2d89-1061-4104-b59e-5a522dad5b46 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:46.862118 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19c2d89-1061-4104-b59e-5a522dad5b46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:07:46.869662 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-e19c2d89-1061-4104-b59e-5a522dad5b46 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:07:46.869662 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:07:46.869662 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:07:46.869662 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:07:46.869662 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:07:46.869662 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:07:46.869662 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:07:46.869662 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:07:46.869662 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:07:46.869662 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:07:46.869662 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:07:46.869662 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:07:46.869662 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:07:46.869662 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:07:46.869662 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:07:46.869662 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:07:46.870680 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:07:46.870680 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:07:46.870680 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:07:46.870680 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:07:46.870680 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:07:46.870680 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:07:46.870680 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:07:46.870680 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:07:46.870680 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:07:46.870680 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:07:46.870680 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:07:46.870680 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:07:46.870680 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:07:46.870680 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:07:46.870680 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:07:46.870680 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:07:46.871466 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:07:46.871466 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:07:46.871466 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:07:46.871466 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:07:46.871466 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:07:46.871466 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:07:46.871466 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:07:46.871466 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:07:46.871466 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:07:46.871466 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:07:46.871466 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:07:46.871466 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:07:46.871466 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 25/49] 10.222.0.62 () {56 vars in 1096 bytes} [Fri May 27 16:07:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:07:46.876749 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59777fc5-bc4d-4c1f-9af7-7f30300a87e9 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:07:46.973644 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59777fc5-bc4d-4c1f-9af7-7f30300a87e9 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:07:47.003146 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:07:47.011707 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16bbdf0-79bc-45f0-8a2e-d54f0f6cafaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:07:47.012385 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16bbdf0-79bc-45f0-8a2e-d54f0f6cafaf None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:47.020209 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16bbdf0-79bc-45f0-8a2e-d54f0f6cafaf None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:47.020209 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16bbdf0-79bc-45f0-8a2e-d54f0f6cafaf None admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:47.020209 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16bbdf0-79bc-45f0-8a2e-d54f0f6cafaf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:07:47.020209 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16bbdf0-79bc-45f0-8a2e-d54f0f6cafaf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:07:47.020209 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16bbdf0-79bc-45f0-8a2e-d54f0f6cafaf None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:07:47.023750 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 25/50] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 16:07:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:07:47.029830 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19c2d89-1061-4104-b59e-5a522dad5b46 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:07:47.112576 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:07:47.128181 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19c2d89-1061-4104-b59e-5a522dad5b46 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:07:47.162359 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b63f0ac-f33c-4e6d-a724-a79ce09d1698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:07:47.163242 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b63f0ac-f33c-4e6d-a724-a79ce09d1698 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:47.163535 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b63f0ac-f33c-4e6d-a724-a79ce09d1698 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:47.163822 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b63f0ac-f33c-4e6d-a724-a79ce09d1698 None admin] PATH_INFO: `/v3/users/e26f01858edd43d6bd42a1a5a4965a24` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:47.165022 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b63f0ac-f33c-4e6d-a724-a79ce09d1698 None admin] RBAC: Authorizing `identity:get_user(user_id=e26f01858edd43d6bd42a1a5a4965a24)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:07:47.166621 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b63f0ac-f33c-4e6d-a724-a79ce09d1698 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:07:47.166878 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ccaf7-6af6-4d76-b6d1-3610e71d4ad2 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:47.167176 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ccaf7-6af6-4d76-b6d1-3610e71d4ad2 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:47.167457 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ccaf7-6af6-4d76-b6d1-3610e71d4ad2 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:47.168457 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 26/51] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 16:07:47 2022] GET /identity/v3/users/e26f01858edd43d6bd42a1a5a4965a24 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:07:47.168831 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 26/52] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:07:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:07:47.173316 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b63f0ac-f33c-4e6d-a724-a79ce09d1698 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:07:47.173967 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446aa715-20b9-4c58-aeb6-182eae52ecdd None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:47.174359 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446aa715-20b9-4c58-aeb6-182eae52ecdd None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:47.174648 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446aa715-20b9-4c58-aeb6-182eae52ecdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:47.191519 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-446aa715-20b9-4c58-aeb6-182eae52ecdd None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:07:47.192758 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-446aa715-20b9-4c58-aeb6-182eae52ecdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:07:47.262033 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 27/53] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:07:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 16:07:47.275117 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b63f0ac-f33c-4e6d-a724-a79ce09d1698 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:07:47.285129 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446aa715-20b9-4c58-aeb6-182eae52ecdd None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:07:47.309533 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a29b1d6-8b63-4ec9-811e-f0389ade49cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:07:47.310361 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a29b1d6-8b63-4ec9-811e-f0389ade49cb None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:47.310646 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a29b1d6-8b63-4ec9-811e-f0389ade49cb None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:47.310925 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a29b1d6-8b63-4ec9-811e-f0389ade49cb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:47.312099 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a29b1d6-8b63-4ec9-811e-f0389ade49cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:07:47.313555 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a29b1d6-8b63-4ec9-811e-f0389ade49cb None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:07:47.319716 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 27/54] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:07:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:07:47.320921 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a29b1d6-8b63-4ec9-811e-f0389ade49cb None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:07:47.343574 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:07:47.390039 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446aa715-20b9-4c58-aeb6-182eae52ecdd None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:07:47.410930 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:07:47.422415 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a29b1d6-8b63-4ec9-811e-f0389ade49cb None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:07:47.425034 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b483eb-55d6-49c3-84f3-719ed8cd1eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:07:47.425829 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b483eb-55d6-49c3-84f3-719ed8cd1eaa None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:47.426119 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b483eb-55d6-49c3-84f3-719ed8cd1eaa None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:47.426447 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b483eb-55d6-49c3-84f3-719ed8cd1eaa None admin] PATH_INFO: `/v3/domains/default` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:47.427626 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b483eb-55d6-49c3-84f3-719ed8cd1eaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:07:47.429085 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b483eb-55d6-49c3-84f3-719ed8cd1eaa None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:07:47.431362 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 28/55] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:07:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:07:47.436763 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b483eb-55d6-49c3-84f3-719ed8cd1eaa None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:07:47.456913 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa30e233-d43c-46cd-943d-26999563704d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:07:47.457588 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30e233-d43c-46cd-943d-26999563704d None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:47.459230 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30e233-d43c-46cd-943d-26999563704d None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:47.459230 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30e233-d43c-46cd-943d-26999563704d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:47.459230 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa30e233-d43c-46cd-943d-26999563704d None admin] RBAC: Adding query filter params (role.id=e04fe3eb1f714d74901ac83e33ea8a16, scope.domain.id=default, user.id=e26f01858edd43d6bd42a1a5a4965a24) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:07:47.459511 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa30e233-d43c-46cd-943d-26999563704d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:07:47.460979 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa30e233-d43c-46cd-943d-26999563704d None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:07:47.467434 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 28/56] 10.222.0.62 () {56 vars in 1322 bytes} [Fri May 27 16:07:47 2022] GET /identity/v3/role_assignments?user.id=e26f01858edd43d6bd42a1a5a4965a24&scope.domain.id=default&role.id=e04fe3eb1f714d74901ac83e33ea8a16 => generated 530 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:07:47.541210 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b483eb-55d6-49c3-84f3-719ed8cd1eaa None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:07:47.577208 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4bebdd-0c68-460c-99bc-46aeaf3766fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:07:47.577888 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4bebdd-0c68-460c-99bc-46aeaf3766fa None admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:47.578178 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4bebdd-0c68-460c-99bc-46aeaf3766fa None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:47.578482 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4bebdd-0c68-460c-99bc-46aeaf3766fa None admin] PATH_INFO: `/v3/projects` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:47.579218 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4bebdd-0c68-460c-99bc-46aeaf3766fa None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:07:47.580689 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4bebdd-0c68-460c-99bc-46aeaf3766fa None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:07:47.667977 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 29/57] 10.222.0.62 () {60 vars in 1140 bytes} [Fri May 27 16:07:47 2022] POST /identity/v3/projects => generated 298 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:07:49.849191 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed9cf6-80bd-4047-b13b-a74072757aff None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:49.849694 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed9cf6-80bd-4047-b13b-a74072757aff None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:49.849782 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed9cf6-80bd-4047-b13b-a74072757aff None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:49.851182 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 29/58] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:07:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:07:49.856967 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afbcefc-a282-48a4-9bb1-541f85193a5d None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:49.857375 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afbcefc-a282-48a4-9bb1-541f85193a5d None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:49.857537 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afbcefc-a282-48a4-9bb1-541f85193a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:49.873854 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-1afbcefc-a282-48a4-9bb1-541f85193a5d None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:07:49.875102 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-1afbcefc-a282-48a4-9bb1-541f85193a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:07:49.908855 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:07:49.939433 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 30/59] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:07:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:07:49.964394 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ed9cf6-80bd-4047-b13b-a74072757aff None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:07:50.049077 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:07:50.065301 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ed9cf6-80bd-4047-b13b-a74072757aff None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:07:50.104159 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ca4200-db43-4538-87c3-90ac0047ca79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:07:50.104913 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca4200-db43-4538-87c3-90ac0047ca79 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:50.105204 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca4200-db43-4538-87c3-90ac0047ca79 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:50.105490 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca4200-db43-4538-87c3-90ac0047ca79 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:50.106702 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ca4200-db43-4538-87c3-90ac0047ca79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:07:50.108174 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ca4200-db43-4538-87c3-90ac0047ca79 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:07:50.109806 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 30/60] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:07:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:07:50.115296 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afbcefc-a282-48a4-9bb1-541f85193a5d None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:07:50.211360 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afbcefc-a282-48a4-9bb1-541f85193a5d None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:07:50.244798 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc29e6d1-cbb9-446c-b0bd-ee3981ee75b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:07:50.245961 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29e6d1-cbb9-446c-b0bd-ee3981ee75b8 None admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:50.246274 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29e6d1-cbb9-446c-b0bd-ee3981ee75b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:50.246560 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29e6d1-cbb9-446c-b0bd-ee3981ee75b8 None admin] PATH_INFO: `/v3/users` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:50.247285 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc29e6d1-cbb9-446c-b0bd-ee3981ee75b8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:07:50.248809 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc29e6d1-cbb9-446c-b0bd-ee3981ee75b8 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:07:50.357834 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 31/61] 10.222.0.62 () {60 vars in 1132 bytes} [Fri May 27 16:07:50 2022] POST /identity/v3/users => generated 275 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:07:53.825709 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9656d-1000-4899-b127-9b7b8a2d14e8 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:53.826214 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9656d-1000-4899-b127-9b7b8a2d14e8 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:53.826311 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9656d-1000-4899-b127-9b7b8a2d14e8 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:53.827689 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 31/62] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:07:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:07:53.845046 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443fb6b-6be0-4929-b946-fd2aded2c90c None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:53.845527 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443fb6b-6be0-4929-b946-fd2aded2c90c None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:53.845599 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443fb6b-6be0-4929-b946-fd2aded2c90c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:53.872158 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-f443fb6b-6be0-4929-b946-fd2aded2c90c None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:07:53.873374 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-f443fb6b-6be0-4929-b946-fd2aded2c90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:07:53.890279 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba46f1-3aa8-40ad-a250-f807b3d632a5 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:53.890904 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba46f1-3aa8-40ad-a250-f807b3d632a5 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:53.891394 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba46f1-3aa8-40ad-a250-f807b3d632a5 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:53.893023 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 32/63] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:07:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:07:53.898456 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004faa26-91ea-47ae-a72c-7e875241492f None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:53.898998 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004faa26-91ea-47ae-a72c-7e875241492f None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:53.899493 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004faa26-91ea-47ae-a72c-7e875241492f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:53.902884 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:07:53.927879 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-004faa26-91ea-47ae-a72c-7e875241492f None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:07:53.929429 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-004faa26-91ea-47ae-a72c-7e875241492f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:07:53.969776 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 32/64] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:07:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:07:53.971583 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847803c-5b3b-4891-b986-643bca7a4eae None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:53.972090 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847803c-5b3b-4891-b986-643bca7a4eae None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:53.972566 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847803c-5b3b-4891-b986-643bca7a4eae None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:53.974217 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 33/65] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:07:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:07:53.980878 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d448be70-fef6-4f63-9a4c-6ee33e3e9c53 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:53.981496 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d448be70-fef6-4f63-9a4c-6ee33e3e9c53 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:53.981995 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d448be70-fef6-4f63-9a4c-6ee33e3e9c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:54.001991 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-d448be70-fef6-4f63-9a4c-6ee33e3e9c53 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:07:54.003511 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-d448be70-fef6-4f63-9a4c-6ee33e3e9c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:07:54.013476 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 33/66] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:07:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 16:07:54.014693 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004faa26-91ea-47ae-a72c-7e875241492f None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:07:54.091792 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 34/67] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:07:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:07:54.092654 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d448be70-fef6-4f63-9a4c-6ee33e3e9c53 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:07:54.109986 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:07:54.138747 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004faa26-91ea-47ae-a72c-7e875241492f None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:07:54.175440 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fade7358-d662-42a3-a649-53d2377f0f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:07:54.176678 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade7358-d662-42a3-a649-53d2377f0f6f None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:54.177162 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade7358-d662-42a3-a649-53d2377f0f6f None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:54.177671 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade7358-d662-42a3-a649-53d2377f0f6f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:54.191119 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fade7358-d662-42a3-a649-53d2377f0f6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:07:54.199118 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-fade7358-d662-42a3-a649-53d2377f0f6f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:07:54.199118 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:07:54.199118 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:07:54.199118 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:07:54.199118 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:07:54.199118 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:07:54.199118 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:07:54.199118 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:07:54.199118 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:07:54.199118 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:07:54.199118 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:07:54.199118 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:07:54.199118 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:07:54.199118 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:07:54.199118 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:07:54.199118 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:07:54.200146 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:07:54.200146 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:07:54.200146 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:07:54.200146 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:07:54.200146 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:07:54.200146 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:07:54.200146 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:07:54.200146 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:07:54.200146 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:07:54.200146 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:07:54.200146 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:07:54.200146 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:07:54.200146 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:07:54.200146 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:07:54.200146 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:07:54.200146 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:07:54.200956 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:07:54.200956 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:07:54.200956 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:07:54.200956 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:07:54.200956 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:07:54.200956 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:07:54.200956 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:07:54.200956 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:07:54.200956 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:07:54.200956 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:07:54.200956 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:07:54.200956 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:07:54.203663 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 34/68] 10.222.0.62 () {56 vars in 1096 bytes} [Fri May 27 16:07:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:07:54.204695 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fade7358-d662-42a3-a649-53d2377f0f6f None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:07:54.206119 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:07:54.223038 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d448be70-fef6-4f63-9a4c-6ee33e3e9c53 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:07:54.257493 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ba57ce-6fae-4021-95d6-81cbf5a8e36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:07:54.258325 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba57ce-6fae-4021-95d6-81cbf5a8e36b None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:54.258639 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba57ce-6fae-4021-95d6-81cbf5a8e36b None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:54.258911 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba57ce-6fae-4021-95d6-81cbf5a8e36b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:54.269600 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ba57ce-6fae-4021-95d6-81cbf5a8e36b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:07:54.278279 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-72ba57ce-6fae-4021-95d6-81cbf5a8e36b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 16:07:54.278279 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:07:54.278279 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:07:54.278279 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:07:54.278279 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:07:54.278279 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:07:54.278279 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:07:54.278279 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:07:54.278279 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:07:54.278279 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:07:54.278279 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:07:54.278279 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:07:54.278279 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:07:54.278279 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:07:54.278279 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:07:54.278279 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:07:54.279153 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:07:54.279153 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:07:54.279153 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:07:54.279153 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:07:54.279153 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:07:54.279153 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:07:54.279153 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:07:54.279153 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:07:54.279153 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:07:54.279153 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:07:54.279153 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:07:54.279153 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:07:54.279153 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:07:54.279153 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:07:54.279153 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:07:54.279153 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:07:54.279909 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:07:54.279909 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:07:54.279909 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:07:54.279909 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:07:54.279909 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:07:54.279909 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:07:54.279909 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:07:54.279909 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:07:54.279909 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:07:54.279909 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:07:54.279909 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 16:07:54.279909 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:07:54.279909 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 35/69] 10.222.0.62 () {56 vars in 1114 bytes} [Fri May 27 16:07:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:07:54.280534 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ba57ce-6fae-4021-95d6-81cbf5a8e36b None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:07:54.308293 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fade7358-d662-42a3-a649-53d2377f0f6f None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:07:54.341752 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a204f581-cffd-44d1-9b51-09e1f9fc6af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:07:54.342643 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204f581-cffd-44d1-9b51-09e1f9fc6af3 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:54.342883 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204f581-cffd-44d1-9b51-09e1f9fc6af3 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:54.343169 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204f581-cffd-44d1-9b51-09e1f9fc6af3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:54.353393 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a204f581-cffd-44d1-9b51-09e1f9fc6af3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:07:54.361307 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-a204f581-cffd-44d1-9b51-09e1f9fc6af3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 16:07:54.361307 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:07:54.361307 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:07:54.361307 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:07:54.361307 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:07:54.361307 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:07:54.361307 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:07:54.361307 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:07:54.361307 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:07:54.361307 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:07:54.361307 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:07:54.361307 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:07:54.361307 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:07:54.361307 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:07:54.361307 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:07:54.361307 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:07:54.366711 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:07:54.366711 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:07:54.366711 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:07:54.366711 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:07:54.366711 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:07:54.366711 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:07:54.366711 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:07:54.366711 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:07:54.366711 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:07:54.366711 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:07:54.366711 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:07:54.366711 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:07:54.366711 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:07:54.366711 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:07:54.366711 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:07:54.366711 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:07:54.367493 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:07:54.367493 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:07:54.367493 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:07:54.367493 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:07:54.367493 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:07:54.367493 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:07:54.367493 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:07:54.367493 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:07:54.367493 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:07:54.367493 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:07:54.367493 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 16:07:54.367493 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:07:54.367493 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 35/70] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 16:07:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:07:54.367493 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432cf0e-0228-4aa7-8767-51caabb93395 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:54.368163 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432cf0e-0228-4aa7-8767-51caabb93395 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:54.368163 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432cf0e-0228-4aa7-8767-51caabb93395 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:54.368163 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 36/71] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:07:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:07:54.368163 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac780e6b-40f0-4573-954b-3fdcff1ef7c4 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:54.368163 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac780e6b-40f0-4573-954b-3fdcff1ef7c4 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:54.368163 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac780e6b-40f0-4573-954b-3fdcff1ef7c4 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:54.368663 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 37/72] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:07:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:07:54.371071 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac780e6b-40f0-4573-954b-3fdcff1ef7c4 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:07:54.374456 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:07:54.387541 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ba57ce-6fae-4021-95d6-81cbf5a8e36b None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:07:54.420639 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d22220-29b3-44e2-9a3f-a7371264102a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:07:54.421313 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d22220-29b3-44e2-9a3f-a7371264102a None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:54.421600 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d22220-29b3-44e2-9a3f-a7371264102a None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:54.421890 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d22220-29b3-44e2-9a3f-a7371264102a None admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:54.422681 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d22220-29b3-44e2-9a3f-a7371264102a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:07:54.422996 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d22220-29b3-44e2-9a3f-a7371264102a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:07:54.424392 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d22220-29b3-44e2-9a3f-a7371264102a None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:07:54.433376 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 36/73] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 16:07:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:07:54.434061 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d22220-29b3-44e2-9a3f-a7371264102a None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:07:54.445928 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:07:54.473422 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac780e6b-40f0-4573-954b-3fdcff1ef7c4 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:07:54.507686 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707c3cef-88dc-45e6-a293-594b1ae32b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:07:54.508352 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707c3cef-88dc-45e6-a293-594b1ae32b54 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:54.508641 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707c3cef-88dc-45e6-a293-594b1ae32b54 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:54.508924 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707c3cef-88dc-45e6-a293-594b1ae32b54 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:54.509666 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707c3cef-88dc-45e6-a293-594b1ae32b54 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:07:54.509980 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707c3cef-88dc-45e6-a293-594b1ae32b54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:07:54.511923 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707c3cef-88dc-45e6-a293-594b1ae32b54 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:07:54.520264 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 38/74] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 16:07:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:07:54.523581 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d41b26-beb2-478b-a8fb-273c4dd4a4f9 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:54.524001 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d41b26-beb2-478b-a8fb-273c4dd4a4f9 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:54.524295 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d41b26-beb2-478b-a8fb-273c4dd4a4f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:54.536025 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d22220-29b3-44e2-9a3f-a7371264102a None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:07:54.540636 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-d5d41b26-beb2-478b-a8fb-273c4dd4a4f9 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:07:54.541850 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-d5d41b26-beb2-478b-a8fb-273c4dd4a4f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:07:54.568490 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461aac16-f918-463c-8486-1121548775e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:07:54.569159 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461aac16-f918-463c-8486-1121548775e1 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:54.569445 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461aac16-f918-463c-8486-1121548775e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:54.569727 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461aac16-f918-463c-8486-1121548775e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:54.570515 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461aac16-f918-463c-8486-1121548775e1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:07:54.570837 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461aac16-f918-463c-8486-1121548775e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:07:54.572205 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461aac16-f918-463c-8486-1121548775e1 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:07:54.580629 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 37/75] 10.222.0.62 () {56 vars in 1101 bytes} [Fri May 27 16:07:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:07:54.581884 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c2d67-2a71-4fac-8f82-da32e250e1da None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:54.582182 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c2d67-2a71-4fac-8f82-da32e250e1da None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:54.582497 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c2d67-2a71-4fac-8f82-da32e250e1da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:54.598977 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-ee5c2d67-2a71-4fac-8f82-da32e250e1da None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:07:54.599670 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:07:54.600104 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-ee5c2d67-2a71-4fac-8f82-da32e250e1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:07:54.608176 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 39/76] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:07:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:07:54.626431 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d41b26-beb2-478b-a8fb-273c4dd4a4f9 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:07:54.661981 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:07:54.666457 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 38/77] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:07:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:07:54.667846 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5c2d67-2a71-4fac-8f82-da32e250e1da None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:07:54.712826 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d41b26-beb2-478b-a8fb-273c4dd4a4f9 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:07:54.746131 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0611cb-a8aa-47b8-bdde-daeb977cf71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:07:54.747032 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0611cb-a8aa-47b8-bdde-daeb977cf71e None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:54.747326 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0611cb-a8aa-47b8-bdde-daeb977cf71e None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:54.747609 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0611cb-a8aa-47b8-bdde-daeb977cf71e None admin] PATH_INFO: `/v3/users/e26f01858edd43d6bd42a1a5a4965a24` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:54.748805 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0611cb-a8aa-47b8-bdde-daeb977cf71e None admin] RBAC: Authorizing `identity:get_user(user_id=e26f01858edd43d6bd42a1a5a4965a24)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:07:54.750300 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0611cb-a8aa-47b8-bdde-daeb977cf71e None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:07:54.751925 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 40/78] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 16:07:54 2022] GET /identity/v3/users/e26f01858edd43d6bd42a1a5a4965a24 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:07:54.752698 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0611cb-a8aa-47b8-bdde-daeb977cf71e None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:07:54.768474 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5c2d67-2a71-4fac-8f82-da32e250e1da None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:07:54.801876 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525b7438-76f8-4b61-a60d-c6672a9bccc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:07:54.802807 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b7438-76f8-4b61-a60d-c6672a9bccc2 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:54.803095 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b7438-76f8-4b61-a60d-c6672a9bccc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:54.803377 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b7438-76f8-4b61-a60d-c6672a9bccc2 None admin] PATH_INFO: `/v3/users/13643c5d35d44115a5784bad3c8e4cf7` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:54.811979 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:07:54.820020 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525b7438-76f8-4b61-a60d-c6672a9bccc2 None admin] RBAC: Authorizing `identity:get_user(user_id=13643c5d35d44115a5784bad3c8e4cf7)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:07:54.821488 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525b7438-76f8-4b61-a60d-c6672a9bccc2 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:07:54.823259 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 39/79] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 16:07:54 2022] GET /identity/v3/users/13643c5d35d44115a5784bad3c8e4cf7 => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:07:54.824121 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525b7438-76f8-4b61-a60d-c6672a9bccc2 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:07:54.851199 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0611cb-a8aa-47b8-bdde-daeb977cf71e None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:07:54.886386 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:07:54.887742 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96609f57-c4ad-4368-a2fa-aeabaf14b00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:07:54.888621 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96609f57-c4ad-4368-a2fa-aeabaf14b00b None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:54.888912 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96609f57-c4ad-4368-a2fa-aeabaf14b00b None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:54.889196 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96609f57-c4ad-4368-a2fa-aeabaf14b00b None admin] PATH_INFO: `/v3/users/13643c5d35d44115a5784bad3c8e4cf7` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:54.890454 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96609f57-c4ad-4368-a2fa-aeabaf14b00b None admin] RBAC: Authorizing `identity:get_user(user_id=13643c5d35d44115a5784bad3c8e4cf7)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:07:54.891913 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96609f57-c4ad-4368-a2fa-aeabaf14b00b None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:07:54.893552 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 41/80] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 16:07:54 2022] GET /identity/v3/users/13643c5d35d44115a5784bad3c8e4cf7 => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:07:54.894351 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96609f57-c4ad-4368-a2fa-aeabaf14b00b None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:07:54.936353 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525b7438-76f8-4b61-a60d-c6672a9bccc2 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:07:54.970929 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c9640b-06c5-4774-953d-ec6373ccd635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:07:54.971726 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c9640b-06c5-4774-953d-ec6373ccd635 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:54.972017 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c9640b-06c5-4774-953d-ec6373ccd635 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:54.972300 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c9640b-06c5-4774-953d-ec6373ccd635 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:54.973496 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c9640b-06c5-4774-953d-ec6373ccd635 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:07:54.974993 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c9640b-06c5-4774-953d-ec6373ccd635 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:07:54.976620 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 40/81] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:07:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:07:54.977389 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c9640b-06c5-4774-953d-ec6373ccd635 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:07:54.999819 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96609f57-c4ad-4368-a2fa-aeabaf14b00b None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:07:55.028171 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:07:55.033884 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81a141e-e8ec-4005-87af-8bad30bd76da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:07:55.034730 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a141e-e8ec-4005-87af-8bad30bd76da None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:55.037939 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a141e-e8ec-4005-87af-8bad30bd76da None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:55.037939 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a141e-e8ec-4005-87af-8bad30bd76da None admin] PATH_INFO: `/v3/roles/member` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:55.046335 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81a141e-e8ec-4005-87af-8bad30bd76da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:07:55.054858 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-c81a141e-e8ec-4005-87af-8bad30bd76da None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 16:07:55.054858 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:07:55.054858 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:07:55.054858 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:07:55.054858 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:07:55.054858 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:07:55.054858 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:07:55.054858 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:07:55.054858 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:07:55.054858 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:07:55.054858 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:07:55.054858 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:07:55.054858 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:07:55.054858 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:07:55.054858 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:07:55.054858 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:07:55.055915 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:07:55.055915 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:07:55.055915 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:07:55.055915 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:07:55.055915 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:07:55.055915 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:07:55.055915 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:07:55.055915 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:07:55.055915 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:07:55.055915 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:07:55.055915 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:07:55.055915 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:07:55.055915 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:07:55.055915 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:07:55.055915 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:07:55.055915 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:07:55.056766 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:07:55.056766 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:07:55.056766 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:07:55.056766 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:07:55.056766 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:07:55.056766 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:07:55.056766 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:07:55.056766 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:07:55.056766 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:07:55.056766 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:07:55.056766 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 16:07:55.056766 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:07:55.056766 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 42/82] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 16:07:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:07:55.061690 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81a141e-e8ec-4005-87af-8bad30bd76da None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:07:55.079328 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c9640b-06c5-4774-953d-ec6373ccd635 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:07:55.104444 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:07:55.112559 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7095985-5492-46f4-a7ec-dfd5d6ec1a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:07:55.113837 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7095985-5492-46f4-a7ec-dfd5d6ec1a42 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:55.113837 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7095985-5492-46f4-a7ec-dfd5d6ec1a42 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:55.113837 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7095985-5492-46f4-a7ec-dfd5d6ec1a42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:55.161366 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81a141e-e8ec-4005-87af-8bad30bd76da None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:07:55.184392 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7095985-5492-46f4-a7ec-dfd5d6ec1a42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:07:55.185866 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7095985-5492-46f4-a7ec-dfd5d6ec1a42 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:07:55.194384 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a94f6-6164-4668-babc-6fd43cc54e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:07:55.195028 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a94f6-6164-4668-babc-6fd43cc54e51 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:55.195317 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a94f6-6164-4668-babc-6fd43cc54e51 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:55.195601 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a94f6-6164-4668-babc-6fd43cc54e51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:55.253026 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:07:55.264865 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02a94f6-6164-4668-babc-6fd43cc54e51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:07:55.267650 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02a94f6-6164-4668-babc-6fd43cc54e51 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:07:55.284659 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 41/83] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 16:07:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 16:07:55.285532 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7095985-5492-46f4-a7ec-dfd5d6ec1a42 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:07:55.315559 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:07:55.373485 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 43/84] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 16:07:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 16:07:55.374239 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a94f6-6164-4668-babc-6fd43cc54e51 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:07:55.390627 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7095985-5492-46f4-a7ec-dfd5d6ec1a42 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:07:55.426905 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8791505-95a6-4c18-9bcd-2a53598cf26f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:07:55.427550 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8791505-95a6-4c18-9bcd-2a53598cf26f None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:55.427835 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8791505-95a6-4c18-9bcd-2a53598cf26f None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:55.428115 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8791505-95a6-4c18-9bcd-2a53598cf26f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:55.462396 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:07:55.471787 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a94f6-6164-4668-babc-6fd43cc54e51 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:07:55.494373 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8791505-95a6-4c18-9bcd-2a53598cf26f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:07:55.495898 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8791505-95a6-4c18-9bcd-2a53598cf26f None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:07:55.506005 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bdadd6-cd00-4f29-be66-5de6eeadab41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:07:55.506717 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bdadd6-cd00-4f29-be66-5de6eeadab41 None admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:55.507006 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bdadd6-cd00-4f29-be66-5de6eeadab41 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:55.507289 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bdadd6-cd00-4f29-be66-5de6eeadab41 None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:55.507990 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bdadd6-cd00-4f29-be66-5de6eeadab41 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:07:55.509419 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bdadd6-cd00-4f29-be66-5de6eeadab41 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:07:55.520916 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:07:55.590970 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 42/85] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 16:07:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 16:07:55.595562 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8791505-95a6-4c18-9bcd-2a53598cf26f None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:07:55.630695 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 44/86] 10.222.0.62 () {60 vars in 1132 bytes} [Fri May 27 16:07:55 2022] POST /identity/v3/users => generated 289 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:07:55.647373 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bdadd6-cd00-4f29-be66-5de6eeadab41 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:07:55.709009 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8791505-95a6-4c18-9bcd-2a53598cf26f None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:07:55.738214 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:07:55.749775 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cef0c56-5406-4551-88cf-0a8eee006915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:07:55.750494 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef0c56-5406-4551-88cf-0a8eee006915 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:55.750790 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef0c56-5406-4551-88cf-0a8eee006915 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:55.751077 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef0c56-5406-4551-88cf-0a8eee006915 None admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:55.751849 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cef0c56-5406-4551-88cf-0a8eee006915 None admin] RBAC: Adding query filter params (name=member) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:07:55.752164 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cef0c56-5406-4551-88cf-0a8eee006915 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:07:55.753615 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cef0c56-5406-4551-88cf-0a8eee006915 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:07:55.764527 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 43/87] 10.222.0.62 () {56 vars in 1101 bytes} [Fri May 27 16:07:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:07:55.765423 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cef0c56-5406-4551-88cf-0a8eee006915 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:07:55.773700 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bdadd6-cd00-4f29-be66-5de6eeadab41 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:07:55.813136 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a928ecb-1f6c-4c4f-9870-582d0a409893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:07:55.814237 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a928ecb-1f6c-4c4f-9870-582d0a409893 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:55.814357 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a928ecb-1f6c-4c4f-9870-582d0a409893 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:55.814570 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a928ecb-1f6c-4c4f-9870-582d0a409893 None admin] PATH_INFO: `/v3/projects/d280b4797bdd4aabacba365ec82ca978` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:55.815774 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a928ecb-1f6c-4c4f-9870-582d0a409893 None admin] RBAC: Authorizing `identity:get_project(project_id=d280b4797bdd4aabacba365ec82ca978)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:07:55.817230 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a928ecb-1f6c-4c4f-9870-582d0a409893 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:07:55.818964 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 45/88] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 16:07:55 2022] GET /identity/v3/projects/d280b4797bdd4aabacba365ec82ca978 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:07:55.819723 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a928ecb-1f6c-4c4f-9870-582d0a409893 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:07:55.839957 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:07:55.891110 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cef0c56-5406-4551-88cf-0a8eee006915 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:07:55.929038 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b1fdc-a7bb-459c-ba3e-9c6cbb6a16ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:07:55.930396 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b1fdc-a7bb-459c-ba3e-9c6cbb6a16ee None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:55.930803 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b1fdc-a7bb-459c-ba3e-9c6cbb6a16ee None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:55.931094 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b1fdc-a7bb-459c-ba3e-9c6cbb6a16ee None admin] PATH_INFO: `/v3/projects/d280b4797bdd4aabacba365ec82ca978` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:55.932403 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153b1fdc-a7bb-459c-ba3e-9c6cbb6a16ee None admin] RBAC: Authorizing `identity:get_project(project_id=d280b4797bdd4aabacba365ec82ca978)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:07:55.933915 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153b1fdc-a7bb-459c-ba3e-9c6cbb6a16ee None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:07:55.935877 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 44/89] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 16:07:55 2022] GET /identity/v3/projects/d280b4797bdd4aabacba365ec82ca978 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:07:55.936777 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b1fdc-a7bb-459c-ba3e-9c6cbb6a16ee None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:07:55.947239 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a928ecb-1f6c-4c4f-9870-582d0a409893 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:07:55.992531 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8880be1d-542c-420c-9327-48ad7f52f19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:07:55.993675 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880be1d-542c-420c-9327-48ad7f52f19a None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:55.993959 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880be1d-542c-420c-9327-48ad7f52f19a None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:55.994238 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880be1d-542c-420c-9327-48ad7f52f19a None admin] PATH_INFO: `/v3/projects/d280b4797bdd4aabacba365ec82ca978` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:55.995815 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8880be1d-542c-420c-9327-48ad7f52f19a None admin] RBAC: Authorizing `identity:get_project(project_id=d280b4797bdd4aabacba365ec82ca978)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:07:55.997989 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8880be1d-542c-420c-9327-48ad7f52f19a None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:07:55.999456 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 46/90] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 16:07:55 2022] GET /identity/v3/projects/d280b4797bdd4aabacba365ec82ca978 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:07:56.000295 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8880be1d-542c-420c-9327-48ad7f52f19a None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:07:56.009412 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:07:56.070164 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b1fdc-a7bb-459c-ba3e-9c6cbb6a16ee None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:07:56.097823 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:07:56.117395 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7686464-e3dc-4ef0-a7a1-61525c1aee5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:07:56.117623 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8880be1d-542c-420c-9327-48ad7f52f19a None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:07:56.118304 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7686464-e3dc-4ef0-a7a1-61525c1aee5a None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:56.118603 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7686464-e3dc-4ef0-a7a1-61525c1aee5a None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:56.118888 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7686464-e3dc-4ef0-a7a1-61525c1aee5a None admin] PATH_INFO: `/v3/users/13643c5d35d44115a5784bad3c8e4cf7` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:56.121116 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7686464-e3dc-4ef0-a7a1-61525c1aee5a None admin] RBAC: Authorizing `identity:get_user(user_id=13643c5d35d44115a5784bad3c8e4cf7)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:07:56.122761 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7686464-e3dc-4ef0-a7a1-61525c1aee5a None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:07:56.124422 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 45/91] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 16:07:55 2022] GET /identity/v3/users/13643c5d35d44115a5784bad3c8e4cf7 => generated 275 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:07:56.125217 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7686464-e3dc-4ef0-a7a1-61525c1aee5a None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:07:56.167825 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec310e4-4b13-4c9b-bb38-78686acb8871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:07:56.167825 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec310e4-4b13-4c9b-bb38-78686acb8871 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:56.168106 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec310e4-4b13-4c9b-bb38-78686acb8871 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:56.168348 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec310e4-4b13-4c9b-bb38-78686acb8871 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:56.169184 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec310e4-4b13-4c9b-bb38-78686acb8871 None admin] RBAC: Adding query filter params (role.id=e04fe3eb1f714d74901ac83e33ea8a16, scope.project.id=d280b4797bdd4aabacba365ec82ca978, user.id=e26f01858edd43d6bd42a1a5a4965a24) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:07:56.169499 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec310e4-4b13-4c9b-bb38-78686acb8871 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:07:56.170986 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec310e4-4b13-4c9b-bb38-78686acb8871 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:07:56.177358 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 47/92] 10.222.0.62 () {56 vars in 1374 bytes} [Fri May 27 16:07:55 2022] GET /identity/v3/role_assignments?user.id=e26f01858edd43d6bd42a1a5a4965a24&scope.project.id=d280b4797bdd4aabacba365ec82ca978&role.id=e04fe3eb1f714d74901ac83e33ea8a16 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:07:56.178274 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec310e4-4b13-4c9b-bb38-78686acb8871 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:07:56.266665 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7686464-e3dc-4ef0-a7a1-61525c1aee5a None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:07:56.293150 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec310e4-4b13-4c9b-bb38-78686acb8871 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:07:56.305499 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:07:56.325673 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af30140-14eb-43b3-8947-5d56a2ee76c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:07:56.326679 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af30140-14eb-43b3-8947-5d56a2ee76c3 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:56.327479 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af30140-14eb-43b3-8947-5d56a2ee76c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:56.327784 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af30140-14eb-43b3-8947-5d56a2ee76c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:56.328943 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af30140-14eb-43b3-8947-5d56a2ee76c3 None admin] RBAC: Adding query filter params (role.id=404d2ea20e7c4842892e5001133f1b93, scope.project.id=d280b4797bdd4aabacba365ec82ca978, user.id=13643c5d35d44115a5784bad3c8e4cf7) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:07:56.329290 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af30140-14eb-43b3-8947-5d56a2ee76c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:07:56.331857 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af30140-14eb-43b3-8947-5d56a2ee76c3 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:07:56.336202 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e78feff-8b96-49a1-83e2-a56e501ee398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:07:56.337004 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78feff-8b96-49a1-83e2-a56e501ee398 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:56.337356 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78feff-8b96-49a1-83e2-a56e501ee398 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:56.337732 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78feff-8b96-49a1-83e2-a56e501ee398 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:56.338803 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e78feff-8b96-49a1-83e2-a56e501ee398 None admin] RBAC: Adding query filter params (role.id=c8ce6d197f654598ac45f6016ecccabd, scope.project.id=d280b4797bdd4aabacba365ec82ca978, user.id=13643c5d35d44115a5784bad3c8e4cf7) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:07:56.339120 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e78feff-8b96-49a1-83e2-a56e501ee398 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:07:56.340606 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e78feff-8b96-49a1-83e2-a56e501ee398 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:07:56.346962 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 46/93] 10.222.0.62 () {56 vars in 1374 bytes} [Fri May 27 16:07:56 2022] GET /identity/v3/role_assignments?user.id=13643c5d35d44115a5784bad3c8e4cf7&scope.project.id=d280b4797bdd4aabacba365ec82ca978&role.id=404d2ea20e7c4842892e5001133f1b93 => generated 259 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:07:56.347630 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 48/94] 10.222.0.62 () {56 vars in 1374 bytes} [Fri May 27 16:07:56 2022] GET /identity/v3/role_assignments?user.id=13643c5d35d44115a5784bad3c8e4cf7&scope.project.id=d280b4797bdd4aabacba365ec82ca978&role.id=c8ce6d197f654598ac45f6016ecccabd => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:07:56.348581 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af30140-14eb-43b3-8947-5d56a2ee76c3 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:07:56.529921 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af30140-14eb-43b3-8947-5d56a2ee76c3 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:07:56.574793 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e07b3c-7cad-4ac8-a08d-8397c633abde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:07:56.575463 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e07b3c-7cad-4ac8-a08d-8397c633abde None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:56.575748 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e07b3c-7cad-4ac8-a08d-8397c633abde None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:56.576078 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e07b3c-7cad-4ac8-a08d-8397c633abde None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:56.648721 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:07:56.674381 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e07b3c-7cad-4ac8-a08d-8397c633abde None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:07:56.676236 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e07b3c-7cad-4ac8-a08d-8397c633abde None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:07:56.819552 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 47/95] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 16:07:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 16:07:56.825711 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e78feff-8b96-49a1-83e2-a56e501ee398 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:07:56.848135 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:07:56.953637 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e78feff-8b96-49a1-83e2-a56e501ee398 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:07:56.998233 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4af99c-2ef1-495e-92ac-255958e676f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:07:56.999133 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4af99c-2ef1-495e-92ac-255958e676f7 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:56.999421 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4af99c-2ef1-495e-92ac-255958e676f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:56.999704 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4af99c-2ef1-495e-92ac-255958e676f7 None admin] PATH_INFO: `/v3/projects/f4b9437a134d464f9bd95f713cc2b841` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:57.000935 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4af99c-2ef1-495e-92ac-255958e676f7 None admin] RBAC: Authorizing `identity:get_project(project_id=f4b9437a134d464f9bd95f713cc2b841)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:07:57.002439 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4af99c-2ef1-495e-92ac-255958e676f7 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:07:57.004164 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 49/96] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 16:07:56 2022] GET /identity/v3/projects/f4b9437a134d464f9bd95f713cc2b841 => generated 312 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:07:57.009842 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e07b3c-7cad-4ac8-a08d-8397c633abde None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:07:57.136169 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:07:57.149279 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e07b3c-7cad-4ac8-a08d-8397c633abde None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:07:57.193188 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b5e0c-f798-40f3-afc9-c6aa2f6713c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:07:57.193860 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b5e0c-f798-40f3-afc9-c6aa2f6713c6 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:57.194156 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b5e0c-f798-40f3-afc9-c6aa2f6713c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:57.194463 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b5e0c-f798-40f3-afc9-c6aa2f6713c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:57.195428 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57b5e0c-f798-40f3-afc9-c6aa2f6713c6 None admin] RBAC: Adding query filter params (role.id=c8ce6d197f654598ac45f6016ecccabd, scope.project.id=f4b9437a134d464f9bd95f713cc2b841, user.id=13643c5d35d44115a5784bad3c8e4cf7) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:07:57.195747 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57b5e0c-f798-40f3-afc9-c6aa2f6713c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:07:57.197219 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57b5e0c-f798-40f3-afc9-c6aa2f6713c6 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:07:57.206518 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 48/97] 10.222.0.62 () {56 vars in 1374 bytes} [Fri May 27 16:07:57 2022] GET /identity/v3/role_assignments?user.id=13643c5d35d44115a5784bad3c8e4cf7&scope.project.id=f4b9437a134d464f9bd95f713cc2b841&role.id=c8ce6d197f654598ac45f6016ecccabd => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:07:58.607037 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f07178-39d5-4890-9bcb-578b9e864c40 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:58.607651 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f07178-39d5-4890-9bcb-578b9e864c40 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:58.607651 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f07178-39d5-4890-9bcb-578b9e864c40 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:58.608981 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 50/98] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:07:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:07:58.614795 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b5840-3731-4cf6-b6cb-9a910a51adac None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:58.615302 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b5840-3731-4cf6-b6cb-9a910a51adac None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:58.615381 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b5840-3731-4cf6-b6cb-9a910a51adac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:58.643251 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-313b5840-3731-4cf6-b6cb-9a910a51adac None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:07:58.644475 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-313b5840-3731-4cf6-b6cb-9a910a51adac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:07:58.735278 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 49/99] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:07:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:07:58.758725 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f07178-39d5-4890-9bcb-578b9e864c40 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:07:58.845329 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:07:58.868906 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f07178-39d5-4890-9bcb-578b9e864c40 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:07:58.904175 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44296906-171a-4cb4-b096-2b0b83405d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:07:58.905031 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44296906-171a-4cb4-b096-2b0b83405d1d None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:58.905326 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44296906-171a-4cb4-b096-2b0b83405d1d None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:58.905613 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44296906-171a-4cb4-b096-2b0b83405d1d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:58.906834 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44296906-171a-4cb4-b096-2b0b83405d1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:07:58.908728 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44296906-171a-4cb4-b096-2b0b83405d1d None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:07:58.914544 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 51/100] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:07:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:07:58.916987 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313b5840-3731-4cf6-b6cb-9a910a51adac None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:07:58.969136 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada5a530-6105-455a-818c-643f6e3baa08 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:58.969447 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada5a530-6105-455a-818c-643f6e3baa08 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:58.969708 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada5a530-6105-455a-818c-643f6e3baa08 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:58.971186 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 52/101] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:07:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 16:07:58.976207 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23060a5-6ed9-4593-bd18-adf1a5f2c23d None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:58.976503 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23060a5-6ed9-4593-bd18-adf1a5f2c23d None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:58.976865 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23060a5-6ed9-4593-bd18-adf1a5f2c23d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:58.999853 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-c23060a5-6ed9-4593-bd18-adf1a5f2c23d None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:07:59.001069 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-c23060a5-6ed9-4593-bd18-adf1a5f2c23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:07:59.056241 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:07:59.095711 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313b5840-3731-4cf6-b6cb-9a910a51adac None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:07:59.143179 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 53/102] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:07:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:07:59.153861 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f689271-033c-4388-a72e-d00f3182b3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:07:59.154871 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f689271-033c-4388-a72e-d00f3182b3a9 None admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:59.155323 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f689271-033c-4388-a72e-d00f3182b3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:59.155757 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f689271-033c-4388-a72e-d00f3182b3a9 None admin] PATH_INFO: `/v3/projects` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:59.156703 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f689271-033c-4388-a72e-d00f3182b3a9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:07:59.158325 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f689271-033c-4388-a72e-d00f3182b3a9 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:07:59.183092 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23060a5-6ed9-4593-bd18-adf1a5f2c23d None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:07:59.270125 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 50/103] 10.222.0.62 () {60 vars in 1141 bytes} [Fri May 27 16:07:58 2022] POST /identity/v3/projects => generated 302 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:07:59.271492 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a0c69-cc1a-4e52-b833-1566ee461149 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:59.271784 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a0c69-cc1a-4e52-b833-1566ee461149 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:59.272064 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a0c69-cc1a-4e52-b833-1566ee461149 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:59.274406 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 51/104] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:07:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:07:59.282908 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb411d6d-92ed-4977-a98a-3916dbc7d6d3 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:59.283228 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb411d6d-92ed-4977-a98a-3916dbc7d6d3 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:59.283476 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb411d6d-92ed-4977-a98a-3916dbc7d6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:59.308644 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-eb411d6d-92ed-4977-a98a-3916dbc7d6d3 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:07:59.310204 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-eb411d6d-92ed-4977-a98a-3916dbc7d6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:07:59.322283 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:07:59.366510 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23060a5-6ed9-4593-bd18-adf1a5f2c23d None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:07:59.437993 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b3f8b8-9639-4f35-9058-0ddee19389d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:07:59.438760 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b3f8b8-9639-4f35-9058-0ddee19389d1 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:59.439047 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b3f8b8-9639-4f35-9058-0ddee19389d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:59.439329 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b3f8b8-9639-4f35-9058-0ddee19389d1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:59.452110 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 52/105] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:07:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 27 16:07:59.465395 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b3f8b8-9639-4f35-9058-0ddee19389d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:07:59.473826 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-92b3f8b8-9639-4f35-9058-0ddee19389d1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 16:07:59.473826 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:07:59.473826 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:07:59.473826 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:07:59.473826 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:07:59.473826 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:07:59.473826 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:07:59.473826 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:07:59.473826 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:07:59.473826 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:07:59.473826 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:07:59.473826 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:07:59.473826 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:07:59.473826 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:07:59.473826 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:07:59.473826 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:07:59.474819 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:07:59.474819 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:07:59.474819 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:07:59.474819 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:07:59.474819 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:07:59.474819 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:07:59.474819 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:07:59.474819 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:07:59.474819 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:07:59.474819 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:07:59.474819 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:07:59.474819 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:07:59.474819 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:07:59.474819 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:07:59.474819 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:07:59.474819 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:07:59.475604 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:07:59.475604 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:07:59.475604 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:07:59.475604 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:07:59.475604 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:07:59.475604 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:07:59.475604 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:07:59.475604 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:07:59.475604 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:07:59.475604 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:07:59.475604 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 16:07:59.475604 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:07:59.475604 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 54/106] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 16:07:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:07:59.481767 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb411d6d-92ed-4977-a98a-3916dbc7d6d3 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:07:59.526781 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b3f8b8-9639-4f35-9058-0ddee19389d1 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:07:59.584797 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:07:59.633972 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb411d6d-92ed-4977-a98a-3916dbc7d6d3 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:07:59.672638 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b3f8b8-9639-4f35-9058-0ddee19389d1 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:07:59.696255 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5713805-fbc7-4724-a734-b5e47a6a8379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:07:59.696255 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5713805-fbc7-4724-a734-b5e47a6a8379 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:59.696255 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5713805-fbc7-4724-a734-b5e47a6a8379 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:59.696575 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5713805-fbc7-4724-a734-b5e47a6a8379 None admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:59.697235 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5713805-fbc7-4724-a734-b5e47a6a8379 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:07:59.697552 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5713805-fbc7-4724-a734-b5e47a6a8379 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:07:59.701231 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5713805-fbc7-4724-a734-b5e47a6a8379 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:07:59.711244 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 53/107] 10.222.0.62 () {56 vars in 1101 bytes} [Fri May 27 16:07:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:07:59.717437 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5713805-fbc7-4724-a734-b5e47a6a8379 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:07:59.729524 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d1d994-712d-4741-bdc2-c8c01d66912c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:07:59.730990 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d1d994-712d-4741-bdc2-c8c01d66912c None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:59.731389 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d1d994-712d-4741-bdc2-c8c01d66912c None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:59.731790 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d1d994-712d-4741-bdc2-c8c01d66912c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:59.735872 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:07:59.745934 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d1d994-712d-4741-bdc2-c8c01d66912c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:07:59.754833 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-f4d1d994-712d-4741-bdc2-c8c01d66912c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 16:07:59.754833 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:07:59.754833 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:07:59.754833 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:07:59.754833 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:07:59.754833 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:07:59.754833 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:07:59.754833 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:07:59.754833 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:07:59.754833 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:07:59.754833 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:07:59.754833 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:07:59.754833 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:07:59.754833 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:07:59.754833 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:07:59.754833 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:07:59.755684 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:07:59.755684 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:07:59.755684 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:07:59.755684 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:07:59.755684 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:07:59.755684 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:07:59.755684 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:07:59.755684 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:07:59.755684 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:07:59.755684 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:07:59.755684 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:07:59.755684 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:07:59.755684 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:07:59.755684 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:07:59.755684 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:07:59.755684 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:07:59.756456 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:07:59.756456 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:07:59.756456 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:07:59.756456 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:07:59.756456 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:07:59.756456 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:07:59.756456 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:07:59.756456 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:07:59.756456 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:07:59.756456 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:07:59.756456 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 16:07:59.756456 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:07:59.759005 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 55/108] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 16:07:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:07:59.765570 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d1d994-712d-4741-bdc2-c8c01d66912c None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:07:59.843669 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5713805-fbc7-4724-a734-b5e47a6a8379 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:07:59.879282 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:07:59.889206 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2086b12b-3d24-4e92-8400-9df668300cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:07:59.892000 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2086b12b-3d24-4e92-8400-9df668300cef None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:59.892000 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2086b12b-3d24-4e92-8400-9df668300cef None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:59.892000 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2086b12b-3d24-4e92-8400-9df668300cef None admin] PATH_INFO: `/v3/users/02264f96f7214ecaabcc6264007255d2` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:59.906508 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2086b12b-3d24-4e92-8400-9df668300cef None admin] RBAC: Authorizing `identity:get_user(user_id=02264f96f7214ecaabcc6264007255d2)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:07:59.908290 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2086b12b-3d24-4e92-8400-9df668300cef None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:07:59.910590 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 54/109] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 16:07:59 2022] GET /identity/v3/users/02264f96f7214ecaabcc6264007255d2 => generated 289 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:07:59.912261 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ab5f5-0cff-47e4-9442-7bbe5043619f None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:59.912709 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ab5f5-0cff-47e4-9442-7bbe5043619f None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:59.913003 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ab5f5-0cff-47e4-9442-7bbe5043619f None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:59.914435 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 55/110] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:07:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:07:59.918678 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102ab5f5-0cff-47e4-9442-7bbe5043619f None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:07:59.927539 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d1d994-712d-4741-bdc2-c8c01d66912c None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:07:59.968068 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a22691-040c-4007-9db0-e8e7ef94399b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:07:59.968723 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a22691-040c-4007-9db0-e8e7ef94399b None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:59.969035 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a22691-040c-4007-9db0-e8e7ef94399b None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:59.969345 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a22691-040c-4007-9db0-e8e7ef94399b None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:07:59.970104 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a22691-040c-4007-9db0-e8e7ef94399b None admin] RBAC: Adding query filter params (name=member) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:07:59.970443 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a22691-040c-4007-9db0-e8e7ef94399b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:07:59.971846 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a22691-040c-4007-9db0-e8e7ef94399b None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:07:59.981324 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 56/111] 10.222.0.62 () {56 vars in 1101 bytes} [Fri May 27 16:07:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:07:59.982620 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d33b84c-665f-4166-9243-b4a2ed311970 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:07:59.982964 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d33b84c-665f-4166-9243-b4a2ed311970 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:07:59.983316 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d33b84c-665f-4166-9243-b4a2ed311970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:00.007496 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-4d33b84c-665f-4166-9243-b4a2ed311970 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:08:00.008806 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-4d33b84c-665f-4166-9243-b4a2ed311970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:08:00.060152 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102ab5f5-0cff-47e4-9442-7bbe5043619f None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:00.081092 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:00.097014 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006e2e32-f2f3-448d-8c88-5557b4a609c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:00.097996 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006e2e32-f2f3-448d-8c88-5557b4a609c7 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:00.098425 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006e2e32-f2f3-448d-8c88-5557b4a609c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:00.098808 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006e2e32-f2f3-448d-8c88-5557b4a609c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:00.100473 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 57/112] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:07:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:08:00.101340 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d33b84c-665f-4166-9243-b4a2ed311970 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:00.226856 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:00.242970 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006e2e32-f2f3-448d-8c88-5557b4a609c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:00.248886 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006e2e32-f2f3-448d-8c88-5557b4a609c7 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:00.249007 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d33b84c-665f-4166-9243-b4a2ed311970 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:00.283167 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262a5d21-5403-457b-9134-e7d8a07cb67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:00.284055 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a5d21-5403-457b-9134-e7d8a07cb67e None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:00.284342 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a5d21-5403-457b-9134-e7d8a07cb67e None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:00.284624 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a5d21-5403-457b-9134-e7d8a07cb67e None admin] PATH_INFO: `/v3/users/13643c5d35d44115a5784bad3c8e4cf7` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:00.285841 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262a5d21-5403-457b-9134-e7d8a07cb67e None admin] RBAC: Authorizing `identity:get_user(user_id=13643c5d35d44115a5784bad3c8e4cf7)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:00.287339 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262a5d21-5403-457b-9134-e7d8a07cb67e None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:00.289276 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 58/113] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 16:08:00 2022] GET /identity/v3/users/13643c5d35d44115a5784bad3c8e4cf7 => generated 275 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:00.290058 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262a5d21-5403-457b-9134-e7d8a07cb67e None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:00.364833 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 56/114] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 16:07:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 16:08:00.365314 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:00.366476 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d697c395-6396-4993-9801-f710806f995a None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:00.366778 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d697c395-6396-4993-9801-f710806f995a None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:00.367333 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d697c395-6396-4993-9801-f710806f995a None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:00.368797 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 57/115] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:08:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:08:00.371365 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d697c395-6396-4993-9801-f710806f995a None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:00.416959 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262a5d21-5403-457b-9134-e7d8a07cb67e None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:00.452442 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d5a078-3c40-4dc7-bbc3-34413b1d6aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:00.453291 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d5a078-3c40-4dc7-bbc3-34413b1d6aaa None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:00.453575 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d5a078-3c40-4dc7-bbc3-34413b1d6aaa None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:00.453854 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d5a078-3c40-4dc7-bbc3-34413b1d6aaa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:00.465663 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d5a078-3c40-4dc7-bbc3-34413b1d6aaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:08:00.473266 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:00.473980 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-d9d5a078-3c40-4dc7-bbc3-34413b1d6aaa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 16:08:00.473980 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:08:00.473980 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:08:00.473980 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:08:00.473980 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:08:00.473980 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:08:00.473980 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:08:00.473980 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:08:00.473980 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:08:00.473980 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:08:00.473980 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:08:00.473980 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:08:00.473980 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:08:00.473980 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:08:00.473980 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:08:00.473980 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:08:00.474891 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:08:00.474891 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:08:00.474891 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:08:00.474891 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:08:00.474891 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:08:00.474891 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:08:00.474891 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:08:00.474891 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:08:00.474891 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:08:00.474891 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:08:00.474891 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:08:00.474891 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:08:00.474891 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:08:00.474891 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:08:00.474891 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:08:00.474891 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:08:00.476129 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:08:00.476129 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:08:00.476129 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:08:00.476129 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:08:00.476129 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:08:00.476129 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:08:00.476129 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:08:00.476129 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:08:00.476129 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:08:00.476129 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:08:00.476129 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 16:08:00.476129 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:08:00.476129 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 59/116] 10.222.0.62 () {56 vars in 1114 bytes} [Fri May 27 16:08:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:08:00.476129 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d5a078-3c40-4dc7-bbc3-34413b1d6aaa None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:00.496984 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d697c395-6396-4993-9801-f710806f995a None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:00.536349 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485645b8-5685-409e-9fbd-63abf63067dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:00.537782 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485645b8-5685-409e-9fbd-63abf63067dc None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:00.538326 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485645b8-5685-409e-9fbd-63abf63067dc None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:00.538970 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485645b8-5685-409e-9fbd-63abf63067dc None admin] PATH_INFO: `/v3/projects/d280b4797bdd4aabacba365ec82ca978` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:00.540721 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485645b8-5685-409e-9fbd-63abf63067dc None admin] RBAC: Authorizing `identity:get_project(project_id=d280b4797bdd4aabacba365ec82ca978)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:00.543109 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485645b8-5685-409e-9fbd-63abf63067dc None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:00.546802 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 58/117] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 16:08:00 2022] GET /identity/v3/projects/d280b4797bdd4aabacba365ec82ca978 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:00.548476 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7254255f-594e-4b7b-9b23-5da6af42385e None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:00.548974 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7254255f-594e-4b7b-9b23-5da6af42385e None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:00.549512 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7254255f-594e-4b7b-9b23-5da6af42385e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:00.569160 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-7254255f-594e-4b7b-9b23-5da6af42385e None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:08:00.570776 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-7254255f-594e-4b7b-9b23-5da6af42385e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:08:00.580533 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d5a078-3c40-4dc7-bbc3-34413b1d6aaa None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:00.597163 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:00.616123 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ebde13-7f56-4497-bf24-a2cde7cc0803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:00.616993 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ebde13-7f56-4497-bf24-a2cde7cc0803 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:00.617279 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ebde13-7f56-4497-bf24-a2cde7cc0803 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:00.617554 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ebde13-7f56-4497-bf24-a2cde7cc0803 None admin] PATH_INFO: `/v3/projects/d280b4797bdd4aabacba365ec82ca978` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:00.618781 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ebde13-7f56-4497-bf24-a2cde7cc0803 None admin] RBAC: Authorizing `identity:get_project(project_id=d280b4797bdd4aabacba365ec82ca978)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:00.620806 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ebde13-7f56-4497-bf24-a2cde7cc0803 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:00.627422 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 60/118] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 16:08:00 2022] GET /identity/v3/projects/d280b4797bdd4aabacba365ec82ca978 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:00.627422 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ebde13-7f56-4497-bf24-a2cde7cc0803 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:00.655999 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 59/119] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:08:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:08:00.657560 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7254255f-594e-4b7b-9b23-5da6af42385e None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:00.753784 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ebde13-7f56-4497-bf24-a2cde7cc0803 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:00.764302 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:00.790648 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413b97e3-a333-4a60-92cc-bbbacc72248f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:00.791324 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b97e3-a333-4a60-92cc-bbbacc72248f None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:00.792164 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b97e3-a333-4a60-92cc-bbbacc72248f None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:00.792448 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b97e3-a333-4a60-92cc-bbbacc72248f None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:00.793079 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7254255f-594e-4b7b-9b23-5da6af42385e None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:00.793193 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413b97e3-a333-4a60-92cc-bbbacc72248f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:00.793487 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413b97e3-a333-4a60-92cc-bbbacc72248f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:00.794908 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413b97e3-a333-4a60-92cc-bbbacc72248f None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:00.803731 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 61/120] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 16:08:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:00.804620 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413b97e3-a333-4a60-92cc-bbbacc72248f None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:00.839361 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b4c12e-2680-4d52-9731-8eeafc97a745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:00.840610 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b4c12e-2680-4d52-9731-8eeafc97a745 None admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:00.841127 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b4c12e-2680-4d52-9731-8eeafc97a745 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:00.841628 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b4c12e-2680-4d52-9731-8eeafc97a745 None admin] PATH_INFO: `/v3/projects/d280b4797bdd4aabacba365ec82ca978/users/13643c5d35d44115a5784bad3c8e4cf7/roles/c8ce6d197f654598ac45f6016ecccabd` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:00.843978 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b4c12e-2680-4d52-9731-8eeafc97a745 None admin] RBAC: Authorizing `identity:create_grant(project_id=d280b4797bdd4aabacba365ec82ca978, user_id=13643c5d35d44115a5784bad3c8e4cf7, role_id=c8ce6d197f654598ac45f6016ecccabd)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:00.845683 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b4c12e-2680-4d52-9731-8eeafc97a745 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:00.856072 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:00.909456 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413b97e3-a333-4a60-92cc-bbbacc72248f None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:00.917918 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 60/121] 10.222.0.62 () {58 vars in 1439 bytes} [Fri May 27 16:08:00 2022] PUT /identity/v3/projects/d280b4797bdd4aabacba365ec82ca978/users/13643c5d35d44115a5784bad3c8e4cf7/roles/c8ce6d197f654598ac45f6016ecccabd => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:08:00.918769 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b4c12e-2680-4d52-9731-8eeafc97a745 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:00.949961 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1442cab5-30b3-47db-a797-152baf205740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:00.951096 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442cab5-30b3-47db-a797-152baf205740 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:00.951529 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442cab5-30b3-47db-a797-152baf205740 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:00.951951 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442cab5-30b3-47db-a797-152baf205740 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:00.952968 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1442cab5-30b3-47db-a797-152baf205740 None admin] RBAC: Adding query filter params (role.id=6d3bcbc332ec4ad4b4910a6a9fc398ae, scope.project.id=d280b4797bdd4aabacba365ec82ca978, user.id=02264f96f7214ecaabcc6264007255d2) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:00.953451 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1442cab5-30b3-47db-a797-152baf205740 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:00.955176 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1442cab5-30b3-47db-a797-152baf205740 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:00.961887 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 62/122] 10.222.0.62 () {56 vars in 1374 bytes} [Fri May 27 16:08:00 2022] GET /identity/v3/role_assignments?user.id=02264f96f7214ecaabcc6264007255d2&scope.project.id=d280b4797bdd4aabacba365ec82ca978&role.id=6d3bcbc332ec4ad4b4910a6a9fc398ae => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:00.963125 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1442cab5-30b3-47db-a797-152baf205740 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:01.105298 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b4c12e-2680-4d52-9731-8eeafc97a745 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:01.178114 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1f6f5f-cc11-49f1-a558-16f32c5b954b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:01.180520 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1f6f5f-cc11-49f1-a558-16f32c5b954b None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:01.181028 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1f6f5f-cc11-49f1-a558-16f32c5b954b None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:01.181617 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1f6f5f-cc11-49f1-a558-16f32c5b954b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:01.182209 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1442cab5-30b3-47db-a797-152baf205740 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:01.196020 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:01.204309 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1f6f5f-cc11-49f1-a558-16f32c5b954b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:08:01.212734 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-6a1f6f5f-cc11-49f1-a558-16f32c5b954b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:08:01.212734 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:08:01.212734 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:08:01.212734 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:08:01.212734 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:08:01.212734 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:08:01.212734 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:08:01.212734 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:08:01.212734 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:08:01.212734 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:08:01.212734 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:08:01.212734 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:08:01.212734 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:08:01.212734 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:08:01.212734 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:08:01.212734 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:08:01.214580 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:08:01.214580 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:08:01.214580 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:08:01.214580 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:08:01.214580 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:08:01.214580 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:08:01.214580 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:08:01.214580 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:08:01.214580 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:08:01.214580 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:08:01.214580 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:08:01.214580 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:08:01.214580 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:08:01.214580 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:08:01.214580 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:08:01.214580 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:08:01.215347 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:08:01.215347 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:08:01.215347 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:08:01.215347 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:08:01.215347 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:08:01.215347 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:08:01.215347 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:08:01.215347 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:08:01.215347 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:08:01.215347 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:08:01.215347 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:08:01.215347 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:08:01.217735 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 61/123] 10.222.0.62 () {56 vars in 1096 bytes} [Fri May 27 16:08:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:08:01.220123 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f16c538-c499-497d-b9df-955a93041df0 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:01.220619 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f16c538-c499-497d-b9df-955a93041df0 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:01.221078 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f16c538-c499-497d-b9df-955a93041df0 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:01.223176 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 62/124] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:08:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:08:01.228936 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ca228-1add-4cf5-9e9e-4f0ec8cdb2ea None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:01.229914 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ca228-1add-4cf5-9e9e-4f0ec8cdb2ea None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:01.230416 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ca228-1add-4cf5-9e9e-4f0ec8cdb2ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:01.236985 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1391af-2d91-42d6-ab77-87609c574dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:01.238066 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1391af-2d91-42d6-ab77-87609c574dbc None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:01.239443 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1391af-2d91-42d6-ab77-87609c574dbc None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:01.240974 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1391af-2d91-42d6-ab77-87609c574dbc None admin] PATH_INFO: `/v3/users/13643c5d35d44115a5784bad3c8e4cf7` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:01.243643 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:01.243847 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1391af-2d91-42d6-ab77-87609c574dbc None admin] RBAC: Authorizing `identity:get_user(user_id=13643c5d35d44115a5784bad3c8e4cf7)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:01.247090 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1391af-2d91-42d6-ab77-87609c574dbc None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:01.247219 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 63/125] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 16:08:00 2022] GET /identity/v3/users/13643c5d35d44115a5784bad3c8e4cf7 => generated 275 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:01.247935 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1391af-2d91-42d6-ab77-87609c574dbc None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:01.266389 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-9c8ca228-1add-4cf5-9e9e-4f0ec8cdb2ea None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:08:01.267950 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-9c8ca228-1add-4cf5-9e9e-4f0ec8cdb2ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:08:01.339854 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 63/126] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:08:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:08:01.341144 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8ca228-1add-4cf5-9e9e-4f0ec8cdb2ea None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:01.433326 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1391af-2d91-42d6-ab77-87609c574dbc None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:01.469345 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599cc2e9-0128-4ac5-995e-155f1803bc3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:01.470022 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599cc2e9-0128-4ac5-995e-155f1803bc3f None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:01.470335 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599cc2e9-0128-4ac5-995e-155f1803bc3f None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:01.470620 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599cc2e9-0128-4ac5-995e-155f1803bc3f None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:01.471518 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599cc2e9-0128-4ac5-995e-155f1803bc3f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:01.471827 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599cc2e9-0128-4ac5-995e-155f1803bc3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:01.473210 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599cc2e9-0128-4ac5-995e-155f1803bc3f None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:01.481902 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 64/127] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 16:08:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:01.482749 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599cc2e9-0128-4ac5-995e-155f1803bc3f None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:01.530689 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8ca228-1add-4cf5-9e9e-4f0ec8cdb2ea None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:01.545134 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:01.576716 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:01.581828 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b821f4de-ba05-482b-80d7-d90d8c44373c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:01.582736 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b821f4de-ba05-482b-80d7-d90d8c44373c None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:01.583025 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b821f4de-ba05-482b-80d7-d90d8c44373c None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:01.583305 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b821f4de-ba05-482b-80d7-d90d8c44373c None admin] PATH_INFO: `/v3/projects/d280b4797bdd4aabacba365ec82ca978` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:01.586056 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b821f4de-ba05-482b-80d7-d90d8c44373c None admin] RBAC: Authorizing `identity:get_project(project_id=d280b4797bdd4aabacba365ec82ca978)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:01.588843 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b821f4de-ba05-482b-80d7-d90d8c44373c None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:01.591003 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 64/128] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 16:08:01 2022] GET /identity/v3/projects/d280b4797bdd4aabacba365ec82ca978 => generated 298 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:01.591860 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b821f4de-ba05-482b-80d7-d90d8c44373c None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:01.677439 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599cc2e9-0128-4ac5-995e-155f1803bc3f None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:01.729578 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a8a04e-862b-4fe9-af24-2f34ef57647b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:01.731265 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8a04e-862b-4fe9-af24-2f34ef57647b None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:01.731777 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8a04e-862b-4fe9-af24-2f34ef57647b None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:01.732277 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8a04e-862b-4fe9-af24-2f34ef57647b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:01.744512 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a8a04e-862b-4fe9-af24-2f34ef57647b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:08:01.753725 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-79a8a04e-862b-4fe9-af24-2f34ef57647b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 16:08:01.753725 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:08:01.753725 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:08:01.753725 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:08:01.753725 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:08:01.753725 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:08:01.753725 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:08:01.753725 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:08:01.753725 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:08:01.753725 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:08:01.753725 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:08:01.753725 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:08:01.753725 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:08:01.753725 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:08:01.753725 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:08:01.753725 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:08:01.755151 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:08:01.755151 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:08:01.755151 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:08:01.755151 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:08:01.755151 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:08:01.755151 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:08:01.755151 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:08:01.755151 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:08:01.755151 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:08:01.755151 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:08:01.755151 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:08:01.755151 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:08:01.755151 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:08:01.755151 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:08:01.755151 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:08:01.755151 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:08:01.755923 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:08:01.755923 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:08:01.755923 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:08:01.755923 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:08:01.755923 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:08:01.755923 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:08:01.755923 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:08:01.755923 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:08:01.755923 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:08:01.755923 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:08:01.755923 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 16:08:01.755923 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:08:01.758242 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 65/129] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 16:08:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:08:01.759902 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a8a04e-862b-4fe9-af24-2f34ef57647b None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:01.769152 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b821f4de-ba05-482b-80d7-d90d8c44373c None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:01.840164 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78853de6-0e23-436a-b0c0-701d183b5f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:01.841057 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78853de6-0e23-436a-b0c0-701d183b5f33 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:01.841347 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78853de6-0e23-436a-b0c0-701d183b5f33 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:01.841628 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78853de6-0e23-436a-b0c0-701d183b5f33 None admin] PATH_INFO: `/v3/users/e26f01858edd43d6bd42a1a5a4965a24` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:01.847216 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78853de6-0e23-436a-b0c0-701d183b5f33 None admin] RBAC: Authorizing `identity:get_user(user_id=e26f01858edd43d6bd42a1a5a4965a24)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:01.850930 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78853de6-0e23-436a-b0c0-701d183b5f33 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:01.852760 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 65/130] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 16:08:01 2022] GET /identity/v3/users/e26f01858edd43d6bd42a1a5a4965a24 => generated 247 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:01.853556 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78853de6-0e23-436a-b0c0-701d183b5f33 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:01.898921 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:01.903934 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a8a04e-862b-4fe9-af24-2f34ef57647b None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:01.969626 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ad3ba9-f3f9-471a-95a9-7817d65b5adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:01.970589 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad3ba9-f3f9-471a-95a9-7817d65b5adf None admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:01.970884 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad3ba9-f3f9-471a-95a9-7817d65b5adf None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:01.971168 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad3ba9-f3f9-471a-95a9-7817d65b5adf None admin] PATH_INFO: `/v3/projects/d280b4797bdd4aabacba365ec82ca978/users/13643c5d35d44115a5784bad3c8e4cf7/roles/404d2ea20e7c4842892e5001133f1b93` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:01.977080 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ad3ba9-f3f9-471a-95a9-7817d65b5adf None admin] RBAC: Authorizing `identity:create_grant(project_id=d280b4797bdd4aabacba365ec82ca978, user_id=13643c5d35d44115a5784bad3c8e4cf7, role_id=404d2ea20e7c4842892e5001133f1b93)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:01.978611 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ad3ba9-f3f9-471a-95a9-7817d65b5adf None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:01.983674 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:02.018804 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78853de6-0e23-436a-b0c0-701d183b5f33 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:02.055962 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e3d0d0-5abe-4b67-b8fd-3b476a01f938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:02.056642 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3d0d0-5abe-4b67-b8fd-3b476a01f938 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:02.056951 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3d0d0-5abe-4b67-b8fd-3b476a01f938 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:02.057350 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3d0d0-5abe-4b67-b8fd-3b476a01f938 None admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:02.058160 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e3d0d0-5abe-4b67-b8fd-3b476a01f938 None admin] RBAC: Adding query filter params (name=member) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:02.058519 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e3d0d0-5abe-4b67-b8fd-3b476a01f938 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:02.059912 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e3d0d0-5abe-4b67-b8fd-3b476a01f938 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:02.074013 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 66/131] 10.222.0.62 () {56 vars in 1101 bytes} [Fri May 27 16:08:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:02.076147 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e3d0d0-5abe-4b67-b8fd-3b476a01f938 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:02.092543 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 66/132] 10.222.0.62 () {58 vars in 1439 bytes} [Fri May 27 16:08:01 2022] PUT /identity/v3/projects/d280b4797bdd4aabacba365ec82ca978/users/13643c5d35d44115a5784bad3c8e4cf7/roles/404d2ea20e7c4842892e5001133f1b93 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:08:02.113652 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ad3ba9-f3f9-471a-95a9-7817d65b5adf None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:02.256158 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e3d0d0-5abe-4b67-b8fd-3b476a01f938 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:02.330078 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ad3ba9-f3f9-471a-95a9-7817d65b5adf None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:02.330627 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:02.339366 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63730bf3-2045-4279-a06a-6aab5f4c1405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:02.340327 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63730bf3-2045-4279-a06a-6aab5f4c1405 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:02.340625 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63730bf3-2045-4279-a06a-6aab5f4c1405 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:02.340912 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63730bf3-2045-4279-a06a-6aab5f4c1405 None admin] PATH_INFO: `/v3/projects/d280b4797bdd4aabacba365ec82ca978` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:02.342360 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63730bf3-2045-4279-a06a-6aab5f4c1405 None admin] RBAC: Authorizing `identity:get_project(project_id=d280b4797bdd4aabacba365ec82ca978)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:02.343856 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63730bf3-2045-4279-a06a-6aab5f4c1405 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:02.347805 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 67/133] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 16:08:02 2022] GET /identity/v3/projects/d280b4797bdd4aabacba365ec82ca978 => generated 298 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:02.347805 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8c555-4e40-44cc-a9c4-07424cb12e97 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:02.347805 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8c555-4e40-44cc-a9c4-07424cb12e97 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:02.347805 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8c555-4e40-44cc-a9c4-07424cb12e97 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:02.348595 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 68/134] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:08:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:08:02.352151 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea8c555-4e40-44cc-a9c4-07424cb12e97 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:02.397365 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f75ef38-9df0-4325-a659-0eb6cd639312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:02.398272 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f75ef38-9df0-4325-a659-0eb6cd639312 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:02.398620 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f75ef38-9df0-4325-a659-0eb6cd639312 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:02.398911 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f75ef38-9df0-4325-a659-0eb6cd639312 None admin] PATH_INFO: `/v3/users/13643c5d35d44115a5784bad3c8e4cf7` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:02.400496 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f75ef38-9df0-4325-a659-0eb6cd639312 None admin] RBAC: Authorizing `identity:get_user(user_id=13643c5d35d44115a5784bad3c8e4cf7)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:02.402021 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f75ef38-9df0-4325-a659-0eb6cd639312 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:02.403777 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 67/135] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 16:08:02 2022] GET /identity/v3/users/13643c5d35d44115a5784bad3c8e4cf7 => generated 275 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:02.404984 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca7c580-7f25-417c-9ae7-ab5e372353d3 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:02.405280 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca7c580-7f25-417c-9ae7-ab5e372353d3 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:02.405569 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca7c580-7f25-417c-9ae7-ab5e372353d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:02.424095 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-9ca7c580-7f25-417c-9ae7-ab5e372353d3 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:08:02.425361 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-9ca7c580-7f25-417c-9ae7-ab5e372353d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:08:02.465590 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:02.512960 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea8c555-4e40-44cc-a9c4-07424cb12e97 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:02.552039 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9c46f2-fbd1-45d7-9add-aaabbb933ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:02.553097 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c46f2-fbd1-45d7-9add-aaabbb933ad8 None admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:02.553394 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c46f2-fbd1-45d7-9add-aaabbb933ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:02.553681 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c46f2-fbd1-45d7-9add-aaabbb933ad8 None admin] PATH_INFO: `/v3/projects/d280b4797bdd4aabacba365ec82ca978/users/e26f01858edd43d6bd42a1a5a4965a24/roles/e04fe3eb1f714d74901ac83e33ea8a16` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:02.556172 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9c46f2-fbd1-45d7-9add-aaabbb933ad8 None admin] RBAC: Authorizing `identity:create_grant(project_id=d280b4797bdd4aabacba365ec82ca978, user_id=e26f01858edd43d6bd42a1a5a4965a24, role_id=e04fe3eb1f714d74901ac83e33ea8a16)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:02.558013 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 68/136] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:08:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:08:02.558238 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9c46f2-fbd1-45d7-9add-aaabbb933ad8 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:02.558948 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca7c580-7f25-417c-9ae7-ab5e372353d3 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:02.631022 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 69/137] 10.222.0.62 () {58 vars in 1439 bytes} [Fri May 27 16:08:02 2022] PUT /identity/v3/projects/d280b4797bdd4aabacba365ec82ca978/users/e26f01858edd43d6bd42a1a5a4965a24/roles/e04fe3eb1f714d74901ac83e33ea8a16 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:08:02.631884 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9c46f2-fbd1-45d7-9add-aaabbb933ad8 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:02.733096 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca7c580-7f25-417c-9ae7-ab5e372353d3 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:02.754623 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:02.813614 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9c46f2-fbd1-45d7-9add-aaabbb933ad8 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:02.835000 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eedb08-bc44-46f8-84d9-42c03afadfa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:02.835949 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eedb08-bc44-46f8-84d9-42c03afadfa6 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:02.836240 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eedb08-bc44-46f8-84d9-42c03afadfa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:02.836524 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eedb08-bc44-46f8-84d9-42c03afadfa6 None admin] PATH_INFO: `/v3/projects/f4b9437a134d464f9bd95f713cc2b841` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:02.837775 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eedb08-bc44-46f8-84d9-42c03afadfa6 None admin] RBAC: Authorizing `identity:get_project(project_id=f4b9437a134d464f9bd95f713cc2b841)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:02.841318 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eedb08-bc44-46f8-84d9-42c03afadfa6 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:02.841318 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 69/138] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 16:08:02 2022] GET /identity/v3/projects/f4b9437a134d464f9bd95f713cc2b841 => generated 312 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:02.847276 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eedb08-bc44-46f8-84d9-42c03afadfa6 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:02.874685 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508aa03b-62ab-4161-b5c3-c8fe8c94904d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:02.875705 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508aa03b-62ab-4161-b5c3-c8fe8c94904d None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:02.875999 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508aa03b-62ab-4161-b5c3-c8fe8c94904d None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:02.876286 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508aa03b-62ab-4161-b5c3-c8fe8c94904d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:02.882222 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508aa03b-62ab-4161-b5c3-c8fe8c94904d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:02.883807 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508aa03b-62ab-4161-b5c3-c8fe8c94904d None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:02.886547 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 70/139] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:08:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:02.892020 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508aa03b-62ab-4161-b5c3-c8fe8c94904d None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:02.915351 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:03.021355 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eedb08-bc44-46f8-84d9-42c03afadfa6 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:03.068212 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf831aa7-9177-493e-9e88-7b6861a8a55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:03.070038 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf831aa7-9177-493e-9e88-7b6861a8a55b None admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:03.070361 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf831aa7-9177-493e-9e88-7b6861a8a55b None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:03.070646 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf831aa7-9177-493e-9e88-7b6861a8a55b None admin] PATH_INFO: `/v3/projects/f4b9437a134d464f9bd95f713cc2b841/users/13643c5d35d44115a5784bad3c8e4cf7/roles/c8ce6d197f654598ac45f6016ecccabd` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:03.073447 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf831aa7-9177-493e-9e88-7b6861a8a55b None admin] RBAC: Authorizing `identity:create_grant(project_id=f4b9437a134d464f9bd95f713cc2b841, user_id=13643c5d35d44115a5784bad3c8e4cf7, role_id=c8ce6d197f654598ac45f6016ecccabd)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:03.075483 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf831aa7-9177-493e-9e88-7b6861a8a55b None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:03.080139 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508aa03b-62ab-4161-b5c3-c8fe8c94904d None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:03.112449 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:03.125806 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e9fc96-5eab-4447-bac7-f805234691db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:03.126536 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9fc96-5eab-4447-bac7-f805234691db None admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:03.126827 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9fc96-5eab-4447-bac7-f805234691db None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:03.127110 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9fc96-5eab-4447-bac7-f805234691db None admin] PATH_INFO: `/v3/users` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:03.127836 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e9fc96-5eab-4447-bac7-f805234691db None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:03.129282 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e9fc96-5eab-4447-bac7-f805234691db None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:03.155178 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 70/140] 10.222.0.62 () {58 vars in 1439 bytes} [Fri May 27 16:08:02 2022] PUT /identity/v3/projects/f4b9437a134d464f9bd95f713cc2b841/users/13643c5d35d44115a5784bad3c8e4cf7/roles/c8ce6d197f654598ac45f6016ecccabd => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:08:03.212500 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 71/141] 10.222.0.62 () {60 vars in 1132 bytes} [Fri May 27 16:08:02 2022] POST /identity/v3/users => generated 283 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:08:03.767772 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a25184-1ca4-43fb-bfc8-46bf2d3e1266 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:03.768640 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a25184-1ca4-43fb-bfc8-46bf2d3e1266 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:03.769150 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a25184-1ca4-43fb-bfc8-46bf2d3e1266 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:03.770875 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 71/142] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:08:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:08:03.776754 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d20206-7875-4604-b65a-6c80ddb83784 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:03.777057 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d20206-7875-4604-b65a-6c80ddb83784 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:03.777344 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d20206-7875-4604-b65a-6c80ddb83784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:03.799526 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-31d20206-7875-4604-b65a-6c80ddb83784 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:08:03.800753 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-31d20206-7875-4604-b65a-6c80ddb83784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:08:03.887062 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 72/143] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:08:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:08:03.917022 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f923cdf2-2655-49c5-9c4d-be357fc3e0a8 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:03.917525 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f923cdf2-2655-49c5-9c4d-be357fc3e0a8 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:03.917612 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f923cdf2-2655-49c5-9c4d-be357fc3e0a8 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:03.919158 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 72/144] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:08:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:08:03.924532 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d19fa5-3f15-4e1f-a16f-c6e56893a51c None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:03.924835 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d19fa5-3f15-4e1f-a16f-c6e56893a51c None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:03.925126 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d19fa5-3f15-4e1f-a16f-c6e56893a51c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:03.927385 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f923cdf2-2655-49c5-9c4d-be357fc3e0a8 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:03.954134 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-a7d19fa5-3f15-4e1f-a16f-c6e56893a51c None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:08:03.955387 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-a7d19fa5-3f15-4e1f-a16f-c6e56893a51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:08:04.075102 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 73/145] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:08:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:08:04.091135 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:04.114907 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f923cdf2-2655-49c5-9c4d-be357fc3e0a8 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:04.126279 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d19fa5-3f15-4e1f-a16f-c6e56893a51c None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:04.184047 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b7b71c-7ef7-4b96-9c66-fe7c54374fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:04.184854 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7b71c-7ef7-4b96-9c66-fe7c54374fc3 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:04.185142 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7b71c-7ef7-4b96-9c66-fe7c54374fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:04.185425 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7b71c-7ef7-4b96-9c66-fe7c54374fc3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:04.207817 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:04.213824 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b7b71c-7ef7-4b96-9c66-fe7c54374fc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:08:04.223904 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-46b7b71c-7ef7-4b96-9c66-fe7c54374fc3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 16:08:04.223904 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:08:04.223904 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:08:04.223904 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:08:04.223904 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:08:04.223904 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:08:04.223904 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:08:04.223904 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:08:04.223904 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:08:04.223904 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:08:04.223904 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:08:04.223904 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:08:04.223904 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:08:04.223904 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:08:04.223904 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:08:04.223904 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:08:04.224782 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:08:04.224782 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:08:04.224782 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:08:04.224782 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:08:04.224782 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:08:04.224782 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:08:04.224782 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:08:04.224782 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:08:04.224782 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:08:04.224782 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:08:04.224782 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:08:04.224782 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:08:04.224782 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:08:04.224782 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:08:04.224782 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:08:04.224782 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:08:04.225543 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:08:04.225543 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:08:04.225543 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:08:04.225543 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:08:04.225543 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:08:04.225543 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:08:04.225543 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:08:04.225543 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:08:04.225543 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:08:04.225543 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:08:04.225543 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 16:08:04.225543 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:08:04.225543 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 73/146] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 16:08:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:08:04.236351 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b7b71c-7ef7-4b96-9c66-fe7c54374fc3 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:04.346152 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d19fa5-3f15-4e1f-a16f-c6e56893a51c None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:04.414985 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dac5c96-46c1-4340-8655-77c11274c9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:04.415857 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac5c96-46c1-4340-8655-77c11274c9e7 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:04.416149 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac5c96-46c1-4340-8655-77c11274c9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:04.416981 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac5c96-46c1-4340-8655-77c11274c9e7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:04.417363 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b7b71c-7ef7-4b96-9c66-fe7c54374fc3 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:04.439618 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dac5c96-46c1-4340-8655-77c11274c9e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:08:04.451672 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-0dac5c96-46c1-4340-8655-77c11274c9e7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 16:08:04.451672 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:08:04.451672 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:08:04.451672 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:08:04.451672 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:08:04.451672 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:08:04.451672 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:08:04.451672 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:08:04.451672 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:08:04.451672 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:08:04.451672 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:08:04.451672 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:08:04.451672 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:08:04.451672 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:08:04.451672 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:08:04.451672 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:08:04.452561 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:08:04.452561 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:08:04.452561 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:08:04.452561 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:08:04.452561 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:08:04.452561 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:08:04.452561 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:08:04.452561 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:08:04.452561 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:08:04.452561 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:08:04.452561 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:08:04.452561 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:08:04.452561 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:08:04.452561 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:08:04.452561 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:08:04.452561 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:08:04.453306 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:08:04.453306 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:08:04.453306 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:08:04.453306 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:08:04.453306 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:08:04.453306 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:08:04.453306 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:08:04.453306 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:08:04.453306 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:08:04.453306 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:08:04.453306 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 16:08:04.453306 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:08:04.453306 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 74/147] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 16:08:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:08:04.459546 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dac5c96-46c1-4340-8655-77c11274c9e7 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:04.464414 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889e5797-9042-4821-b153-fc75d36f4021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:04.465106 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e5797-9042-4821-b153-fc75d36f4021 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:04.465877 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e5797-9042-4821-b153-fc75d36f4021 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:04.466223 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e5797-9042-4821-b153-fc75d36f4021 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:04.467015 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889e5797-9042-4821-b153-fc75d36f4021 None admin] RBAC: Adding query filter params (name=member) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:04.467431 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889e5797-9042-4821-b153-fc75d36f4021 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:04.468831 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889e5797-9042-4821-b153-fc75d36f4021 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:04.482824 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 74/148] 10.222.0.62 () {56 vars in 1101 bytes} [Fri May 27 16:08:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:04.488254 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889e5797-9042-4821-b153-fc75d36f4021 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:04.502624 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:04.617217 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dac5c96-46c1-4340-8655-77c11274c9e7 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:04.618756 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:04.655959 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889e5797-9042-4821-b153-fc75d36f4021 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:04.657736 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c3e757-e1ae-48d3-b0a4-dd10d3a77ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:04.658496 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c3e757-e1ae-48d3-b0a4-dd10d3a77ae7 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:04.659364 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c3e757-e1ae-48d3-b0a4-dd10d3a77ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:04.660688 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c3e757-e1ae-48d3-b0a4-dd10d3a77ae7 None admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:04.660688 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c3e757-e1ae-48d3-b0a4-dd10d3a77ae7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:04.661215 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c3e757-e1ae-48d3-b0a4-dd10d3a77ae7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:04.666269 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c3e757-e1ae-48d3-b0a4-dd10d3a77ae7 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:04.673609 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 75/149] 10.222.0.62 () {56 vars in 1101 bytes} [Fri May 27 16:08:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:04.682333 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c3e757-e1ae-48d3-b0a4-dd10d3a77ae7 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:04.730605 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613006ee-53c0-442e-9f1f-37c81b20be9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:04.731494 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613006ee-53c0-442e-9f1f-37c81b20be9f None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:04.731776 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613006ee-53c0-442e-9f1f-37c81b20be9f None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:04.732052 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613006ee-53c0-442e-9f1f-37c81b20be9f None admin] PATH_INFO: `/v3/users/13643c5d35d44115a5784bad3c8e4cf7` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:04.739025 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613006ee-53c0-442e-9f1f-37c81b20be9f None admin] RBAC: Authorizing `identity:get_user(user_id=13643c5d35d44115a5784bad3c8e4cf7)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:04.740506 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613006ee-53c0-442e-9f1f-37c81b20be9f None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:04.742567 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 75/150] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 16:08:04 2022] GET /identity/v3/users/13643c5d35d44115a5784bad3c8e4cf7 => generated 275 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:08:04.748441 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613006ee-53c0-442e-9f1f-37c81b20be9f None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:04.797116 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c3e757-e1ae-48d3-b0a4-dd10d3a77ae7 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:04.838637 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50467538-6b06-4f62-bcba-015374f47027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:04.839540 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50467538-6b06-4f62-bcba-015374f47027 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:04.839825 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50467538-6b06-4f62-bcba-015374f47027 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:04.840108 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50467538-6b06-4f62-bcba-015374f47027 None admin] PATH_INFO: `/v3/users/02264f96f7214ecaabcc6264007255d2` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:04.841426 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50467538-6b06-4f62-bcba-015374f47027 None admin] RBAC: Authorizing `identity:get_user(user_id=02264f96f7214ecaabcc6264007255d2)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:04.842926 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50467538-6b06-4f62-bcba-015374f47027 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:04.844869 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 76/151] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 16:08:04 2022] GET /identity/v3/users/02264f96f7214ecaabcc6264007255d2 => generated 289 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:04.850238 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50467538-6b06-4f62-bcba-015374f47027 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:04.890092 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:04.958281 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50467538-6b06-4f62-bcba-015374f47027 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:04.968528 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:04.994539 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf6b664-9786-4499-b1a4-2b22fbcd9490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:04.995395 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6b664-9786-4499-b1a4-2b22fbcd9490 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:04.995754 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6b664-9786-4499-b1a4-2b22fbcd9490 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:04.996046 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6b664-9786-4499-b1a4-2b22fbcd9490 None admin] PATH_INFO: `/v3/projects/d280b4797bdd4aabacba365ec82ca978` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:04.997304 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf6b664-9786-4499-b1a4-2b22fbcd9490 None admin] RBAC: Authorizing `identity:get_project(project_id=d280b4797bdd4aabacba365ec82ca978)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:04.998887 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf6b664-9786-4499-b1a4-2b22fbcd9490 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:05.000961 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 77/152] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 16:08:04 2022] GET /identity/v3/projects/d280b4797bdd4aabacba365ec82ca978 => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:05.006475 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf6b664-9786-4499-b1a4-2b22fbcd9490 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:05.017253 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613006ee-53c0-442e-9f1f-37c81b20be9f None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:05.107027 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381c9809-ba06-4ed5-8c27-538a9d4f2021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:05.107707 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c9809-ba06-4ed5-8c27-538a9d4f2021 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:05.108006 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c9809-ba06-4ed5-8c27-538a9d4f2021 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:05.108279 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c9809-ba06-4ed5-8c27-538a9d4f2021 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:05.116799 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf6b664-9786-4499-b1a4-2b22fbcd9490 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:05.126719 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:05.153866 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53527e83-0f24-480d-9cd8-71a846873afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:05.154725 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53527e83-0f24-480d-9cd8-71a846873afa None admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:05.155016 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53527e83-0f24-480d-9cd8-71a846873afa None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:05.155301 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53527e83-0f24-480d-9cd8-71a846873afa None admin] PATH_INFO: `/v3/projects/d280b4797bdd4aabacba365ec82ca978/users/02264f96f7214ecaabcc6264007255d2/roles/6d3bcbc332ec4ad4b4910a6a9fc398ae` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:05.157407 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53527e83-0f24-480d-9cd8-71a846873afa None admin] RBAC: Authorizing `identity:create_grant(project_id=d280b4797bdd4aabacba365ec82ca978, user_id=02264f96f7214ecaabcc6264007255d2, role_id=6d3bcbc332ec4ad4b4910a6a9fc398ae)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:05.159820 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53527e83-0f24-480d-9cd8-71a846873afa None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:05.244842 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381c9809-ba06-4ed5-8c27-538a9d4f2021 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:05.246347 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381c9809-ba06-4ed5-8c27-538a9d4f2021 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:05.296853 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 78/153] 10.222.0.62 () {58 vars in 1439 bytes} [Fri May 27 16:08:05 2022] PUT /identity/v3/projects/d280b4797bdd4aabacba365ec82ca978/users/02264f96f7214ecaabcc6264007255d2/roles/6d3bcbc332ec4ad4b4910a6a9fc398ae => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:08:05.352477 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:05.377025 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 76/154] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 16:08:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 629 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 27 16:08:05.382834 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53527e83-0f24-480d-9cd8-71a846873afa None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:05.555021 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53527e83-0f24-480d-9cd8-71a846873afa None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:05.607379 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9196adfa-9a11-413e-bd0d-41dcbacb4c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:05.608285 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9196adfa-9a11-413e-bd0d-41dcbacb4c67 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:05.608577 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9196adfa-9a11-413e-bd0d-41dcbacb4c67 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:05.608865 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9196adfa-9a11-413e-bd0d-41dcbacb4c67 None admin] PATH_INFO: `/v3/projects/d280b4797bdd4aabacba365ec82ca978` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:05.610147 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9196adfa-9a11-413e-bd0d-41dcbacb4c67 None admin] RBAC: Authorizing `identity:get_project(project_id=d280b4797bdd4aabacba365ec82ca978)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:05.611674 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9196adfa-9a11-413e-bd0d-41dcbacb4c67 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:05.613454 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 79/155] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 16:08:05 2022] GET /identity/v3/projects/d280b4797bdd4aabacba365ec82ca978 => generated 298 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:05.619488 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381c9809-ba06-4ed5-8c27-538a9d4f2021 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:05.653197 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00bfdc6-1732-4f52-a9ed-6f644b148df3 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:05.653516 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00bfdc6-1732-4f52-a9ed-6f644b148df3 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:05.653765 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00bfdc6-1732-4f52-a9ed-6f644b148df3 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:05.655428 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 80/156] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:08:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:08:05.671347 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425db186-8a89-4043-9856-3b6904f19d4c None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:05.671653 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425db186-8a89-4043-9856-3b6904f19d4c None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:05.671920 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425db186-8a89-4043-9856-3b6904f19d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:05.700337 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-425db186-8a89-4043-9856-3b6904f19d4c None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:08:05.701735 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-425db186-8a89-4043-9856-3b6904f19d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:08:05.755981 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:05.772445 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381c9809-ba06-4ed5-8c27-538a9d4f2021 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:05.831955 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a50144c-08c9-463a-b5c2-310f8e1683c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:05.832639 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a50144c-08c9-463a-b5c2-310f8e1683c5 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:05.832929 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a50144c-08c9-463a-b5c2-310f8e1683c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:05.833212 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a50144c-08c9-463a-b5c2-310f8e1683c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:05.834063 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a50144c-08c9-463a-b5c2-310f8e1683c5 None admin] RBAC: Adding query filter params (role.id=c8ce6d197f654598ac45f6016ecccabd, scope.project.id=d280b4797bdd4aabacba365ec82ca978, user.id=13643c5d35d44115a5784bad3c8e4cf7) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:05.834419 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a50144c-08c9-463a-b5c2-310f8e1683c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:05.835940 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a50144c-08c9-463a-b5c2-310f8e1683c5 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:05.842985 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 77/157] 10.222.0.62 () {56 vars in 1374 bytes} [Fri May 27 16:08:05 2022] GET /identity/v3/role_assignments?user.id=13643c5d35d44115a5784bad3c8e4cf7&scope.project.id=d280b4797bdd4aabacba365ec82ca978&role.id=c8ce6d197f654598ac45f6016ecccabd => generated 608 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:05.880785 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 81/158] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:08:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 16:08:05.934921 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a50144c-08c9-463a-b5c2-310f8e1683c5 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:05.991239 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:06.065235 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a50144c-08c9-463a-b5c2-310f8e1683c5 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:06.111997 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4949cc-8c05-4e82-94a8-5781d99f3f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:06.113063 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4949cc-8c05-4e82-94a8-5781d99f3f17 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:06.113515 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4949cc-8c05-4e82-94a8-5781d99f3f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:06.113939 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4949cc-8c05-4e82-94a8-5781d99f3f17 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:06.126403 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4949cc-8c05-4e82-94a8-5781d99f3f17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:08:06.135061 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-fb4949cc-8c05-4e82-94a8-5781d99f3f17 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 16:08:06.135061 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:08:06.135061 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:08:06.135061 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:08:06.135061 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:08:06.135061 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:08:06.135061 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:08:06.135061 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:08:06.135061 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:08:06.135061 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:08:06.135061 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:08:06.135061 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:08:06.135061 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:08:06.135061 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:08:06.135061 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:08:06.135061 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:08:06.136162 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:08:06.136162 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:08:06.136162 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:08:06.136162 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:08:06.136162 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:08:06.136162 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:08:06.136162 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:08:06.136162 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:08:06.136162 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:08:06.136162 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:08:06.136162 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:08:06.136162 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:08:06.136162 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:08:06.136162 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:08:06.136162 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:08:06.136162 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:08:06.137209 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:08:06.137209 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:08:06.137209 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:08:06.137209 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:08:06.137209 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:08:06.137209 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:08:06.137209 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:08:06.137209 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:08:06.137209 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:08:06.137209 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:08:06.137209 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 16:08:06.137209 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:08:06.142400 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 78/159] 10.222.0.62 () {56 vars in 1114 bytes} [Fri May 27 16:08:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:08:06.147356 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425db186-8a89-4043-9856-3b6904f19d4c None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:06.245787 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e423ee-74dc-4048-a2a1-eb7b25cfc879 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:06.246486 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e423ee-74dc-4048-a2a1-eb7b25cfc879 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:06.246994 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e423ee-74dc-4048-a2a1-eb7b25cfc879 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:06.248659 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 79/160] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:08:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 16:08:06.264430 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc252122-8da2-47df-b885-d28f8a891635 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:06.270792 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc252122-8da2-47df-b885-d28f8a891635 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:06.271388 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc252122-8da2-47df-b885-d28f8a891635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:06.303147 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-cc252122-8da2-47df-b885-d28f8a891635 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:08:06.305038 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-cc252122-8da2-47df-b885-d28f8a891635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:08:06.346274 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425db186-8a89-4043-9856-3b6904f19d4c None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:06.392540 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 80/161] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:08:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:08:06.414871 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a201fea-beb9-41ba-b2b9-cf4a40134426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:06.415899 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a201fea-beb9-41ba-b2b9-cf4a40134426 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:06.416900 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a201fea-beb9-41ba-b2b9-cf4a40134426 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:06.417373 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a201fea-beb9-41ba-b2b9-cf4a40134426 None admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:06.418429 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a201fea-beb9-41ba-b2b9-cf4a40134426 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:06.419006 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a201fea-beb9-41ba-b2b9-cf4a40134426 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:06.420665 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a201fea-beb9-41ba-b2b9-cf4a40134426 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:06.432049 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 82/162] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 16:08:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:06.437878 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc252122-8da2-47df-b885-d28f8a891635 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:06.451676 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a201fea-beb9-41ba-b2b9-cf4a40134426 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:06.499548 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:06.515333 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:06.605892 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc252122-8da2-47df-b885-d28f8a891635 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:06.644525 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac66e7c-0361-417e-a51e-fa5c9b92aa83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:06.645763 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac66e7c-0361-417e-a51e-fa5c9b92aa83 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:06.646276 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac66e7c-0361-417e-a51e-fa5c9b92aa83 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:06.646762 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac66e7c-0361-417e-a51e-fa5c9b92aa83 None admin] PATH_INFO: `/v3/users/13643c5d35d44115a5784bad3c8e4cf7` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:06.648183 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac66e7c-0361-417e-a51e-fa5c9b92aa83 None admin] RBAC: Authorizing `identity:get_user(user_id=13643c5d35d44115a5784bad3c8e4cf7)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:06.649846 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac66e7c-0361-417e-a51e-fa5c9b92aa83 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:06.652294 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 81/163] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 16:08:06 2022] GET /identity/v3/users/13643c5d35d44115a5784bad3c8e4cf7 => generated 275 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:06.658578 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac66e7c-0361-417e-a51e-fa5c9b92aa83 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:06.696540 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a201fea-beb9-41ba-b2b9-cf4a40134426 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:06.771643 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac66e7c-0361-417e-a51e-fa5c9b92aa83 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:06.774905 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:06.783511 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a525b9c7-fabf-487c-b95e-1b47272de3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:06.784536 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a525b9c7-fabf-487c-b95e-1b47272de3a6 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:06.784646 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a525b9c7-fabf-487c-b95e-1b47272de3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:06.784916 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a525b9c7-fabf-487c-b95e-1b47272de3a6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:06.800631 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a525b9c7-fabf-487c-b95e-1b47272de3a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:08:06.813258 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-a525b9c7-fabf-487c-b95e-1b47272de3a6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:08:06.813258 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:08:06.813258 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:08:06.813258 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:08:06.813258 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:08:06.813258 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:08:06.813258 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:08:06.813258 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:08:06.813258 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:08:06.813258 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:08:06.813258 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:08:06.813258 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:08:06.813258 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:08:06.813258 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:08:06.813258 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:08:06.813258 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:08:06.814266 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:08:06.814266 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:08:06.814266 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:08:06.814266 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:08:06.814266 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:08:06.814266 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:08:06.814266 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:08:06.814266 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:08:06.814266 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:08:06.814266 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:08:06.814266 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:08:06.814266 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:08:06.814266 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:08:06.814266 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:08:06.814266 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:08:06.814266 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:08:06.815061 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:08:06.815061 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:08:06.815061 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:08:06.815061 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:08:06.815061 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:08:06.815061 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:08:06.815061 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:08:06.815061 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:08:06.815061 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:08:06.815061 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:08:06.815061 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:08:06.815061 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:08:06.818852 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444533a4-2e7b-4ca7-b722-0e2446e2545a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:06.820079 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444533a4-2e7b-4ca7-b722-0e2446e2545a None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:06.820317 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 83/164] 10.222.0.62 () {56 vars in 1096 bytes} [Fri May 27 16:08:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:08:06.820754 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444533a4-2e7b-4ca7-b722-0e2446e2545a None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:06.821576 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444533a4-2e7b-4ca7-b722-0e2446e2545a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:06.825585 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a525b9c7-fabf-487c-b95e-1b47272de3a6 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:06.974716 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444533a4-2e7b-4ca7-b722-0e2446e2545a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:06.976439 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444533a4-2e7b-4ca7-b722-0e2446e2545a None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:06.985125 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:07.037834 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a525b9c7-fabf-487c-b95e-1b47272de3a6 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:07.122630 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684226cc-8349-403f-8da1-1930b8dcd9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:07.123319 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684226cc-8349-403f-8da1-1930b8dcd9e7 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:07.123607 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684226cc-8349-403f-8da1-1930b8dcd9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:07.123888 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684226cc-8349-403f-8da1-1930b8dcd9e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:07.124659 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684226cc-8349-403f-8da1-1930b8dcd9e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:07.124973 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684226cc-8349-403f-8da1-1930b8dcd9e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:07.127606 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684226cc-8349-403f-8da1-1930b8dcd9e7 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:07.142478 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 84/165] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 16:08:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:07.148425 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684226cc-8349-403f-8da1-1930b8dcd9e7 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:07.163468 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:07.171259 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 82/166] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 16:08:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 16:08:07.176958 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444533a4-2e7b-4ca7-b722-0e2446e2545a None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:07.258281 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684226cc-8349-403f-8da1-1930b8dcd9e7 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:07.294335 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1590e41f-420b-411e-8306-d96751707659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:07.295529 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590e41f-420b-411e-8306-d96751707659 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:07.296021 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590e41f-420b-411e-8306-d96751707659 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:07.296471 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590e41f-420b-411e-8306-d96751707659 None admin] PATH_INFO: `/v3/users/e26f01858edd43d6bd42a1a5a4965a24` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:07.298439 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1590e41f-420b-411e-8306-d96751707659 None admin] RBAC: Authorizing `identity:get_user(user_id=e26f01858edd43d6bd42a1a5a4965a24)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:07.300236 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1590e41f-420b-411e-8306-d96751707659 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:07.306477 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 85/167] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 16:08:07 2022] GET /identity/v3/users/e26f01858edd43d6bd42a1a5a4965a24 => generated 247 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:08:07.307998 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719ba573-d7b3-4c8e-a18b-b599aacf6387 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:07.308467 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719ba573-d7b3-4c8e-a18b-b599aacf6387 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:07.308941 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719ba573-d7b3-4c8e-a18b-b599aacf6387 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:07.310419 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 86/168] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:08:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:08:07.312525 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719ba573-d7b3-4c8e-a18b-b599aacf6387 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:07.330854 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:07.404546 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444533a4-2e7b-4ca7-b722-0e2446e2545a None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:07.420958 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719ba573-d7b3-4c8e-a18b-b599aacf6387 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:07.439759 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a4406-866d-4f8f-a6a2-b4266a03ad34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:07.440628 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a4406-866d-4f8f-a6a2-b4266a03ad34 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:07.440917 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a4406-866d-4f8f-a6a2-b4266a03ad34 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:07.441201 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a4406-866d-4f8f-a6a2-b4266a03ad34 None admin] PATH_INFO: `/v3/projects/d280b4797bdd4aabacba365ec82ca978` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:07.442440 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816a4406-866d-4f8f-a6a2-b4266a03ad34 None admin] RBAC: Authorizing `identity:get_project(project_id=d280b4797bdd4aabacba365ec82ca978)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:07.444048 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816a4406-866d-4f8f-a6a2-b4266a03ad34 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:07.445907 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 83/169] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 16:08:07 2022] GET /identity/v3/projects/d280b4797bdd4aabacba365ec82ca978 => generated 298 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:08:07.447181 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80a9ed-820c-49e1-8f4e-58c8b85dfc98 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:07.448005 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80a9ed-820c-49e1-8f4e-58c8b85dfc98 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:07.448287 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80a9ed-820c-49e1-8f4e-58c8b85dfc98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:07.460210 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd5d3ad-fad0-4f1a-bf30-de01a5ee2129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:07.461475 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd5d3ad-fad0-4f1a-bf30-de01a5ee2129 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:07.462022 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd5d3ad-fad0-4f1a-bf30-de01a5ee2129 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:07.462533 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd5d3ad-fad0-4f1a-bf30-de01a5ee2129 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:07.475257 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-4b80a9ed-820c-49e1-8f4e-58c8b85dfc98 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:08:07.476473 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-4b80a9ed-820c-49e1-8f4e-58c8b85dfc98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:08:07.539053 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd5d3ad-fad0-4f1a-bf30-de01a5ee2129 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:07.540916 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd5d3ad-fad0-4f1a-bf30-de01a5ee2129 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:07.558739 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:07.590998 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:07.607654 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 84/170] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:08:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:08:07.608525 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b80a9ed-820c-49e1-8f4e-58c8b85dfc98 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:07.653521 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 87/171] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 16:08:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 27 16:08:07.655191 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd5d3ad-fad0-4f1a-bf30-de01a5ee2129 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:07.737995 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b80a9ed-820c-49e1-8f4e-58c8b85dfc98 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:07.764363 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd5d3ad-fad0-4f1a-bf30-de01a5ee2129 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:07.782631 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:07.782811 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e1b5d2-1839-4a1c-88aa-cafa604aee2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:07.783348 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e1b5d2-1839-4a1c-88aa-cafa604aee2a None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:07.783637 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e1b5d2-1839-4a1c-88aa-cafa604aee2a None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:07.783918 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e1b5d2-1839-4a1c-88aa-cafa604aee2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:07.784773 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e1b5d2-1839-4a1c-88aa-cafa604aee2a None admin] RBAC: Adding query filter params (role.id=404d2ea20e7c4842892e5001133f1b93, scope.project.id=d280b4797bdd4aabacba365ec82ca978, user.id=13643c5d35d44115a5784bad3c8e4cf7) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:07.785090 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e1b5d2-1839-4a1c-88aa-cafa604aee2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:07.786585 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e1b5d2-1839-4a1c-88aa-cafa604aee2a None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:07.798305 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 85/172] 10.222.0.62 () {56 vars in 1374 bytes} [Fri May 27 16:08:07 2022] GET /identity/v3/role_assignments?user.id=13643c5d35d44115a5784bad3c8e4cf7&scope.project.id=d280b4797bdd4aabacba365ec82ca978&role.id=404d2ea20e7c4842892e5001133f1b93 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:07.799303 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e1b5d2-1839-4a1c-88aa-cafa604aee2a None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:07.861705 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08b9eac-b5f3-4cef-ab65-a35dcc7a4903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:07.862574 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b9eac-b5f3-4cef-ab65-a35dcc7a4903 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:07.862864 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b9eac-b5f3-4cef-ab65-a35dcc7a4903 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:07.865946 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b9eac-b5f3-4cef-ab65-a35dcc7a4903 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:07.891822 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08b9eac-b5f3-4cef-ab65-a35dcc7a4903 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:08:07.901041 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-a08b9eac-b5f3-4cef-ab65-a35dcc7a4903 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 16:08:07.901041 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:08:07.901041 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:08:07.901041 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:08:07.901041 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:08:07.901041 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:08:07.901041 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:08:07.901041 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:08:07.901041 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:08:07.901041 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:08:07.901041 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:08:07.901041 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:08:07.901041 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:08:07.901041 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:08:07.901041 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:08:07.901041 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:08:07.902104 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:08:07.902104 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:08:07.902104 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:08:07.902104 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:08:07.902104 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:08:07.902104 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:08:07.902104 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:08:07.902104 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:08:07.902104 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:08:07.902104 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:08:07.902104 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:08:07.902104 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:08:07.902104 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:08:07.902104 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:08:07.902104 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:08:07.902104 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:08:07.902916 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:08:07.902916 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:08:07.902916 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:08:07.902916 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:08:07.902916 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:08:07.902916 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:08:07.902916 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:08:07.902916 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:08:07.902916 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:08:07.902916 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:08:07.902916 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 16:08:07.902916 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:08:07.904048 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 88/173] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 16:08:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:08:07.912698 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08b9eac-b5f3-4cef-ab65-a35dcc7a4903 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:07.941139 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:07.976617 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e1b5d2-1839-4a1c-88aa-cafa604aee2a None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:08.020941 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded3fce0-d821-4f95-af8b-2e206de0cf42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:08.021847 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded3fce0-d821-4f95-af8b-2e206de0cf42 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:08.022148 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded3fce0-d821-4f95-af8b-2e206de0cf42 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:08.022449 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded3fce0-d821-4f95-af8b-2e206de0cf42 None admin] PATH_INFO: `/v3/projects/d280b4797bdd4aabacba365ec82ca978` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:08.025669 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded3fce0-d821-4f95-af8b-2e206de0cf42 None admin] RBAC: Authorizing `identity:get_project(project_id=d280b4797bdd4aabacba365ec82ca978)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:08.027211 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded3fce0-d821-4f95-af8b-2e206de0cf42 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:08.031582 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 86/174] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 16:08:07 2022] GET /identity/v3/projects/d280b4797bdd4aabacba365ec82ca978 => generated 298 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:08.034758 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded3fce0-d821-4f95-af8b-2e206de0cf42 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:08.141404 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08b9eac-b5f3-4cef-ab65-a35dcc7a4903 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:08.186460 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded3fce0-d821-4f95-af8b-2e206de0cf42 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:08.213800 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb057eb5-71af-43cb-8cec-0ff3b6a1b01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:08.214516 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb057eb5-71af-43cb-8cec-0ff3b6a1b01c None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:08.214805 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb057eb5-71af-43cb-8cec-0ff3b6a1b01c None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:08.215088 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb057eb5-71af-43cb-8cec-0ff3b6a1b01c None admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:08.215965 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb057eb5-71af-43cb-8cec-0ff3b6a1b01c None admin] RBAC: Adding query filter params (name=member) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:08.216284 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb057eb5-71af-43cb-8cec-0ff3b6a1b01c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:08.217805 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb057eb5-71af-43cb-8cec-0ff3b6a1b01c None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:08.223036 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:08.228991 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5cad57-9192-450e-8f05-95e5e2b603c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:08.229755 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5cad57-9192-450e-8f05-95e5e2b603c4 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:08.230819 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5cad57-9192-450e-8f05-95e5e2b603c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:08.231110 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5cad57-9192-450e-8f05-95e5e2b603c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:08.232148 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5cad57-9192-450e-8f05-95e5e2b603c4 None admin] RBAC: Adding query filter params (role.id=e04fe3eb1f714d74901ac83e33ea8a16, scope.project.id=d280b4797bdd4aabacba365ec82ca978, user.id=e26f01858edd43d6bd42a1a5a4965a24) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:08.232475 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5cad57-9192-450e-8f05-95e5e2b603c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:08.234093 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5cad57-9192-450e-8f05-95e5e2b603c4 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:08.240276 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 89/175] 10.222.0.62 () {56 vars in 1101 bytes} [Fri May 27 16:08:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:08.241907 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 87/176] 10.222.0.62 () {56 vars in 1374 bytes} [Fri May 27 16:08:08 2022] GET /identity/v3/role_assignments?user.id=e26f01858edd43d6bd42a1a5a4965a24&scope.project.id=d280b4797bdd4aabacba365ec82ca978&role.id=e04fe3eb1f714d74901ac83e33ea8a16 => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:08:08.246866 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb057eb5-71af-43cb-8cec-0ff3b6a1b01c None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:08.293830 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:08.373778 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb057eb5-71af-43cb-8cec-0ff3b6a1b01c None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:08.411867 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce82dfc6-d531-4e4e-87ad-63891148d93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:08.413112 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce82dfc6-d531-4e4e-87ad-63891148d93a None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:08.413617 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce82dfc6-d531-4e4e-87ad-63891148d93a None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:08.414105 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce82dfc6-d531-4e4e-87ad-63891148d93a None admin] PATH_INFO: `/v3/users/13643c5d35d44115a5784bad3c8e4cf7` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:08.415771 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce82dfc6-d531-4e4e-87ad-63891148d93a None admin] RBAC: Authorizing `identity:get_user(user_id=13643c5d35d44115a5784bad3c8e4cf7)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:08.417611 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce82dfc6-d531-4e4e-87ad-63891148d93a None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:08.423925 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 90/177] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 16:08:08 2022] GET /identity/v3/users/13643c5d35d44115a5784bad3c8e4cf7 => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:08.425740 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46a3c7-1c67-4bcd-88cf-8560fcafa8a5 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:08.426042 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46a3c7-1c67-4bcd-88cf-8560fcafa8a5 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:08.426360 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46a3c7-1c67-4bcd-88cf-8560fcafa8a5 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:08.426850 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce82dfc6-d531-4e4e-87ad-63891148d93a None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:08.427903 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 88/178] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:08:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:08:08.433821 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4521b8-5be6-4b78-9073-c2a2749e7faf None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:08.434114 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4521b8-5be6-4b78-9073-c2a2749e7faf None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:08.434448 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4521b8-5be6-4b78-9073-c2a2749e7faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:08.452193 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-bc4521b8-5be6-4b78-9073-c2a2749e7faf None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:08:08.453398 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-bc4521b8-5be6-4b78-9073-c2a2749e7faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:08:08.576762 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 89/179] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:08:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 16:08:08.593062 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:08.600783 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce82dfc6-d531-4e4e-87ad-63891148d93a None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:08.603523 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4521b8-5be6-4b78-9073-c2a2749e7faf None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:08.660302 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc42619-69b2-41bf-9556-d7050ebee1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:08.660977 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc42619-69b2-41bf-9556-d7050ebee1bd None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:08.661261 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc42619-69b2-41bf-9556-d7050ebee1bd None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:08.661546 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc42619-69b2-41bf-9556-d7050ebee1bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:08.781689 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4521b8-5be6-4b78-9073-c2a2749e7faf None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:08.809270 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:08.823184 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577a7733-dfee-41ba-aa50-68912f57f524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:08.824000 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577a7733-dfee-41ba-aa50-68912f57f524 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:08.824293 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577a7733-dfee-41ba-aa50-68912f57f524 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:08.824571 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577a7733-dfee-41ba-aa50-68912f57f524 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:08.836414 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577a7733-dfee-41ba-aa50-68912f57f524 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:08:08.846099 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-577a7733-dfee-41ba-aa50-68912f57f524 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:08:08.846099 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:08:08.846099 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:08:08.846099 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:08:08.846099 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:08:08.846099 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:08:08.846099 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:08:08.846099 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:08:08.846099 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:08:08.846099 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:08:08.846099 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:08:08.846099 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:08:08.846099 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:08:08.846099 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:08:08.846099 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:08:08.846099 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:08:08.847047 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:08:08.847047 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:08:08.847047 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:08:08.847047 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:08:08.847047 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:08:08.847047 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:08:08.847047 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:08:08.847047 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:08:08.847047 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:08:08.847047 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:08:08.847047 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:08:08.847047 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:08:08.847047 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:08:08.847047 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:08:08.847047 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:08:08.847047 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:08:08.847827 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:08:08.847827 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:08:08.847827 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:08:08.847827 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:08:08.847827 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:08:08.847827 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:08:08.847827 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:08:08.847827 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:08:08.847827 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:08:08.847827 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:08:08.847827 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:08:08.847827 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:08:08.847827 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 90/180] 10.222.0.62 () {56 vars in 1096 bytes} [Fri May 27 16:08:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:08:08.848955 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc42619-69b2-41bf-9556-d7050ebee1bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:08.850134 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc42619-69b2-41bf-9556-d7050ebee1bd None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:08.853270 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577a7733-dfee-41ba-aa50-68912f57f524 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:08.992541 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577a7733-dfee-41ba-aa50-68912f57f524 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:09.013587 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:09.017864 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 91/181] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 16:08:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 592 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 27 16:08:09.019325 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01435dd-db63-420f-b945-ad247c2b48ec None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:09.019685 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01435dd-db63-420f-b945-ad247c2b48ec None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:09.020036 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01435dd-db63-420f-b945-ad247c2b48ec None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:09.021396 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 92/182] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:08:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:08:09.024259 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01435dd-db63-420f-b945-ad247c2b48ec None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:09.052265 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d01c75-e7be-40d6-bc5b-63b052068eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:09.052975 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d01c75-e7be-40d6-bc5b-63b052068eac None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:09.053439 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d01c75-e7be-40d6-bc5b-63b052068eac None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:09.053725 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d01c75-e7be-40d6-bc5b-63b052068eac None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:09.055119 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d01c75-e7be-40d6-bc5b-63b052068eac None admin] RBAC: Adding query filter params (name=admin) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:09.055437 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d01c75-e7be-40d6-bc5b-63b052068eac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:09.057386 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d01c75-e7be-40d6-bc5b-63b052068eac None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:09.069011 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 91/183] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 16:08:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:08:09.076990 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03632e64-75c4-4120-bdee-7a767a895e19 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:09.077288 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03632e64-75c4-4120-bdee-7a767a895e19 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:09.077574 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03632e64-75c4-4120-bdee-7a767a895e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:09.094989 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-03632e64-75c4-4120-bdee-7a767a895e19 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:08:09.096217 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-03632e64-75c4-4120-bdee-7a767a895e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:08:09.139789 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:09.155846 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01435dd-db63-420f-b945-ad247c2b48ec None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:09.167905 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 92/184] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:08:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:08:09.168814 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03632e64-75c4-4120-bdee-7a767a895e19 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:09.206060 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae114ca7-df01-4a8b-bff5-9b3839f4bddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:09.206060 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae114ca7-df01-4a8b-bff5-9b3839f4bddd None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:09.206060 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae114ca7-df01-4a8b-bff5-9b3839f4bddd None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:09.206060 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae114ca7-df01-4a8b-bff5-9b3839f4bddd None admin] PATH_INFO: `/v3/projects/f4b9437a134d464f9bd95f713cc2b841` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:09.207472 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae114ca7-df01-4a8b-bff5-9b3839f4bddd None admin] RBAC: Authorizing `identity:get_project(project_id=f4b9437a134d464f9bd95f713cc2b841)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:09.208702 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae114ca7-df01-4a8b-bff5-9b3839f4bddd None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:09.210673 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 93/185] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 16:08:09 2022] GET /identity/v3/projects/f4b9437a134d464f9bd95f713cc2b841 => generated 312 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:09.211735 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894568a-5bd8-4d43-9f6e-4facf0fb1a37 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:09.212025 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894568a-5bd8-4d43-9f6e-4facf0fb1a37 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:09.212307 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894568a-5bd8-4d43-9f6e-4facf0fb1a37 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:09.214320 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 94/186] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:08:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:08:09.218440 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8894568a-5bd8-4d43-9f6e-4facf0fb1a37 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:09.287812 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03632e64-75c4-4120-bdee-7a767a895e19 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:09.295142 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:09.323559 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255f9e8a-b043-4fa0-b199-30e1e2ea7e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:09.324440 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f9e8a-b043-4fa0-b199-30e1e2ea7e0d None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:09.324727 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f9e8a-b043-4fa0-b199-30e1e2ea7e0d None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:09.325004 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f9e8a-b043-4fa0-b199-30e1e2ea7e0d None admin] PATH_INFO: `/v3/users/48a53eb8f1874e4c8976945519c1a59a` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:09.332951 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8894568a-5bd8-4d43-9f6e-4facf0fb1a37 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:09.339672 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255f9e8a-b043-4fa0-b199-30e1e2ea7e0d None admin] RBAC: Authorizing `identity:get_user(user_id=48a53eb8f1874e4c8976945519c1a59a)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:09.341194 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255f9e8a-b043-4fa0-b199-30e1e2ea7e0d None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:09.343345 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 93/187] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 16:08:09 2022] GET /identity/v3/users/48a53eb8f1874e4c8976945519c1a59a => generated 283 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:09.344542 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d6931-f8c8-4f23-906f-b3432f9fe0f6 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:09.344842 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d6931-f8c8-4f23-906f-b3432f9fe0f6 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:09.345122 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d6931-f8c8-4f23-906f-b3432f9fe0f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:09.361952 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-370d6931-f8c8-4f23-906f-b3432f9fe0f6 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:08:09.363209 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-370d6931-f8c8-4f23-906f-b3432f9fe0f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:08:09.373491 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c649bbe-a841-4c58-85e8-5af50fd33119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:09.374348 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c649bbe-a841-4c58-85e8-5af50fd33119 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:09.374641 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c649bbe-a841-4c58-85e8-5af50fd33119 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:09.374920 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c649bbe-a841-4c58-85e8-5af50fd33119 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:09.386152 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c649bbe-a841-4c58-85e8-5af50fd33119 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:08:09.391657 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:09.394694 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-1c649bbe-a841-4c58-85e8-5af50fd33119 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 16:08:09.394694 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:08:09.394694 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:08:09.394694 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:08:09.394694 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:08:09.394694 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:08:09.394694 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:08:09.394694 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:08:09.394694 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:08:09.394694 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:08:09.394694 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:08:09.394694 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:08:09.394694 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:08:09.394694 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:08:09.394694 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:08:09.394694 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:08:09.395772 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:08:09.395772 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:08:09.395772 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:08:09.395772 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:08:09.395772 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:08:09.395772 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:08:09.395772 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:08:09.395772 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:08:09.395772 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:08:09.395772 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:08:09.395772 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:08:09.395772 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:08:09.395772 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:08:09.395772 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:08:09.395772 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:08:09.395772 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:08:09.396650 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:08:09.396650 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:08:09.396650 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:08:09.396650 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:08:09.396650 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:08:09.396650 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:08:09.396650 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:08:09.396650 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:08:09.396650 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:08:09.396650 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:08:09.396650 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 16:08:09.396650 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:08:09.396650 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 95/188] 10.222.0.62 () {56 vars in 1114 bytes} [Fri May 27 16:08:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:08:09.396650 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c649bbe-a841-4c58-85e8-5af50fd33119 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:09.443106 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 94/189] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:08:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:08:09.443958 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d6931-f8c8-4f23-906f-b3432f9fe0f6 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:09.508158 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c649bbe-a841-4c58-85e8-5af50fd33119 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:09.533930 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:09.542164 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca307b1-bf34-469e-9cf2-de6a03355b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:09.549444 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca307b1-bf34-469e-9cf2-de6a03355b46 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:09.549444 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca307b1-bf34-469e-9cf2-de6a03355b46 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:09.549444 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca307b1-bf34-469e-9cf2-de6a03355b46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:09.549683 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d6931-f8c8-4f23-906f-b3432f9fe0f6 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:09.549764 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca307b1-bf34-469e-9cf2-de6a03355b46 None admin] RBAC: Adding query filter params (role.id=c8ce6d197f654598ac45f6016ecccabd, scope.project.id=f4b9437a134d464f9bd95f713cc2b841, user.id=13643c5d35d44115a5784bad3c8e4cf7) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:09.549764 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca307b1-bf34-469e-9cf2-de6a03355b46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:09.549764 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca307b1-bf34-469e-9cf2-de6a03355b46 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:09.551690 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 96/190] 10.222.0.62 () {56 vars in 1374 bytes} [Fri May 27 16:08:09 2022] GET /identity/v3/role_assignments?user.id=13643c5d35d44115a5784bad3c8e4cf7&scope.project.id=f4b9437a134d464f9bd95f713cc2b841&role.id=c8ce6d197f654598ac45f6016ecccabd => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:09.553432 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca307b1-bf34-469e-9cf2-de6a03355b46 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:09.581921 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab5df9b-26ac-42a1-a87b-f0e73433af99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:09.582543 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab5df9b-26ac-42a1-a87b-f0e73433af99 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:09.582848 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab5df9b-26ac-42a1-a87b-f0e73433af99 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:09.583109 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab5df9b-26ac-42a1-a87b-f0e73433af99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:09.620694 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:09.663140 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab5df9b-26ac-42a1-a87b-f0e73433af99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:09.664642 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab5df9b-26ac-42a1-a87b-f0e73433af99 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:09.665608 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca307b1-bf34-469e-9cf2-de6a03355b46 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:09.703800 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25d9b78-71e5-4eab-b039-4dff60c3111f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:09.704492 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d9b78-71e5-4eab-b039-4dff60c3111f None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:09.704779 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d9b78-71e5-4eab-b039-4dff60c3111f None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:09.705059 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d9b78-71e5-4eab-b039-4dff60c3111f None admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:09.705829 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25d9b78-71e5-4eab-b039-4dff60c3111f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:09.706143 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25d9b78-71e5-4eab-b039-4dff60c3111f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:09.707621 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25d9b78-71e5-4eab-b039-4dff60c3111f None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:09.717214 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 97/191] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 16:08:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:09.718717 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121bda01-3f34-49b2-8623-9252e9b17128 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:09.718949 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121bda01-3f34-49b2-8623-9252e9b17128 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:09.719227 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121bda01-3f34-49b2-8623-9252e9b17128 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:09.720615 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 98/192] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:08:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:08:09.725441 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121bda01-3f34-49b2-8623-9252e9b17128 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:09.791908 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:09.796001 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 95/193] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 16:08:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 16:08:09.797023 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab5df9b-26ac-42a1-a87b-f0e73433af99 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:09.847104 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121bda01-3f34-49b2-8623-9252e9b17128 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:09.863329 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:09.882645 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1489214e-3cbf-409d-978a-970a1f7fe126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:09.883437 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1489214e-3cbf-409d-978a-970a1f7fe126 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:09.883720 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1489214e-3cbf-409d-978a-970a1f7fe126 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:09.883991 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1489214e-3cbf-409d-978a-970a1f7fe126 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:09.885165 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1489214e-3cbf-409d-978a-970a1f7fe126 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:09.886712 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1489214e-3cbf-409d-978a-970a1f7fe126 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:09.888306 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 99/194] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:08:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:09.892803 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7716e2d1-9136-49b5-a663-658a0958c673 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:09.892803 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7716e2d1-9136-49b5-a663-658a0958c673 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:09.892803 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7716e2d1-9136-49b5-a663-658a0958c673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:09.901132 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab5df9b-26ac-42a1-a87b-f0e73433af99 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:09.905964 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-7716e2d1-9136-49b5-a663-658a0958c673 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:08:09.907258 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-7716e2d1-9136-49b5-a663-658a0958c673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:08:09.934877 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d676621-726a-4f2b-a0c1-cc8989e4a023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:09.935744 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d676621-726a-4f2b-a0c1-cc8989e4a023 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:09.936030 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d676621-726a-4f2b-a0c1-cc8989e4a023 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:09.936322 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d676621-726a-4f2b-a0c1-cc8989e4a023 None admin] PATH_INFO: `/v3/users/48a53eb8f1874e4c8976945519c1a59a` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:09.937498 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d676621-726a-4f2b-a0c1-cc8989e4a023 None admin] RBAC: Authorizing `identity:get_user(user_id=48a53eb8f1874e4c8976945519c1a59a)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:09.938976 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d676621-726a-4f2b-a0c1-cc8989e4a023 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:09.940606 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 96/195] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 16:08:09 2022] GET /identity/v3/users/48a53eb8f1874e4c8976945519c1a59a => generated 283 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:09.945062 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d676621-726a-4f2b-a0c1-cc8989e4a023 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:09.978794 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 100/196] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:08:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:08:09.979620 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7716e2d1-9136-49b5-a663-658a0958c673 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:10.038578 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d676621-726a-4f2b-a0c1-cc8989e4a023 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:10.042618 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:10.068110 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:10.073730 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7189e643-7536-4782-ae4d-aa1bcd9c191a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:10.074623 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7189e643-7536-4782-ae4d-aa1bcd9c191a None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:10.074908 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7189e643-7536-4782-ae4d-aa1bcd9c191a None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:10.075184 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7189e643-7536-4782-ae4d-aa1bcd9c191a None admin] PATH_INFO: `/v3/projects/fe60851080e24e0db8e6af2ad2a17a54` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:10.076401 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7189e643-7536-4782-ae4d-aa1bcd9c191a None admin] RBAC: Authorizing `identity:get_project(project_id=fe60851080e24e0db8e6af2ad2a17a54)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:10.077880 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7189e643-7536-4782-ae4d-aa1bcd9c191a None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:10.079765 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 97/197] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 16:08:09 2022] GET /identity/v3/projects/fe60851080e24e0db8e6af2ad2a17a54 => generated 302 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:10.080373 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7189e643-7536-4782-ae4d-aa1bcd9c191a None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:10.092067 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7716e2d1-9136-49b5-a663-658a0958c673 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:10.126869 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e0c16-0d8d-4a9d-8318-d4252309293a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:10.127473 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e0c16-0d8d-4a9d-8318-d4252309293a None admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:10.127757 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e0c16-0d8d-4a9d-8318-d4252309293a None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:10.128034 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e0c16-0d8d-4a9d-8318-d4252309293a None admin] PATH_INFO: `/v3/users` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:10.128740 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53e0c16-0d8d-4a9d-8318-d4252309293a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:10.130173 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53e0c16-0d8d-4a9d-8318-d4252309293a None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:10.178235 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7189e643-7536-4782-ae4d-aa1bcd9c191a None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:10.212164 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16436be-3a25-48b4-bb79-d3afbc3b6c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:10.226278 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 101/198] 10.222.0.62 () {60 vars in 1132 bytes} [Fri May 27 16:08:09 2022] POST /identity/v3/users => generated 297 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:08:10.226826 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16436be-3a25-48b4-bb79-d3afbc3b6c43 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:10.226826 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16436be-3a25-48b4-bb79-d3afbc3b6c43 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:10.227031 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e0c16-0d8d-4a9d-8318-d4252309293a None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:10.227114 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16436be-3a25-48b4-bb79-d3afbc3b6c43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:10.297365 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:10.301948 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16436be-3a25-48b4-bb79-d3afbc3b6c43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:10.303511 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16436be-3a25-48b4-bb79-d3afbc3b6c43 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:10.336952 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e0c16-0d8d-4a9d-8318-d4252309293a None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:10.349009 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:10.375444 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423959cc-9c08-4cef-8be0-d5288c780a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:10.376259 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423959cc-9c08-4cef-8be0-d5288c780a56 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:10.376552 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423959cc-9c08-4cef-8be0-d5288c780a56 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:10.376829 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423959cc-9c08-4cef-8be0-d5288c780a56 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:10.391843 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423959cc-9c08-4cef-8be0-d5288c780a56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:08:10.399233 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-423959cc-9c08-4cef-8be0-d5288c780a56 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 16:08:10.399233 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:08:10.399233 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:08:10.399233 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:08:10.399233 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:08:10.399233 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:08:10.399233 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:08:10.399233 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:08:10.399233 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:08:10.399233 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:08:10.399233 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:08:10.399233 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:08:10.399233 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:08:10.399233 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:08:10.399233 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:08:10.399233 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:08:10.400143 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:08:10.400143 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:08:10.400143 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:08:10.400143 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:08:10.400143 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:08:10.400143 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:08:10.400143 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:08:10.400143 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:08:10.400143 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:08:10.400143 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:08:10.400143 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:08:10.400143 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:08:10.400143 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:08:10.400143 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:08:10.400143 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:08:10.400143 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:08:10.401919 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:08:10.401919 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:08:10.401919 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:08:10.401919 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:08:10.401919 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:08:10.401919 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:08:10.401919 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:08:10.401919 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:08:10.401919 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:08:10.401919 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:08:10.401919 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 16:08:10.401919 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:08:10.401919 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 102/199] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 16:08:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:08:10.402606 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423959cc-9c08-4cef-8be0-d5288c780a56 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:10.433990 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 98/200] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 16:08:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 16:08:10.434981 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16436be-3a25-48b4-bb79-d3afbc3b6c43 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:10.525034 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423959cc-9c08-4cef-8be0-d5288c780a56 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:10.566554 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:10.567035 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a320a501-0832-46d7-b821-c17d6231c400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:10.568883 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a320a501-0832-46d7-b821-c17d6231c400 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:10.569342 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a320a501-0832-46d7-b821-c17d6231c400 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:10.569785 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a320a501-0832-46d7-b821-c17d6231c400 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:10.570395 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16436be-3a25-48b4-bb79-d3afbc3b6c43 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:10.571020 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a320a501-0832-46d7-b821-c17d6231c400 None admin] RBAC: Adding query filter params (role.id=e04fe3eb1f714d74901ac83e33ea8a16, scope.project.id=fe60851080e24e0db8e6af2ad2a17a54, user.id=48a53eb8f1874e4c8976945519c1a59a) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:10.571599 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a320a501-0832-46d7-b821-c17d6231c400 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:10.574221 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a320a501-0832-46d7-b821-c17d6231c400 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:10.586221 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 103/201] 10.222.0.62 () {56 vars in 1374 bytes} [Fri May 27 16:08:10 2022] GET /identity/v3/role_assignments?user.id=48a53eb8f1874e4c8976945519c1a59a&scope.project.id=fe60851080e24e0db8e6af2ad2a17a54&role.id=e04fe3eb1f714d74901ac83e33ea8a16 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:10.586221 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a320a501-0832-46d7-b821-c17d6231c400 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:10.623282 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:10.625425 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d7d3ec-83de-452f-99ba-7c39422f873e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:10.626274 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d7d3ec-83de-452f-99ba-7c39422f873e None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:10.626560 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d7d3ec-83de-452f-99ba-7c39422f873e None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:10.626838 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d7d3ec-83de-452f-99ba-7c39422f873e None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:10.627598 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d7d3ec-83de-452f-99ba-7c39422f873e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:10.628068 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d7d3ec-83de-452f-99ba-7c39422f873e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:10.630468 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d7d3ec-83de-452f-99ba-7c39422f873e None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:10.643135 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 99/202] 10.222.0.62 () {56 vars in 1101 bytes} [Fri May 27 16:08:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:10.649290 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d7d3ec-83de-452f-99ba-7c39422f873e None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:10.718429 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a320a501-0832-46d7-b821-c17d6231c400 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:10.756549 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26d4524-0aa7-4829-8147-f8d5baefb87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:10.757420 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d4524-0aa7-4829-8147-f8d5baefb87e None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:10.757703 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d4524-0aa7-4829-8147-f8d5baefb87e None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:10.757980 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d4524-0aa7-4829-8147-f8d5baefb87e None admin] PATH_INFO: `/v3/projects/fe60851080e24e0db8e6af2ad2a17a54` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:10.759240 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26d4524-0aa7-4829-8147-f8d5baefb87e None admin] RBAC: Authorizing `identity:get_project(project_id=fe60851080e24e0db8e6af2ad2a17a54)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:10.761466 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26d4524-0aa7-4829-8147-f8d5baefb87e None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:10.763456 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 104/203] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 16:08:10 2022] GET /identity/v3/projects/fe60851080e24e0db8e6af2ad2a17a54 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:10.769230 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26d4524-0aa7-4829-8147-f8d5baefb87e None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:10.783428 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d7d3ec-83de-452f-99ba-7c39422f873e None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:10.822895 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29853981-74ec-4e24-88b0-2c67e622691b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:10.823875 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29853981-74ec-4e24-88b0-2c67e622691b None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:10.824166 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29853981-74ec-4e24-88b0-2c67e622691b None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:10.824447 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29853981-74ec-4e24-88b0-2c67e622691b None admin] PATH_INFO: `/v3/users/02264f96f7214ecaabcc6264007255d2` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:10.825671 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29853981-74ec-4e24-88b0-2c67e622691b None admin] RBAC: Authorizing `identity:get_user(user_id=02264f96f7214ecaabcc6264007255d2)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:10.827267 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29853981-74ec-4e24-88b0-2c67e622691b None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:10.829293 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 100/204] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 16:08:10 2022] GET /identity/v3/users/02264f96f7214ecaabcc6264007255d2 => generated 289 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:10.844104 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29853981-74ec-4e24-88b0-2c67e622691b None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:10.878368 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:10.881453 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26d4524-0aa7-4829-8147-f8d5baefb87e None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:10.900785 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:10.919091 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b137b0-9844-4aa2-bae2-7f51456b003b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:10.919765 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b137b0-9844-4aa2-bae2-7f51456b003b None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:10.920054 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b137b0-9844-4aa2-bae2-7f51456b003b None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:10.920338 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b137b0-9844-4aa2-bae2-7f51456b003b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:10.921186 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b137b0-9844-4aa2-bae2-7f51456b003b None admin] RBAC: Adding query filter params (role.id=404d2ea20e7c4842892e5001133f1b93, scope.project.id=fe60851080e24e0db8e6af2ad2a17a54, user.id=48a53eb8f1874e4c8976945519c1a59a) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:10.921504 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b137b0-9844-4aa2-bae2-7f51456b003b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:10.923007 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b137b0-9844-4aa2-bae2-7f51456b003b None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:10.929591 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 105/205] 10.222.0.62 () {56 vars in 1374 bytes} [Fri May 27 16:08:10 2022] GET /identity/v3/role_assignments?user.id=48a53eb8f1874e4c8976945519c1a59a&scope.project.id=fe60851080e24e0db8e6af2ad2a17a54&role.id=404d2ea20e7c4842892e5001133f1b93 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:11.008933 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29853981-74ec-4e24-88b0-2c67e622691b None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:11.046754 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc511cd-42d7-4629-ab6e-dcd1395af01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:11.047437 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc511cd-42d7-4629-ab6e-dcd1395af01d None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:11.047727 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc511cd-42d7-4629-ab6e-dcd1395af01d None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:11.048012 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc511cd-42d7-4629-ab6e-dcd1395af01d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:11.125625 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc511cd-42d7-4629-ab6e-dcd1395af01d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:11.127172 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc511cd-42d7-4629-ab6e-dcd1395af01d None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:11.158402 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:11.235854 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 101/206] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 16:08:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 27 16:08:11.241675 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b137b0-9844-4aa2-bae2-7f51456b003b None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:11.381111 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b137b0-9844-4aa2-bae2-7f51456b003b None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:11.415731 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2074348b-1fca-4e19-8a44-8f5aab55ba9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:11.416583 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074348b-1fca-4e19-8a44-8f5aab55ba9f None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:11.416867 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074348b-1fca-4e19-8a44-8f5aab55ba9f None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:11.417144 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074348b-1fca-4e19-8a44-8f5aab55ba9f None admin] PATH_INFO: `/v3/projects/d280b4797bdd4aabacba365ec82ca978` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:11.418388 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2074348b-1fca-4e19-8a44-8f5aab55ba9f None admin] RBAC: Authorizing `identity:get_project(project_id=d280b4797bdd4aabacba365ec82ca978)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:11.419835 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2074348b-1fca-4e19-8a44-8f5aab55ba9f None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:11.421904 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 106/207] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 16:08:11 2022] GET /identity/v3/projects/d280b4797bdd4aabacba365ec82ca978 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:11.427480 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc511cd-42d7-4629-ab6e-dcd1395af01d None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:11.592922 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc511cd-42d7-4629-ab6e-dcd1395af01d None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:11.631248 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:11.638799 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a666c5-de7c-4caa-8455-fcf7051a0cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:11.639463 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a666c5-de7c-4caa-8455-fcf7051a0cf6 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:11.639805 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a666c5-de7c-4caa-8455-fcf7051a0cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:11.640090 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a666c5-de7c-4caa-8455-fcf7051a0cf6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:11.641028 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a666c5-de7c-4caa-8455-fcf7051a0cf6 None admin] RBAC: Adding query filter params (role.id=6d3bcbc332ec4ad4b4910a6a9fc398ae, scope.project.id=d280b4797bdd4aabacba365ec82ca978, user.id=02264f96f7214ecaabcc6264007255d2) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:11.641351 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a666c5-de7c-4caa-8455-fcf7051a0cf6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:11.642889 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a666c5-de7c-4caa-8455-fcf7051a0cf6 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:11.655092 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 102/208] 10.222.0.62 () {56 vars in 1374 bytes} [Fri May 27 16:08:11 2022] GET /identity/v3/role_assignments?user.id=02264f96f7214ecaabcc6264007255d2&scope.project.id=d280b4797bdd4aabacba365ec82ca978&role.id=6d3bcbc332ec4ad4b4910a6a9fc398ae => generated 608 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:12.885989 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d934fd-1516-494d-bccf-c34fa6f4782e None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:12.887035 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d934fd-1516-494d-bccf-c34fa6f4782e None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:12.887523 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d934fd-1516-494d-bccf-c34fa6f4782e None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:12.889187 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 107/209] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:08:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:08:12.895338 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e579689d-b09b-4321-b96d-031fa0afd233 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:12.896319 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e579689d-b09b-4321-b96d-031fa0afd233 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:12.896804 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e579689d-b09b-4321-b96d-031fa0afd233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:12.916417 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-e579689d-b09b-4321-b96d-031fa0afd233 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:08:12.918048 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-e579689d-b09b-4321-b96d-031fa0afd233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:08:12.988807 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 103/210] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:08:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:08:13.011641 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d11730-01bf-45e6-b44c-171ac44d5c25 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:13.011952 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d11730-01bf-45e6-b44c-171ac44d5c25 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:13.012203 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d11730-01bf-45e6-b44c-171ac44d5c25 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:13.013743 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 108/211] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:08:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:08:13.018853 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e579689d-b09b-4321-b96d-031fa0afd233 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:13.020115 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9373245-9bde-4e5e-a2d8-75ac2f2a13b0 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:13.020403 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9373245-9bde-4e5e-a2d8-75ac2f2a13b0 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:13.020681 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9373245-9bde-4e5e-a2d8-75ac2f2a13b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:13.043042 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-a9373245-9bde-4e5e-a2d8-75ac2f2a13b0 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:08:13.044388 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-a9373245-9bde-4e5e-a2d8-75ac2f2a13b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:08:13.078709 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:13.134353 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 109/212] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:08:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 16:08:13.134353 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13cf2fe-195e-41d5-901d-b90752546065 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:13.134353 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13cf2fe-195e-41d5-901d-b90752546065 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:13.134353 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13cf2fe-195e-41d5-901d-b90752546065 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:13.134353 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 110/213] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:08:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:08:13.136678 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f8af8-feaa-4b8e-a32b-f77f187dcf7c None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:13.136960 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f8af8-feaa-4b8e-a32b-f77f187dcf7c None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:13.137235 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f8af8-feaa-4b8e-a32b-f77f187dcf7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:13.141005 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e579689d-b09b-4321-b96d-031fa0afd233 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:13.154886 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-632f8af8-feaa-4b8e-a32b-f77f187dcf7c None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:08:13.156259 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-632f8af8-feaa-4b8e-a32b-f77f187dcf7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:08:13.165510 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:13.179382 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce663c5d-bcb7-4468-994c-c741a7f76efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:13.180178 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce663c5d-bcb7-4468-994c-c741a7f76efc None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:13.180888 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce663c5d-bcb7-4468-994c-c741a7f76efc None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:13.181178 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce663c5d-bcb7-4468-994c-c741a7f76efc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:13.182505 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce663c5d-bcb7-4468-994c-c741a7f76efc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:13.184018 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce663c5d-bcb7-4468-994c-c741a7f76efc None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:13.185628 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 104/214] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:08:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:13.190980 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce663c5d-bcb7-4468-994c-c741a7f76efc None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:13.242270 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 111/215] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:08:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 16:08:13.242270 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632f8af8-feaa-4b8e-a32b-f77f187dcf7c None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:13.300718 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce663c5d-bcb7-4468-994c-c741a7f76efc None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:13.336715 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedaeded-04ad-4fb0-b08c-8350c055b7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:13.337511 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedaeded-04ad-4fb0-b08c-8350c055b7d7 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:13.337795 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedaeded-04ad-4fb0-b08c-8350c055b7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:13.338076 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedaeded-04ad-4fb0-b08c-8350c055b7d7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:13.342715 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:13.349316 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedaeded-04ad-4fb0-b08c-8350c055b7d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:08:13.351322 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632f8af8-feaa-4b8e-a32b-f77f187dcf7c None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:13.357561 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-aedaeded-04ad-4fb0-b08c-8350c055b7d7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:08:13.357561 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:08:13.357561 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:08:13.357561 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:08:13.357561 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:08:13.357561 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:08:13.357561 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:08:13.357561 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:08:13.357561 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:08:13.357561 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:08:13.357561 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:08:13.357561 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:08:13.357561 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:08:13.357561 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:08:13.357561 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:08:13.357561 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:08:13.358501 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:08:13.358501 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:08:13.358501 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:08:13.358501 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:08:13.358501 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:08:13.358501 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:08:13.358501 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:08:13.358501 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:08:13.358501 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:08:13.358501 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:08:13.358501 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:08:13.358501 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:08:13.358501 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:08:13.358501 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:08:13.358501 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:08:13.358501 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:08:13.359292 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:08:13.359292 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:08:13.359292 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:08:13.359292 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:08:13.359292 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:08:13.359292 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:08:13.359292 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:08:13.359292 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:08:13.359292 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:08:13.359292 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:08:13.359292 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:08:13.359292 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:08:13.359292 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 105/216] 10.222.0.62 () {56 vars in 1096 bytes} [Fri May 27 16:08:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:08:13.359948 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedaeded-04ad-4fb0-b08c-8350c055b7d7 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:13.389685 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe811ea-44b4-408c-a732-146294b4db79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:13.390315 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe811ea-44b4-408c-a732-146294b4db79 None admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:13.390606 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe811ea-44b4-408c-a732-146294b4db79 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:13.390890 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe811ea-44b4-408c-a732-146294b4db79 None admin] PATH_INFO: `/v3/users` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:13.391597 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe811ea-44b4-408c-a732-146294b4db79 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:13.393045 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe811ea-44b4-408c-a732-146294b4db79 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:13.414393 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:13.466823 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedaeded-04ad-4fb0-b08c-8350c055b7d7 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:13.493511 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 112/217] 10.222.0.62 () {60 vars in 1132 bytes} [Fri May 27 16:08:13 2022] POST /identity/v3/users => generated 297 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:08:13.496594 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe811ea-44b4-408c-a732-146294b4db79 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:13.523555 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2362087-2518-442d-9d57-50472ba30062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:13.524566 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2362087-2518-442d-9d57-50472ba30062 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:13.524856 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2362087-2518-442d-9d57-50472ba30062 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:13.525650 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2362087-2518-442d-9d57-50472ba30062 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:13.539767 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2362087-2518-442d-9d57-50472ba30062 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:08:13.548851 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-f2362087-2518-442d-9d57-50472ba30062 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 16:08:13.548851 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:08:13.548851 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:08:13.548851 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:08:13.548851 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:08:13.548851 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:08:13.548851 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:08:13.548851 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:08:13.548851 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:08:13.548851 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:08:13.548851 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:08:13.548851 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:08:13.548851 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:08:13.548851 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:08:13.548851 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:08:13.548851 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:08:13.549800 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:08:13.549800 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:08:13.549800 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:08:13.549800 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:08:13.549800 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:08:13.549800 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:08:13.549800 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:08:13.549800 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:08:13.549800 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:08:13.549800 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:08:13.549800 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:08:13.549800 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:08:13.549800 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:08:13.549800 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:08:13.549800 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:08:13.549800 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:08:13.550647 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:08:13.550647 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:08:13.550647 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:08:13.550647 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:08:13.550647 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:08:13.550647 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:08:13.550647 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:08:13.550647 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:08:13.550647 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:08:13.550647 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:08:13.550647 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 16:08:13.550647 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:08:13.550647 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 106/218] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 16:08:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:08:13.557772 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2362087-2518-442d-9d57-50472ba30062 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:13.626261 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe811ea-44b4-408c-a732-146294b4db79 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:13.664126 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a34d6a6-86d0-4c8f-ab8c-65795bd91113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:13.664725 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a34d6a6-86d0-4c8f-ab8c-65795bd91113 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:13.665008 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a34d6a6-86d0-4c8f-ab8c-65795bd91113 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:13.665290 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a34d6a6-86d0-4c8f-ab8c-65795bd91113 None admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:13.666657 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a34d6a6-86d0-4c8f-ab8c-65795bd91113 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:13.666965 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a34d6a6-86d0-4c8f-ab8c-65795bd91113 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:13.668377 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a34d6a6-86d0-4c8f-ab8c-65795bd91113 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:13.672525 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2362087-2518-442d-9d57-50472ba30062 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:13.683030 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 113/219] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 16:08:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:13.683030 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b28de7-42ac-4f6b-91dc-21a3b2bf30e5 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:13.683030 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b28de7-42ac-4f6b-91dc-21a3b2bf30e5 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:13.683030 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b28de7-42ac-4f6b-91dc-21a3b2bf30e5 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:13.683030 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 114/220] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:08:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:08:13.684825 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b28de7-42ac-4f6b-91dc-21a3b2bf30e5 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:13.689070 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:13.701053 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:13.718641 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24732507-7b14-4e83-b639-5cb3cec9708f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:13.719316 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24732507-7b14-4e83-b639-5cb3cec9708f None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:13.719596 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24732507-7b14-4e83-b639-5cb3cec9708f None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:13.719876 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24732507-7b14-4e83-b639-5cb3cec9708f None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:13.720630 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24732507-7b14-4e83-b639-5cb3cec9708f None admin] RBAC: Adding query filter params (name=member) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:13.721157 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24732507-7b14-4e83-b639-5cb3cec9708f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:13.724331 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24732507-7b14-4e83-b639-5cb3cec9708f None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:13.732576 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 107/221] 10.222.0.62 () {56 vars in 1101 bytes} [Fri May 27 16:08:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:13.733844 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bca0f1-526f-47d3-8594-cb7cd3371f10 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:13.734135 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bca0f1-526f-47d3-8594-cb7cd3371f10 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:13.734448 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bca0f1-526f-47d3-8594-cb7cd3371f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:13.753814 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-a5bca0f1-526f-47d3-8594-cb7cd3371f10 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:08:13.754881 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-a5bca0f1-526f-47d3-8594-cb7cd3371f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:08:13.827237 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b28de7-42ac-4f6b-91dc-21a3b2bf30e5 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:13.849038 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 108/222] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:08:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:08:13.850106 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bca0f1-526f-47d3-8594-cb7cd3371f10 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:13.882525 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aebe091-3892-4c7a-b6b6-94330c990763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:13.883657 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aebe091-3892-4c7a-b6b6-94330c990763 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:13.883951 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aebe091-3892-4c7a-b6b6-94330c990763 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:13.884235 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aebe091-3892-4c7a-b6b6-94330c990763 None admin] PATH_INFO: `/v3/users/48a53eb8f1874e4c8976945519c1a59a` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:13.885870 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aebe091-3892-4c7a-b6b6-94330c990763 None admin] RBAC: Authorizing `identity:get_user(user_id=48a53eb8f1874e4c8976945519c1a59a)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:13.886976 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aebe091-3892-4c7a-b6b6-94330c990763 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:13.892878 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 115/223] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 16:08:13 2022] GET /identity/v3/users/48a53eb8f1874e4c8976945519c1a59a => generated 283 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:08:13.892878 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aebe091-3892-4c7a-b6b6-94330c990763 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:13.981621 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:13.986124 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bca0f1-526f-47d3-8594-cb7cd3371f10 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:13.988622 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:14.004196 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aebe091-3892-4c7a-b6b6-94330c990763 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:14.035736 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c897501b-117f-48f9-899e-ca1cbb804c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:14.036797 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c897501b-117f-48f9-899e-ca1cbb804c89 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:14.037189 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c897501b-117f-48f9-899e-ca1cbb804c89 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:14.037571 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c897501b-117f-48f9-899e-ca1cbb804c89 None admin] PATH_INFO: `/v3/users/076e982a905245c8936850f1d0b51687` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:14.049253 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e20aceb-8d50-4d72-94ce-4a3b5e93d496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:14.050391 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20aceb-8d50-4d72-94ce-4a3b5e93d496 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:14.050996 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20aceb-8d50-4d72-94ce-4a3b5e93d496 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:14.051424 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20aceb-8d50-4d72-94ce-4a3b5e93d496 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:14.054777 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c897501b-117f-48f9-899e-ca1cbb804c89 None admin] RBAC: Authorizing `identity:get_user(user_id=076e982a905245c8936850f1d0b51687)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:14.056428 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c897501b-117f-48f9-899e-ca1cbb804c89 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:14.065709 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 109/224] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 16:08:13 2022] GET /identity/v3/users/076e982a905245c8936850f1d0b51687 => generated 297 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:14.065709 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c897501b-117f-48f9-899e-ca1cbb804c89 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:14.071049 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e20aceb-8d50-4d72-94ce-4a3b5e93d496 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:08:14.082277 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-4e20aceb-8d50-4d72-94ce-4a3b5e93d496 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 16:08:14.082277 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:08:14.082277 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:08:14.082277 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:08:14.082277 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:08:14.082277 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:08:14.082277 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:08:14.082277 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:08:14.082277 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:08:14.082277 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:08:14.082277 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:08:14.082277 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:08:14.082277 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:08:14.082277 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:08:14.082277 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:08:14.082277 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:08:14.083214 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:08:14.083214 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:08:14.083214 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:08:14.083214 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:08:14.083214 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:08:14.083214 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:08:14.083214 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:08:14.083214 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:08:14.083214 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:08:14.083214 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:08:14.083214 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:08:14.083214 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:08:14.083214 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:08:14.083214 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:08:14.083214 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:08:14.083214 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:08:14.084027 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:08:14.084027 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:08:14.084027 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:08:14.084027 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:08:14.084027 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:08:14.084027 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:08:14.084027 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:08:14.084027 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:08:14.084027 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:08:14.084027 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:08:14.084027 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 16:08:14.084027 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:08:14.086340 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 116/225] 10.222.0.62 () {56 vars in 1114 bytes} [Fri May 27 16:08:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:08:14.087574 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e20aceb-8d50-4d72-94ce-4a3b5e93d496 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:14.174881 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c897501b-117f-48f9-899e-ca1cbb804c89 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:14.205113 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e20aceb-8d50-4d72-94ce-4a3b5e93d496 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:14.213403 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf75d95-306f-4b83-96ea-17cd95d0d95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:14.214466 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf75d95-306f-4b83-96ea-17cd95d0d95d None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:14.214858 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf75d95-306f-4b83-96ea-17cd95d0d95d None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:14.215250 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf75d95-306f-4b83-96ea-17cd95d0d95d None admin] PATH_INFO: `/v3/projects/fe60851080e24e0db8e6af2ad2a17a54` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:14.216583 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf75d95-306f-4b83-96ea-17cd95d0d95d None admin] RBAC: Authorizing `identity:get_project(project_id=fe60851080e24e0db8e6af2ad2a17a54)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:14.218576 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf75d95-306f-4b83-96ea-17cd95d0d95d None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:14.224728 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 110/226] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 16:08:14 2022] GET /identity/v3/projects/fe60851080e24e0db8e6af2ad2a17a54 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:14.224728 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf75d95-306f-4b83-96ea-17cd95d0d95d None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:14.249154 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe422b3-817e-43d9-b659-09976035209d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:14.250085 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe422b3-817e-43d9-b659-09976035209d None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:14.250571 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe422b3-817e-43d9-b659-09976035209d None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:14.251027 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe422b3-817e-43d9-b659-09976035209d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:14.251687 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:14.260575 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:14.324941 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe422b3-817e-43d9-b659-09976035209d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:14.326788 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe422b3-817e-43d9-b659-09976035209d None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:14.332135 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf75d95-306f-4b83-96ea-17cd95d0d95d None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:14.376533 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70c7ab0-25ed-4c3a-868d-46edd9d729e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:14.377561 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c7ab0-25ed-4c3a-868d-46edd9d729e8 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:14.378003 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c7ab0-25ed-4c3a-868d-46edd9d729e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:14.378571 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c7ab0-25ed-4c3a-868d-46edd9d729e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:14.380238 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70c7ab0-25ed-4c3a-868d-46edd9d729e8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:14.380792 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70c7ab0-25ed-4c3a-868d-46edd9d729e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:14.383792 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70c7ab0-25ed-4c3a-868d-46edd9d729e8 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:14.396889 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 111/227] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 16:08:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:14.397751 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70c7ab0-25ed-4c3a-868d-46edd9d729e8 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:14.441243 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 117/228] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 16:08:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 16:08:14.442473 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe422b3-817e-43d9-b659-09976035209d None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:14.485132 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:14.502186 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:14.510601 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70c7ab0-25ed-4c3a-868d-46edd9d729e8 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:14.548679 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe422b3-817e-43d9-b659-09976035209d None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:14.548867 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2844abe6-3134-4153-8db7-9b00e80adfb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:14.551216 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2844abe6-3134-4153-8db7-9b00e80adfb8 None admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:14.551735 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2844abe6-3134-4153-8db7-9b00e80adfb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:14.552213 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2844abe6-3134-4153-8db7-9b00e80adfb8 None admin] PATH_INFO: `/v3/projects/fe60851080e24e0db8e6af2ad2a17a54/users/48a53eb8f1874e4c8976945519c1a59a/roles/e04fe3eb1f714d74901ac83e33ea8a16` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:14.554738 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2844abe6-3134-4153-8db7-9b00e80adfb8 None admin] RBAC: Authorizing `identity:create_grant(project_id=fe60851080e24e0db8e6af2ad2a17a54, user_id=48a53eb8f1874e4c8976945519c1a59a, role_id=e04fe3eb1f714d74901ac83e33ea8a16)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:14.557004 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2844abe6-3134-4153-8db7-9b00e80adfb8 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:14.585912 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6064af1d-64bc-40f6-8760-455ddb0912a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:14.586963 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6064af1d-64bc-40f6-8760-455ddb0912a8 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:14.587370 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6064af1d-64bc-40f6-8760-455ddb0912a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:14.587790 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6064af1d-64bc-40f6-8760-455ddb0912a8 None admin] PATH_INFO: `/v3/users/48a53eb8f1874e4c8976945519c1a59a` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:14.589168 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6064af1d-64bc-40f6-8760-455ddb0912a8 None admin] RBAC: Authorizing `identity:get_user(user_id=48a53eb8f1874e4c8976945519c1a59a)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:14.590956 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6064af1d-64bc-40f6-8760-455ddb0912a8 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:14.592860 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 118/229] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 16:08:14 2022] GET /identity/v3/users/48a53eb8f1874e4c8976945519c1a59a => generated 283 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:14.593529 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6064af1d-64bc-40f6-8760-455ddb0912a8 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:14.633768 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 112/230] 10.222.0.62 () {58 vars in 1439 bytes} [Fri May 27 16:08:14 2022] PUT /identity/v3/projects/fe60851080e24e0db8e6af2ad2a17a54/users/48a53eb8f1874e4c8976945519c1a59a/roles/e04fe3eb1f714d74901ac83e33ea8a16 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:08:14.635113 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2844abe6-3134-4153-8db7-9b00e80adfb8 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:14.765365 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6064af1d-64bc-40f6-8760-455ddb0912a8 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:14.766288 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2844abe6-3134-4153-8db7-9b00e80adfb8 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:14.780681 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:14.812581 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa882388-12b6-4702-9669-11d117d0f110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:14.814107 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa882388-12b6-4702-9669-11d117d0f110 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:14.826470 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa882388-12b6-4702-9669-11d117d0f110 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:14.826470 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa882388-12b6-4702-9669-11d117d0f110 None admin] PATH_INFO: `/v3/projects/fe60851080e24e0db8e6af2ad2a17a54` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:14.826470 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa882388-12b6-4702-9669-11d117d0f110 None admin] RBAC: Authorizing `identity:get_project(project_id=fe60851080e24e0db8e6af2ad2a17a54)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:14.826470 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa882388-12b6-4702-9669-11d117d0f110 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:14.826470 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 113/231] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 16:08:14 2022] GET /identity/v3/projects/fe60851080e24e0db8e6af2ad2a17a54 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:14.830640 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa882388-12b6-4702-9669-11d117d0f110 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:14.850960 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab41dbb3-5738-4041-aaaa-79aff0404aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:14.852153 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41dbb3-5738-4041-aaaa-79aff0404aa6 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:14.852585 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41dbb3-5738-4041-aaaa-79aff0404aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:14.853008 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41dbb3-5738-4041-aaaa-79aff0404aa6 None admin] PATH_INFO: `/v3/projects/fe60851080e24e0db8e6af2ad2a17a54` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:14.856069 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab41dbb3-5738-4041-aaaa-79aff0404aa6 None admin] RBAC: Authorizing `identity:get_project(project_id=fe60851080e24e0db8e6af2ad2a17a54)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:14.860007 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab41dbb3-5738-4041-aaaa-79aff0404aa6 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:14.862677 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 119/232] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 16:08:14 2022] GET /identity/v3/projects/fe60851080e24e0db8e6af2ad2a17a54 => generated 302 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:14.874133 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab41dbb3-5738-4041-aaaa-79aff0404aa6 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:14.893451 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:15.000447 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa882388-12b6-4702-9669-11d117d0f110 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:15.017010 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab41dbb3-5738-4041-aaaa-79aff0404aa6 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:15.036026 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc9ee62-c1e8-42d6-ad24-b49b5f5a891b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:15.036916 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc9ee62-c1e8-42d6-ad24-b49b5f5a891b None admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:15.037199 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc9ee62-c1e8-42d6-ad24-b49b5f5a891b None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:15.037473 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc9ee62-c1e8-42d6-ad24-b49b5f5a891b None admin] PATH_INFO: `/v3/projects/fe60851080e24e0db8e6af2ad2a17a54/users/48a53eb8f1874e4c8976945519c1a59a/roles/404d2ea20e7c4842892e5001133f1b93` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:15.039838 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc9ee62-c1e8-42d6-ad24-b49b5f5a891b None admin] RBAC: Authorizing `identity:create_grant(project_id=fe60851080e24e0db8e6af2ad2a17a54, user_id=48a53eb8f1874e4c8976945519c1a59a, role_id=404d2ea20e7c4842892e5001133f1b93)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:15.041436 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc9ee62-c1e8-42d6-ad24-b49b5f5a891b None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:15.059244 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86773529-215c-47b0-b0df-a17701624a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:15.060426 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86773529-215c-47b0-b0df-a17701624a62 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:15.060651 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86773529-215c-47b0-b0df-a17701624a62 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:15.061112 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86773529-215c-47b0-b0df-a17701624a62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:15.062113 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86773529-215c-47b0-b0df-a17701624a62 None admin] RBAC: Adding query filter params (role.id=c8ce6d197f654598ac45f6016ecccabd, scope.project.id=fe60851080e24e0db8e6af2ad2a17a54, user.id=076e982a905245c8936850f1d0b51687) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:15.062587 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86773529-215c-47b0-b0df-a17701624a62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:15.064283 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86773529-215c-47b0-b0df-a17701624a62 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:15.070472 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 120/233] 10.222.0.62 () {56 vars in 1374 bytes} [Fri May 27 16:08:14 2022] GET /identity/v3/role_assignments?user.id=076e982a905245c8936850f1d0b51687&scope.project.id=fe60851080e24e0db8e6af2ad2a17a54&role.id=c8ce6d197f654598ac45f6016ecccabd => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:15.135170 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 114/234] 10.222.0.62 () {58 vars in 1439 bytes} [Fri May 27 16:08:14 2022] PUT /identity/v3/projects/fe60851080e24e0db8e6af2ad2a17a54/users/48a53eb8f1874e4c8976945519c1a59a/roles/404d2ea20e7c4842892e5001133f1b93 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:08:16.159705 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ee17f9-a440-4745-95f9-35be7263c146 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:16.160664 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ee17f9-a440-4745-95f9-35be7263c146 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:16.161162 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ee17f9-a440-4745-95f9-35be7263c146 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:16.163106 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 121/235] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:08:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:08:16.168546 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf8957-f513-48b6-8d01-935d618089ce None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:16.169339 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf8957-f513-48b6-8d01-935d618089ce None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:16.169779 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf8957-f513-48b6-8d01-935d618089ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:16.191254 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-d3cf8957-f513-48b6-8d01-935d618089ce None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:08:16.192728 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-d3cf8957-f513-48b6-8d01-935d618089ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:08:16.203729 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ffe2e-928b-4069-8cde-6515ec1cede0 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:16.204259 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ffe2e-928b-4069-8cde-6515ec1cede0 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:16.204715 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ffe2e-928b-4069-8cde-6515ec1cede0 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:16.206574 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 122/236] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:08:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:08:16.211054 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a7f07-8975-479b-8ad8-ae7257100409 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:16.211527 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a7f07-8975-479b-8ad8-ae7257100409 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:16.211977 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a7f07-8975-479b-8ad8-ae7257100409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:16.239005 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-4e6a7f07-8975-479b-8ad8-ae7257100409 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:08:16.240207 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-4e6a7f07-8975-479b-8ad8-ae7257100409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:08:16.303169 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:16.328190 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 115/237] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:08:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 16:08:16.351690 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cf8957-f513-48b6-8d01-935d618089ce None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:16.369085 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:16.376827 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 123/238] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:08:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:08:16.412606 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6a7f07-8975-479b-8ad8-ae7257100409 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:16.479835 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cf8957-f513-48b6-8d01-935d618089ce None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:16.542563 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b90153-3614-4a31-9d64-46354dee3680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:16.543924 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b90153-3614-4a31-9d64-46354dee3680 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:16.545200 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b90153-3614-4a31-9d64-46354dee3680 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:16.545695 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b90153-3614-4a31-9d64-46354dee3680 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:16.551147 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b90153-3614-4a31-9d64-46354dee3680 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:16.552851 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b90153-3614-4a31-9d64-46354dee3680 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:16.555267 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 116/239] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:08:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:08:16.561322 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b90153-3614-4a31-9d64-46354dee3680 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:16.606831 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6a7f07-8975-479b-8ad8-ae7257100409 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:16.676032 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86e3229-c5b1-4ad4-86bf-6fea67cee45a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:16.678306 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e3229-c5b1-4ad4-86bf-6fea67cee45a None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:16.680219 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e3229-c5b1-4ad4-86bf-6fea67cee45a None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:16.680704 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e3229-c5b1-4ad4-86bf-6fea67cee45a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:16.706686 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86e3229-c5b1-4ad4-86bf-6fea67cee45a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:08:16.712858 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:16.716360 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-a86e3229-c5b1-4ad4-86bf-6fea67cee45a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 16:08:16.716360 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:08:16.716360 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:08:16.716360 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:08:16.716360 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:08:16.716360 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:08:16.716360 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:08:16.716360 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:08:16.716360 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:08:16.716360 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:08:16.716360 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:08:16.716360 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:08:16.716360 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:08:16.716360 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:08:16.716360 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:08:16.716360 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:08:16.717242 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:08:16.717242 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:08:16.717242 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:08:16.717242 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:08:16.717242 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:08:16.717242 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:08:16.717242 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:08:16.717242 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:08:16.717242 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:08:16.717242 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:08:16.717242 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:08:16.717242 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:08:16.717242 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:08:16.717242 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:08:16.717242 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:08:16.717242 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:08:16.718026 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:08:16.718026 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:08:16.718026 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:08:16.718026 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:08:16.718026 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:08:16.718026 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:08:16.718026 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:08:16.718026 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:08:16.718026 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:08:16.718026 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:08:16.718026 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 16:08:16.718026 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:08:16.720406 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 124/240] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 16:08:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:08:16.727229 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86e3229-c5b1-4ad4-86bf-6fea67cee45a None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:16.737003 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b90153-3614-4a31-9d64-46354dee3680 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:16.791300 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bfeb89-e04b-4e1b-b107-0e42755d0c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:16.791982 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:16.792091 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bfeb89-e04b-4e1b-b107-0e42755d0c8d None admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:16.792272 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bfeb89-e04b-4e1b-b107-0e42755d0c8d None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:16.792550 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bfeb89-e04b-4e1b-b107-0e42755d0c8d None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:16.793282 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bfeb89-e04b-4e1b-b107-0e42755d0c8d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:16.794721 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bfeb89-e04b-4e1b-b107-0e42755d0c8d None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:16.878930 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86e3229-c5b1-4ad4-86bf-6fea67cee45a None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:16.923334 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 117/241] 10.222.0.62 () {60 vars in 1132 bytes} [Fri May 27 16:08:16 2022] POST /identity/v3/users => generated 293 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:08:16.927771 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58397abf-461a-418e-93bd-d0f32b3be674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:16.928395 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58397abf-461a-418e-93bd-d0f32b3be674 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:16.928990 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58397abf-461a-418e-93bd-d0f32b3be674 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:16.929266 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58397abf-461a-418e-93bd-d0f32b3be674 None admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:16.930079 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58397abf-461a-418e-93bd-d0f32b3be674 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:16.930416 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58397abf-461a-418e-93bd-d0f32b3be674 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:16.931989 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58397abf-461a-418e-93bd-d0f32b3be674 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:16.952588 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 125/242] 10.222.0.62 () {56 vars in 1101 bytes} [Fri May 27 16:08:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:16.957965 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bfeb89-e04b-4e1b-b107-0e42755d0c8d None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:17.146954 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bfeb89-e04b-4e1b-b107-0e42755d0c8d None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:17.199418 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:17.206902 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59b60a4-067b-4dd1-9dd6-79bba5c4ae5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:17.207803 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b60a4-067b-4dd1-9dd6-79bba5c4ae5f None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:17.208097 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b60a4-067b-4dd1-9dd6-79bba5c4ae5f None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:17.211965 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b60a4-067b-4dd1-9dd6-79bba5c4ae5f None admin] PATH_INFO: `/v3/users/5f85e1daa5744ef68e90bc3b81a00ec0` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:17.222755 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59b60a4-067b-4dd1-9dd6-79bba5c4ae5f None admin] RBAC: Authorizing `identity:get_user(user_id=5f85e1daa5744ef68e90bc3b81a00ec0)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:17.224253 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59b60a4-067b-4dd1-9dd6-79bba5c4ae5f None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:17.225959 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 118/243] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 16:08:16 2022] GET /identity/v3/users/5f85e1daa5744ef68e90bc3b81a00ec0 => generated 297 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:17.232106 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58397abf-461a-418e-93bd-d0f32b3be674 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:17.284960 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3643e15-159e-40af-b7da-c10beb76f732 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:17.285290 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3643e15-159e-40af-b7da-c10beb76f732 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:17.285532 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3643e15-159e-40af-b7da-c10beb76f732 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:17.286952 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 119/244] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:08:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 16:08:17.293021 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ffad9d-195d-45d3-9528-5fc4d40991f8 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:17.293314 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ffad9d-195d-45d3-9528-5fc4d40991f8 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:17.293598 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ffad9d-195d-45d3-9528-5fc4d40991f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:17.315831 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-80ffad9d-195d-45d3-9528-5fc4d40991f8 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:08:17.318438 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-80ffad9d-195d-45d3-9528-5fc4d40991f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:08:17.341442 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:17.353148 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58397abf-461a-418e-93bd-d0f32b3be674 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:17.398127 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938bb0c6-3d08-4e30-98e3-f4e7a8045d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:17.399223 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938bb0c6-3d08-4e30-98e3-f4e7a8045d31 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:17.399710 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938bb0c6-3d08-4e30-98e3-f4e7a8045d31 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:17.400813 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938bb0c6-3d08-4e30-98e3-f4e7a8045d31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:17.414224 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 120/245] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:08:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 16:08:17.441391 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ffad9d-195d-45d3-9528-5fc4d40991f8 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:17.488576 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938bb0c6-3d08-4e30-98e3-f4e7a8045d31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:17.489985 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938bb0c6-3d08-4e30-98e3-f4e7a8045d31 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:17.594236 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ffad9d-195d-45d3-9528-5fc4d40991f8 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:17.606076 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:17.622394 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:17.625784 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 126/246] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 16:08:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 16:08:17.627052 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a36cec-2cfe-471f-923a-fc810805c51d None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:17.627341 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a36cec-2cfe-471f-923a-fc810805c51d None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:17.627629 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a36cec-2cfe-471f-923a-fc810805c51d None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:17.629034 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 127/247] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:08:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:08:17.636311 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b9551-b805-4368-bb13-d594b1fad92f None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:17.637122 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b9551-b805-4368-bb13-d594b1fad92f None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:17.637403 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b9551-b805-4368-bb13-d594b1fad92f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:17.646093 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710585bb-f4a6-438d-a7e6-d1c7cd8b91f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:17.646938 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710585bb-f4a6-438d-a7e6-d1c7cd8b91f2 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:17.653472 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710585bb-f4a6-438d-a7e6-d1c7cd8b91f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:17.653472 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710585bb-f4a6-438d-a7e6-d1c7cd8b91f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:17.656135 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-555b9551-b805-4368-bb13-d594b1fad92f None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:08:17.657350 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-555b9551-b805-4368-bb13-d594b1fad92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:08:17.661461 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710585bb-f4a6-438d-a7e6-d1c7cd8b91f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:08:17.671248 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-710585bb-f4a6-438d-a7e6-d1c7cd8b91f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:08:17.671248 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:08:17.671248 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:08:17.671248 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:08:17.671248 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:08:17.671248 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:08:17.671248 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:08:17.671248 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:08:17.671248 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:08:17.671248 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:08:17.671248 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:08:17.671248 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:08:17.671248 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:08:17.671248 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:08:17.671248 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:08:17.671248 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:08:17.672199 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:08:17.672199 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:08:17.672199 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:08:17.672199 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:08:17.672199 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:08:17.672199 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:08:17.672199 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:08:17.672199 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:08:17.672199 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:08:17.672199 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:08:17.672199 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:08:17.672199 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:08:17.672199 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:08:17.672199 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:08:17.672199 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:08:17.672199 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:08:17.672994 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:08:17.672994 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:08:17.672994 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:08:17.672994 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:08:17.672994 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:08:17.672994 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:08:17.672994 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:08:17.672994 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:08:17.672994 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:08:17.672994 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:08:17.672994 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:08:17.672994 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:08:17.672994 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 121/248] 10.222.0.62 () {56 vars in 1096 bytes} [Fri May 27 16:08:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:08:17.673653 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710585bb-f4a6-438d-a7e6-d1c7cd8b91f2 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:17.755445 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 128/249] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:08:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 16:08:17.756932 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555b9551-b805-4368-bb13-d594b1fad92f None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:17.809775 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710585bb-f4a6-438d-a7e6-d1c7cd8b91f2 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:17.858283 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c07469-9a9d-4476-8e36-22c40dc5560b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:17.859166 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c07469-9a9d-4476-8e36-22c40dc5560b None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:17.859454 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c07469-9a9d-4476-8e36-22c40dc5560b None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:17.859735 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c07469-9a9d-4476-8e36-22c40dc5560b None admin] PATH_INFO: `/v3/projects/fe60851080e24e0db8e6af2ad2a17a54` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:17.860949 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c07469-9a9d-4476-8e36-22c40dc5560b None admin] RBAC: Authorizing `identity:get_project(project_id=fe60851080e24e0db8e6af2ad2a17a54)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:17.863027 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c07469-9a9d-4476-8e36-22c40dc5560b None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:17.864933 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 122/250] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 16:08:17 2022] GET /identity/v3/projects/fe60851080e24e0db8e6af2ad2a17a54 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:17.865704 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c07469-9a9d-4476-8e36-22c40dc5560b None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:17.899393 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555b9551-b805-4368-bb13-d594b1fad92f None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:17.927414 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:17.929627 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:17.948118 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28006764-3c92-4ea6-8538-c6efb6a0531e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:17.948825 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28006764-3c92-4ea6-8538-c6efb6a0531e None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:17.949103 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28006764-3c92-4ea6-8538-c6efb6a0531e None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:17.949421 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28006764-3c92-4ea6-8538-c6efb6a0531e None admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:17.950839 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28006764-3c92-4ea6-8538-c6efb6a0531e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:17.951283 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28006764-3c92-4ea6-8538-c6efb6a0531e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:17.952736 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28006764-3c92-4ea6-8538-c6efb6a0531e None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:17.978778 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 129/251] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 16:08:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:17.980038 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28006764-3c92-4ea6-8538-c6efb6a0531e None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:18.044737 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c07469-9a9d-4476-8e36-22c40dc5560b None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:18.114281 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c815d4-15c7-4330-a26d-298ab7c05d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:18.115475 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c815d4-15c7-4330-a26d-298ab7c05d8c None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:18.115964 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c815d4-15c7-4330-a26d-298ab7c05d8c None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:18.116441 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c815d4-15c7-4330-a26d-298ab7c05d8c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:18.129548 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c815d4-15c7-4330-a26d-298ab7c05d8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:08:18.138039 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-69c815d4-15c7-4330-a26d-298ab7c05d8c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 16:08:18.138039 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:08:18.138039 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:08:18.138039 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:08:18.138039 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:08:18.138039 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:08:18.138039 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:08:18.138039 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:08:18.138039 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:08:18.138039 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:08:18.138039 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:08:18.138039 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:08:18.138039 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:08:18.138039 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:08:18.138039 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:08:18.138039 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:08:18.138981 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:08:18.138981 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:08:18.138981 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:08:18.138981 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:08:18.138981 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:08:18.138981 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:08:18.138981 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:08:18.138981 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:08:18.138981 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:08:18.138981 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:08:18.138981 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:08:18.138981 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:08:18.138981 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:08:18.138981 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:08:18.138981 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:08:18.138981 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:08:18.139787 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:08:18.139787 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:08:18.139787 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:08:18.139787 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:08:18.139787 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:08:18.139787 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:08:18.139787 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:08:18.139787 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:08:18.139787 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:08:18.139787 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:08:18.139787 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 16:08:18.139787 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:08:18.139787 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 123/252] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 16:08:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:08:18.140935 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c815d4-15c7-4330-a26d-298ab7c05d8c None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:18.147058 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28006764-3c92-4ea6-8538-c6efb6a0531e None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:18.184919 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfd11c2-a244-41b1-b278-d111b93a689b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:18.185964 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd11c2-a244-41b1-b278-d111b93a689b None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:18.186494 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd11c2-a244-41b1-b278-d111b93a689b None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:18.186847 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd11c2-a244-41b1-b278-d111b93a689b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:18.187765 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfd11c2-a244-41b1-b278-d111b93a689b None admin] RBAC: Adding query filter params (role.id=6d3bcbc332ec4ad4b4910a6a9fc398ae, scope.project.id=fe60851080e24e0db8e6af2ad2a17a54, user.id=5f85e1daa5744ef68e90bc3b81a00ec0) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:18.188150 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfd11c2-a244-41b1-b278-d111b93a689b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:18.189857 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfd11c2-a244-41b1-b278-d111b93a689b None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:18.196501 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 130/253] 10.222.0.62 () {56 vars in 1374 bytes} [Fri May 27 16:08:17 2022] GET /identity/v3/role_assignments?user.id=5f85e1daa5744ef68e90bc3b81a00ec0&scope.project.id=fe60851080e24e0db8e6af2ad2a17a54&role.id=6d3bcbc332ec4ad4b4910a6a9fc398ae => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:18.198560 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea98d79d-c38e-45b8-8757-c3c1ad9135db None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:18.199161 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea98d79d-c38e-45b8-8757-c3c1ad9135db None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:18.199621 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea98d79d-c38e-45b8-8757-c3c1ad9135db None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:18.201572 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 131/254] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:08:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:08:18.207009 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea98d79d-c38e-45b8-8757-c3c1ad9135db None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:18.265589 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:18.305653 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c815d4-15c7-4330-a26d-298ab7c05d8c None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:18.325051 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:18.333496 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea98d79d-c38e-45b8-8757-c3c1ad9135db None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:18.372523 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dcf7c6-fbee-4767-ad12-2cdc9a9d2f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:18.373587 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dcf7c6-fbee-4767-ad12-2cdc9a9d2f3d None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:18.374074 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dcf7c6-fbee-4767-ad12-2cdc9a9d2f3d None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:18.374634 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dcf7c6-fbee-4767-ad12-2cdc9a9d2f3d None admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:18.375613 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dcf7c6-fbee-4767-ad12-2cdc9a9d2f3d None admin] RBAC: Adding query filter params (name=member) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:18.376154 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dcf7c6-fbee-4767-ad12-2cdc9a9d2f3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:18.377783 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dcf7c6-fbee-4767-ad12-2cdc9a9d2f3d None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:18.388830 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 132/255] 10.222.0.62 () {56 vars in 1101 bytes} [Fri May 27 16:08:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:18.390508 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e63238-f810-49aa-bd03-3c717e3eca65 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:18.391101 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e63238-f810-49aa-bd03-3c717e3eca65 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:18.391598 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e63238-f810-49aa-bd03-3c717e3eca65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:18.392566 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85035515-cfd2-44a5-992b-f7ec33d715fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:18.393461 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85035515-cfd2-44a5-992b-f7ec33d715fa None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:18.393754 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85035515-cfd2-44a5-992b-f7ec33d715fa None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:18.394041 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85035515-cfd2-44a5-992b-f7ec33d715fa None admin] PATH_INFO: `/v3/users/48a53eb8f1874e4c8976945519c1a59a` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:18.397826 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85035515-cfd2-44a5-992b-f7ec33d715fa None admin] RBAC: Authorizing `identity:get_user(user_id=48a53eb8f1874e4c8976945519c1a59a)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:18.399590 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85035515-cfd2-44a5-992b-f7ec33d715fa None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:18.401616 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 124/256] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 16:08:18 2022] GET /identity/v3/users/48a53eb8f1874e4c8976945519c1a59a => generated 283 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:18.402218 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85035515-cfd2-44a5-992b-f7ec33d715fa None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:18.412675 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-63e63238-f810-49aa-bd03-3c717e3eca65 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:08:18.414179 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-63e63238-f810-49aa-bd03-3c717e3eca65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:08:18.491884 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 133/257] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:08:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:08:18.495070 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e63238-f810-49aa-bd03-3c717e3eca65 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:18.551580 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85035515-cfd2-44a5-992b-f7ec33d715fa None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:18.558663 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:18.591292 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f527e1a-ebee-45c7-a6c4-ed0287389826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:18.592536 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f527e1a-ebee-45c7-a6c4-ed0287389826 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:18.593024 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f527e1a-ebee-45c7-a6c4-ed0287389826 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:18.593500 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f527e1a-ebee-45c7-a6c4-ed0287389826 None admin] PATH_INFO: `/v3/users/076e982a905245c8936850f1d0b51687` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:18.594942 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f527e1a-ebee-45c7-a6c4-ed0287389826 None admin] RBAC: Authorizing `identity:get_user(user_id=076e982a905245c8936850f1d0b51687)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:18.596722 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f527e1a-ebee-45c7-a6c4-ed0287389826 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:18.598745 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 125/258] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 16:08:18 2022] GET /identity/v3/users/076e982a905245c8936850f1d0b51687 => generated 297 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:18.599710 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f527e1a-ebee-45c7-a6c4-ed0287389826 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:18.650223 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:18.684586 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e63238-f810-49aa-bd03-3c717e3eca65 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:18.708435 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f527e1a-ebee-45c7-a6c4-ed0287389826 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:18.743993 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c52b8b-6fa2-4e51-b240-678db8b4047c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:18.745718 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c52b8b-6fa2-4e51-b240-678db8b4047c None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:18.746272 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c52b8b-6fa2-4e51-b240-678db8b4047c None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:18.746758 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c52b8b-6fa2-4e51-b240-678db8b4047c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:18.758890 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c52b8b-6fa2-4e51-b240-678db8b4047c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:08:18.768054 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-70c52b8b-6fa2-4e51-b240-678db8b4047c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 16:08:18.768054 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:08:18.768054 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:08:18.768054 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:08:18.768054 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:08:18.768054 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:08:18.768054 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:08:18.768054 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:08:18.768054 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:08:18.768054 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:08:18.768054 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:08:18.768054 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:08:18.768054 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:08:18.768054 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:08:18.768054 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:08:18.768054 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:08:18.768921 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:08:18.768921 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:08:18.768921 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:08:18.768921 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:08:18.768921 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:08:18.768921 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:08:18.768921 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:08:18.768921 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:08:18.768921 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:08:18.768921 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:08:18.768921 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:08:18.768921 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:08:18.768921 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:08:18.768921 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:08:18.768921 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:08:18.768921 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:08:18.769808 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:08:18.769808 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:08:18.769808 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:08:18.769808 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:08:18.769808 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:08:18.769808 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:08:18.769808 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:08:18.769808 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:08:18.769808 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:08:18.769808 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:08:18.769808 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 16:08:18.769808 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:08:18.772685 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 126/259] 10.222.0.62 () {56 vars in 1114 bytes} [Fri May 27 16:08:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:08:18.773945 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c52b8b-6fa2-4e51-b240-678db8b4047c None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:18.790424 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a25cde-9256-4048-90ea-209ccd3c36e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:18.791203 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a25cde-9256-4048-90ea-209ccd3c36e0 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:18.791546 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a25cde-9256-4048-90ea-209ccd3c36e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:18.791830 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a25cde-9256-4048-90ea-209ccd3c36e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:18.895399 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c52b8b-6fa2-4e51-b240-678db8b4047c None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:18.900624 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:18.938048 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b25425-59f8-4b78-8abd-021ccfca8249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:18.939955 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b25425-59f8-4b78-8abd-021ccfca8249 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:18.940448 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b25425-59f8-4b78-8abd-021ccfca8249 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:18.940935 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b25425-59f8-4b78-8abd-021ccfca8249 None admin] PATH_INFO: `/v3/projects/fe60851080e24e0db8e6af2ad2a17a54` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:18.943100 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b25425-59f8-4b78-8abd-021ccfca8249 None admin] RBAC: Authorizing `identity:get_project(project_id=fe60851080e24e0db8e6af2ad2a17a54)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:18.944854 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b25425-59f8-4b78-8abd-021ccfca8249 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:18.946878 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 127/260] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 16:08:18 2022] GET /identity/v3/projects/fe60851080e24e0db8e6af2ad2a17a54 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:18.948187 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b25425-59f8-4b78-8abd-021ccfca8249 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:18.978468 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a25cde-9256-4048-90ea-209ccd3c36e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:18.979973 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a25cde-9256-4048-90ea-209ccd3c36e0 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:19.073627 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:19.086226 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b25425-59f8-4b78-8abd-021ccfca8249 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:19.156672 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118cb446-cca7-47b4-86dd-2ead200f227d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:19.157813 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118cb446-cca7-47b4-86dd-2ead200f227d None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:19.159208 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118cb446-cca7-47b4-86dd-2ead200f227d None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:19.160434 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118cb446-cca7-47b4-86dd-2ead200f227d None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:19.161395 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118cb446-cca7-47b4-86dd-2ead200f227d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:19.162064 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118cb446-cca7-47b4-86dd-2ead200f227d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:19.164725 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118cb446-cca7-47b4-86dd-2ead200f227d None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:19.180705 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 128/261] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 16:08:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:19.183345 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118cb446-cca7-47b4-86dd-2ead200f227d None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:19.205699 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 134/262] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 16:08:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 713 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 16:08:19.211108 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a25cde-9256-4048-90ea-209ccd3c36e0 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:19.259712 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:19.401117 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a25cde-9256-4048-90ea-209ccd3c36e0 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:19.418155 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118cb446-cca7-47b4-86dd-2ead200f227d None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:19.466996 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aac49be-6d4e-487f-9acb-10d19b66f12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:19.467887 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac49be-6d4e-487f-9acb-10d19b66f12f None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:19.468160 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac49be-6d4e-487f-9acb-10d19b66f12f None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:19.468430 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac49be-6d4e-487f-9acb-10d19b66f12f None admin] PATH_INFO: `/v3/users/48a53eb8f1874e4c8976945519c1a59a` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:19.472666 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aac49be-6d4e-487f-9acb-10d19b66f12f None admin] RBAC: Authorizing `identity:get_user(user_id=48a53eb8f1874e4c8976945519c1a59a)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:19.474118 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aac49be-6d4e-487f-9acb-10d19b66f12f None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:19.475958 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 135/263] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 16:08:19 2022] GET /identity/v3/users/48a53eb8f1874e4c8976945519c1a59a => generated 283 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:19.485553 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aac49be-6d4e-487f-9acb-10d19b66f12f None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:19.495621 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cdf439-274c-43c4-9d1f-77885c8b3d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:19.500873 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cdf439-274c-43c4-9d1f-77885c8b3d69 None admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:19.501152 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cdf439-274c-43c4-9d1f-77885c8b3d69 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:19.501427 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cdf439-274c-43c4-9d1f-77885c8b3d69 None admin] PATH_INFO: `/v3/projects/fe60851080e24e0db8e6af2ad2a17a54/users/076e982a905245c8936850f1d0b51687/roles/c8ce6d197f654598ac45f6016ecccabd` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:19.503487 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cdf439-274c-43c4-9d1f-77885c8b3d69 None admin] RBAC: Authorizing `identity:create_grant(project_id=fe60851080e24e0db8e6af2ad2a17a54, user_id=076e982a905245c8936850f1d0b51687, role_id=c8ce6d197f654598ac45f6016ecccabd)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:19.504894 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:19.505744 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cdf439-274c-43c4-9d1f-77885c8b3d69 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:19.588740 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 129/264] 10.222.0.62 () {58 vars in 1439 bytes} [Fri May 27 16:08:19 2022] PUT /identity/v3/projects/fe60851080e24e0db8e6af2ad2a17a54/users/076e982a905245c8936850f1d0b51687/roles/c8ce6d197f654598ac45f6016ecccabd => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:08:19.590402 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cdf439-274c-43c4-9d1f-77885c8b3d69 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:19.772987 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aac49be-6d4e-487f-9acb-10d19b66f12f None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:19.871536 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd70931-8c4a-4c4e-a58b-f95c3e59b48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:19.872416 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd70931-8c4a-4c4e-a58b-f95c3e59b48c None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:19.872700 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd70931-8c4a-4c4e-a58b-f95c3e59b48c None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:19.872978 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd70931-8c4a-4c4e-a58b-f95c3e59b48c None admin] PATH_INFO: `/v3/projects/fe60851080e24e0db8e6af2ad2a17a54` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:19.874356 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd70931-8c4a-4c4e-a58b-f95c3e59b48c None admin] RBAC: Authorizing `identity:get_project(project_id=fe60851080e24e0db8e6af2ad2a17a54)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:19.875820 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd70931-8c4a-4c4e-a58b-f95c3e59b48c None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:19.883046 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 136/265] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 16:08:19 2022] GET /identity/v3/projects/fe60851080e24e0db8e6af2ad2a17a54 => generated 302 bytes in 406 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:19.888457 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd70931-8c4a-4c4e-a58b-f95c3e59b48c None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:19.891127 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:19.898810 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cdf439-274c-43c4-9d1f-77885c8b3d69 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:19.954862 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cde856-0dc5-4fac-bf1a-52fb74c4bfa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:19.955609 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cde856-0dc5-4fac-bf1a-52fb74c4bfa6 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:19.955896 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cde856-0dc5-4fac-bf1a-52fb74c4bfa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:19.956273 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cde856-0dc5-4fac-bf1a-52fb74c4bfa6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:19.977804 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:20.015324 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd70931-8c4a-4c4e-a58b-f95c3e59b48c None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:20.066872 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4f8ee8-27a2-4a45-bd51-b67312a7c676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:20.067462 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4f8ee8-27a2-4a45-bd51-b67312a7c676 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:20.067749 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4f8ee8-27a2-4a45-bd51-b67312a7c676 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:20.068030 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4f8ee8-27a2-4a45-bd51-b67312a7c676 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:20.068874 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4f8ee8-27a2-4a45-bd51-b67312a7c676 None admin] RBAC: Adding query filter params (role.id=e04fe3eb1f714d74901ac83e33ea8a16, scope.project.id=fe60851080e24e0db8e6af2ad2a17a54, user.id=48a53eb8f1874e4c8976945519c1a59a) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:20.069191 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4f8ee8-27a2-4a45-bd51-b67312a7c676 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:20.070703 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4f8ee8-27a2-4a45-bd51-b67312a7c676 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:20.084924 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 137/266] 10.222.0.62 () {56 vars in 1374 bytes} [Fri May 27 16:08:19 2022] GET /identity/v3/role_assignments?user.id=48a53eb8f1874e4c8976945519c1a59a&scope.project.id=fe60851080e24e0db8e6af2ad2a17a54&role.id=e04fe3eb1f714d74901ac83e33ea8a16 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:08:20.102124 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cde856-0dc5-4fac-bf1a-52fb74c4bfa6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:20.103881 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cde856-0dc5-4fac-bf1a-52fb74c4bfa6 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:20.258192 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:20.267735 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 130/267] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 16:08:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 678 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 16:08:20.273239 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4f8ee8-27a2-4a45-bd51-b67312a7c676 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:20.375798 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee39c072-5c12-4091-8a2e-171420f56ed8 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:20.376125 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee39c072-5c12-4091-8a2e-171420f56ed8 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:20.376352 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee39c072-5c12-4091-8a2e-171420f56ed8 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:20.377977 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 131/268] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:08:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 16:08:20.385599 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf5e477-9fe1-4606-a6b8-197baa082d31 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:20.385886 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf5e477-9fe1-4606-a6b8-197baa082d31 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:20.386161 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf5e477-9fe1-4606-a6b8-197baa082d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:20.398841 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4f8ee8-27a2-4a45-bd51-b67312a7c676 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:20.406971 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-caf5e477-9fe1-4606-a6b8-197baa082d31 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:08:20.408217 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-caf5e477-9fe1-4606-a6b8-197baa082d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:08:20.449825 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a9e8d-1217-40be-a260-b88a8ff45af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:20.450727 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a9e8d-1217-40be-a260-b88a8ff45af2 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:20.451009 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a9e8d-1217-40be-a260-b88a8ff45af2 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:20.451285 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a9e8d-1217-40be-a260-b88a8ff45af2 None admin] PATH_INFO: `/v3/projects/fe60851080e24e0db8e6af2ad2a17a54` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:20.453453 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4a9e8d-1217-40be-a260-b88a8ff45af2 None admin] RBAC: Authorizing `identity:get_project(project_id=fe60851080e24e0db8e6af2ad2a17a54)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:20.455366 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4a9e8d-1217-40be-a260-b88a8ff45af2 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:20.460866 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 138/269] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 16:08:20 2022] GET /identity/v3/projects/fe60851080e24e0db8e6af2ad2a17a54 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:20.466446 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a9e8d-1217-40be-a260-b88a8ff45af2 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:20.480758 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:20.522890 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 132/270] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:08:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 16:08:20.525486 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be4c4d-7674-4638-83d7-ca6a19042798 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:20.526002 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be4c4d-7674-4638-83d7-ca6a19042798 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:20.526888 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be4c4d-7674-4638-83d7-ca6a19042798 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:20.529077 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 133/271] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:08:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:08:20.534567 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f2b9f-08e3-4ac7-8c13-02a61bdf6ac5 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:20.534876 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f2b9f-08e3-4ac7-8c13-02a61bdf6ac5 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:20.535164 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f2b9f-08e3-4ac7-8c13-02a61bdf6ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:20.553867 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-371f2b9f-08e3-4ac7-8c13-02a61bdf6ac5 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:08:20.555417 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-371f2b9f-08e3-4ac7-8c13-02a61bdf6ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:08:20.602996 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a9e8d-1217-40be-a260-b88a8ff45af2 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:20.641368 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 134/272] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:08:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:08:20.642605 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371f2b9f-08e3-4ac7-8c13-02a61bdf6ac5 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:20.646442 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a72a1-80a6-42d9-a35e-1d9f47af0b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:20.648039 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a72a1-80a6-42d9-a35e-1d9f47af0b80 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:20.648322 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a72a1-80a6-42d9-a35e-1d9f47af0b80 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:20.648607 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a72a1-80a6-42d9-a35e-1d9f47af0b80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:20.649454 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5a72a1-80a6-42d9-a35e-1d9f47af0b80 None admin] RBAC: Adding query filter params (role.id=404d2ea20e7c4842892e5001133f1b93, scope.project.id=fe60851080e24e0db8e6af2ad2a17a54, user.id=48a53eb8f1874e4c8976945519c1a59a) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:20.649838 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5a72a1-80a6-42d9-a35e-1d9f47af0b80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:20.651848 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5a72a1-80a6-42d9-a35e-1d9f47af0b80 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:20.660655 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 139/273] 10.222.0.62 () {56 vars in 1374 bytes} [Fri May 27 16:08:20 2022] GET /identity/v3/role_assignments?user.id=48a53eb8f1874e4c8976945519c1a59a&scope.project.id=fe60851080e24e0db8e6af2ad2a17a54&role.id=404d2ea20e7c4842892e5001133f1b93 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:20.675092 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a72a1-80a6-42d9-a35e-1d9f47af0b80 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:20.716415 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:20.762567 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371f2b9f-08e3-4ac7-8c13-02a61bdf6ac5 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:20.810964 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e305b-c2fe-4daf-9bd2-697c46b8fbf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:20.811626 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:20.811802 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e305b-c2fe-4daf-9bd2-697c46b8fbf3 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:20.812067 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e305b-c2fe-4daf-9bd2-697c46b8fbf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:20.812348 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e305b-c2fe-4daf-9bd2-697c46b8fbf3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:20.839962 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a72a1-80a6-42d9-a35e-1d9f47af0b80 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:20.841504 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67e305b-c2fe-4daf-9bd2-697c46b8fbf3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:08:20.849354 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-c67e305b-c2fe-4daf-9bd2-697c46b8fbf3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 16:08:20.849354 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:08:20.849354 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:08:20.849354 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:08:20.849354 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:08:20.849354 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:08:20.849354 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:08:20.849354 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:08:20.849354 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:08:20.849354 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:08:20.849354 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:08:20.849354 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:08:20.849354 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:08:20.849354 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:08:20.849354 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:08:20.849354 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:08:20.850288 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:08:20.850288 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:08:20.850288 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:08:20.850288 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:08:20.850288 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:08:20.850288 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:08:20.850288 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:08:20.850288 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:08:20.850288 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:08:20.850288 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:08:20.850288 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:08:20.850288 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:08:20.850288 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:08:20.850288 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:08:20.850288 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:08:20.850288 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:08:20.851131 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:08:20.851131 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:08:20.851131 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:08:20.851131 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:08:20.851131 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:08:20.851131 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:08:20.851131 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:08:20.851131 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:08:20.851131 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:08:20.851131 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:08:20.851131 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 16:08:20.851131 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:08:20.854783 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 135/274] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 16:08:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:08:20.862938 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e305b-c2fe-4daf-9bd2-697c46b8fbf3 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:20.908494 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada1e209-e636-454e-b5f2-03fa49040fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:20.909940 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada1e209-e636-454e-b5f2-03fa49040fc0 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:20.910237 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada1e209-e636-454e-b5f2-03fa49040fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:20.910652 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada1e209-e636-454e-b5f2-03fa49040fc0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:20.912556 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada1e209-e636-454e-b5f2-03fa49040fc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:20.914567 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada1e209-e636-454e-b5f2-03fa49040fc0 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:20.919116 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 140/275] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:08:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:08:20.924115 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada1e209-e636-454e-b5f2-03fa49040fc0 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:21.010077 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e305b-c2fe-4daf-9bd2-697c46b8fbf3 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:21.028510 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:21.050678 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada1e209-e636-454e-b5f2-03fa49040fc0 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:21.055160 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f85659-4f38-42ee-9f96-cbccc6e600f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:21.055847 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f85659-4f38-42ee-9f96-cbccc6e600f7 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:21.056669 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f85659-4f38-42ee-9f96-cbccc6e600f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:21.056950 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f85659-4f38-42ee-9f96-cbccc6e600f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:21.057709 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f85659-4f38-42ee-9f96-cbccc6e600f7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:21.058022 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f85659-4f38-42ee-9f96-cbccc6e600f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:21.059991 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f85659-4f38-42ee-9f96-cbccc6e600f7 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:21.074029 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 136/276] 10.222.0.62 () {56 vars in 1101 bytes} [Fri May 27 16:08:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:08:21.079078 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f85659-4f38-42ee-9f96-cbccc6e600f7 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:21.096680 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b312b2d-1ff4-422d-964f-81c20543fd15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:21.097126 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b312b2d-1ff4-422d-964f-81c20543fd15 None admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:21.097483 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b312b2d-1ff4-422d-964f-81c20543fd15 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:21.098214 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b312b2d-1ff4-422d-964f-81c20543fd15 None admin] PATH_INFO: `/v3/users` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:21.099069 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b312b2d-1ff4-422d-964f-81c20543fd15 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:21.100696 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b312b2d-1ff4-422d-964f-81c20543fd15 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:21.115680 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:21.185384 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 141/277] 10.222.0.62 () {60 vars in 1132 bytes} [Fri May 27 16:08:20 2022] POST /identity/v3/users => generated 293 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:08:21.186621 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72469a-601f-4552-b6dc-2bbce85f83f4 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:21.186913 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72469a-601f-4552-b6dc-2bbce85f83f4 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:21.187189 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72469a-601f-4552-b6dc-2bbce85f83f4 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:21.188649 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 142/278] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:08:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:08:21.201374 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b55647-4284-46bb-b4d5-bc6327df5662 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:21.203361 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b55647-4284-46bb-b4d5-bc6327df5662 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:21.203740 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b55647-4284-46bb-b4d5-bc6327df5662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:21.216652 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f85659-4f38-42ee-9f96-cbccc6e600f7 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:21.225168 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-63b55647-4284-46bb-b4d5-bc6327df5662 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:08:21.226530 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-63b55647-4284-46bb-b4d5-bc6327df5662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:08:21.257235 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac6335-ac65-48ec-af82-73ebf8c237f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:21.258509 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac6335-ac65-48ec-af82-73ebf8c237f3 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:21.258969 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac6335-ac65-48ec-af82-73ebf8c237f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:21.259522 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac6335-ac65-48ec-af82-73ebf8c237f3 None admin] PATH_INFO: `/v3/users/dbe0a0395c90479bba2e493e01a7e625` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:21.275881 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dac6335-ac65-48ec-af82-73ebf8c237f3 None admin] RBAC: Authorizing `identity:get_user(user_id=dbe0a0395c90479bba2e493e01a7e625)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:21.277661 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dac6335-ac65-48ec-af82-73ebf8c237f3 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:21.280059 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 137/279] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 16:08:21 2022] GET /identity/v3/users/dbe0a0395c90479bba2e493e01a7e625 => generated 293 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:08:21.288772 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac6335-ac65-48ec-af82-73ebf8c237f3 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:21.308767 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 143/280] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:08:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:08:21.325287 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:21.331154 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b55647-4284-46bb-b4d5-bc6327df5662 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:21.402894 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac6335-ac65-48ec-af82-73ebf8c237f3 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:21.441607 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19839a09-8206-43b2-9b76-9994d0892092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:21.442336 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19839a09-8206-43b2-9b76-9994d0892092 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:21.442627 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19839a09-8206-43b2-9b76-9994d0892092 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:21.442907 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19839a09-8206-43b2-9b76-9994d0892092 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:21.443747 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19839a09-8206-43b2-9b76-9994d0892092 None admin] RBAC: Adding query filter params (role.id=c8ce6d197f654598ac45f6016ecccabd, user.id=dbe0a0395c90479bba2e493e01a7e625, scope.system=all) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:21.444065 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19839a09-8206-43b2-9b76-9994d0892092 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:21.446569 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19839a09-8206-43b2-9b76-9994d0892092 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:21.451208 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 138/281] 10.222.0.62 () {56 vars in 1308 bytes} [Fri May 27 16:08:21 2022] GET /identity/v3/role_assignments?user.id=dbe0a0395c90479bba2e493e01a7e625&scope.system=all&role.id=c8ce6d197f654598ac45f6016ecccabd => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:21.452371 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b55647-4284-46bb-b4d5-bc6327df5662 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:21.484510 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:21.498878 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9c2865-ae19-4692-bcc0-ee361653590f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:21.499696 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c2865-ae19-4692-bcc0-ee361653590f None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:21.499985 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c2865-ae19-4692-bcc0-ee361653590f None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:21.500265 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c2865-ae19-4692-bcc0-ee361653590f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:21.512465 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9c2865-ae19-4692-bcc0-ee361653590f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:08:21.520569 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-8c9c2865-ae19-4692-bcc0-ee361653590f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 16:08:21.520569 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:08:21.520569 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:08:21.520569 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:08:21.520569 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:08:21.520569 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:08:21.520569 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:08:21.520569 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:08:21.520569 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:08:21.520569 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:08:21.520569 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:08:21.520569 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:08:21.520569 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:08:21.520569 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:08:21.520569 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:08:21.520569 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:08:21.521666 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:08:21.521666 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:08:21.521666 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:08:21.521666 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:08:21.521666 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:08:21.521666 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:08:21.521666 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:08:21.521666 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:08:21.521666 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:08:21.521666 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:08:21.521666 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:08:21.521666 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:08:21.521666 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:08:21.521666 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:08:21.521666 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:08:21.521666 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:08:21.522694 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:08:21.522694 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:08:21.522694 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:08:21.522694 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:08:21.522694 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:08:21.522694 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:08:21.522694 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:08:21.522694 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:08:21.522694 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:08:21.522694 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:08:21.522694 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 16:08:21.522694 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:08:21.522694 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 144/282] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 16:08:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:08:21.528535 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19839a09-8206-43b2-9b76-9994d0892092 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:21.648790 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:21.652932 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19839a09-8206-43b2-9b76-9994d0892092 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:21.688060 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a919e26b-0942-434d-8c8e-010b9b310bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:21.688754 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919e26b-0942-434d-8c8e-010b9b310bdb None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:21.689525 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919e26b-0942-434d-8c8e-010b9b310bdb None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:21.689804 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919e26b-0942-434d-8c8e-010b9b310bdb None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:21.690588 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a919e26b-0942-434d-8c8e-010b9b310bdb None admin] RBAC: Adding query filter params (name=reader) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:21.690901 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a919e26b-0942-434d-8c8e-010b9b310bdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:21.692339 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a919e26b-0942-434d-8c8e-010b9b310bdb None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:21.701391 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 139/283] 10.222.0.62 () {56 vars in 1101 bytes} [Fri May 27 16:08:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:21.707162 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9c2865-ae19-4692-bcc0-ee361653590f None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:21.822649 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9c2865-ae19-4692-bcc0-ee361653590f None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:21.890989 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d033c9-6a87-450b-ace6-f34ab6fc9200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:21.891898 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d033c9-6a87-450b-ace6-f34ab6fc9200 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:21.892187 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d033c9-6a87-450b-ace6-f34ab6fc9200 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:21.892463 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d033c9-6a87-450b-ace6-f34ab6fc9200 None admin] PATH_INFO: `/v3/users/5f85e1daa5744ef68e90bc3b81a00ec0` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:21.893814 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d033c9-6a87-450b-ace6-f34ab6fc9200 None admin] RBAC: Authorizing `identity:get_user(user_id=5f85e1daa5744ef68e90bc3b81a00ec0)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:21.895385 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d033c9-6a87-450b-ace6-f34ab6fc9200 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:21.897209 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 145/284] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 16:08:21 2022] GET /identity/v3/users/5f85e1daa5744ef68e90bc3b81a00ec0 => generated 297 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:21.902547 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a919e26b-0942-434d-8c8e-010b9b310bdb None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:22.021634 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a919e26b-0942-434d-8c8e-010b9b310bdb None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:22.056509 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb3893-3479-4625-af55-2bc5dc79f8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:22.057385 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb3893-3479-4625-af55-2bc5dc79f8c5 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:22.057670 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb3893-3479-4625-af55-2bc5dc79f8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:22.057947 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb3893-3479-4625-af55-2bc5dc79f8c5 None admin] PATH_INFO: `/v3/projects/fe60851080e24e0db8e6af2ad2a17a54` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:22.059180 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcb3893-3479-4625-af55-2bc5dc79f8c5 None admin] RBAC: Authorizing `identity:get_project(project_id=fe60851080e24e0db8e6af2ad2a17a54)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:22.060645 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcb3893-3479-4625-af55-2bc5dc79f8c5 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:22.062497 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 140/285] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 16:08:21 2022] GET /identity/v3/projects/fe60851080e24e0db8e6af2ad2a17a54 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:22.068102 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d033c9-6a87-450b-ace6-f34ab6fc9200 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:22.122687 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:22.171931 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d033c9-6a87-450b-ace6-f34ab6fc9200 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:22.223183 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4388ea03-e7c0-445c-9c4a-8c67b9d4bae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:22.224091 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388ea03-e7c0-445c-9c4a-8c67b9d4bae0 None admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:22.224378 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388ea03-e7c0-445c-9c4a-8c67b9d4bae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:22.224660 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388ea03-e7c0-445c-9c4a-8c67b9d4bae0 None admin] PATH_INFO: `/v3/projects/fe60851080e24e0db8e6af2ad2a17a54/users/5f85e1daa5744ef68e90bc3b81a00ec0/roles/6d3bcbc332ec4ad4b4910a6a9fc398ae` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:22.229154 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4388ea03-e7c0-445c-9c4a-8c67b9d4bae0 None admin] RBAC: Authorizing `identity:create_grant(project_id=fe60851080e24e0db8e6af2ad2a17a54, user_id=5f85e1daa5744ef68e90bc3b81a00ec0, role_id=6d3bcbc332ec4ad4b4910a6a9fc398ae)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:22.230713 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4388ea03-e7c0-445c-9c4a-8c67b9d4bae0 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:22.312146 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 146/286] 10.222.0.62 () {58 vars in 1439 bytes} [Fri May 27 16:08:22 2022] PUT /identity/v3/projects/fe60851080e24e0db8e6af2ad2a17a54/users/5f85e1daa5744ef68e90bc3b81a00ec0/roles/6d3bcbc332ec4ad4b4910a6a9fc398ae => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:08:22.486952 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ade63-a30f-4a22-b656-e7e7f262a581 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:22.487362 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ade63-a30f-4a22-b656-e7e7f262a581 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:22.487565 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ade63-a30f-4a22-b656-e7e7f262a581 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:22.489254 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 141/287] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:08:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:08:22.495371 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d767e-ad52-46e2-9fbd-962a268ee51e None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:22.495973 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d767e-ad52-46e2-9fbd-962a268ee51e None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:22.495973 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d767e-ad52-46e2-9fbd-962a268ee51e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:22.519314 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-d87d767e-ad52-46e2-9fbd-962a268ee51e None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:08:22.520551 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-d87d767e-ad52-46e2-9fbd-962a268ee51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:08:22.608265 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 147/288] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:08:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:08:22.635335 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933ade63-a30f-4a22-b656-e7e7f262a581 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:22.671576 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:22.768681 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933ade63-a30f-4a22-b656-e7e7f262a581 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:22.808292 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae63ade-b620-4056-8ea6-bb479a770fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:22.809108 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae63ade-b620-4056-8ea6-bb479a770fbc None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:22.809391 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae63ade-b620-4056-8ea6-bb479a770fbc None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:22.809671 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae63ade-b620-4056-8ea6-bb479a770fbc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:22.820063 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae63ade-b620-4056-8ea6-bb479a770fbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:08:22.827910 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-8ae63ade-b620-4056-8ea6-bb479a770fbc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 16:08:22.827910 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:08:22.827910 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:08:22.827910 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:08:22.827910 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:08:22.827910 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:08:22.827910 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:08:22.827910 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:08:22.827910 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:08:22.827910 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:08:22.827910 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:08:22.827910 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:08:22.827910 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:08:22.827910 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:08:22.827910 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:08:22.827910 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:08:22.828779 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:08:22.828779 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:08:22.828779 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:08:22.828779 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:08:22.828779 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:08:22.828779 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:08:22.828779 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:08:22.828779 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:08:22.828779 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:08:22.828779 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:08:22.828779 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:08:22.828779 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:08:22.828779 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:08:22.828779 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:08:22.828779 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:08:22.828779 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:08:22.829665 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:08:22.829665 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:08:22.829665 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:08:22.829665 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:08:22.829665 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:08:22.829665 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:08:22.829665 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:08:22.829665 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:08:22.829665 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:08:22.829665 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:08:22.829665 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 16:08:22.829665 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:08:22.829665 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 142/289] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 16:08:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:08:22.835024 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87d767e-ad52-46e2-9fbd-962a268ee51e None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:22.922443 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:23.006556 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87d767e-ad52-46e2-9fbd-962a268ee51e None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:23.057912 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dcb8f1-64af-4656-9123-10ace85a35a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:23.058956 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dcb8f1-64af-4656-9123-10ace85a35a6 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:23.059445 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dcb8f1-64af-4656-9123-10ace85a35a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:23.059947 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dcb8f1-64af-4656-9123-10ace85a35a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:23.060902 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dcb8f1-64af-4656-9123-10ace85a35a6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:23.061410 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dcb8f1-64af-4656-9123-10ace85a35a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:23.063005 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dcb8f1-64af-4656-9123-10ace85a35a6 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:23.078098 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 148/290] 10.222.0.62 () {56 vars in 1101 bytes} [Fri May 27 16:08:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:23.083404 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae63ade-b620-4056-8ea6-bb479a770fbc None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:23.235648 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae63ade-b620-4056-8ea6-bb479a770fbc None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:23.238546 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:23.279538 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542cc9e4-b712-414b-952b-861d65319a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:23.280424 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542cc9e4-b712-414b-952b-861d65319a76 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:23.280710 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542cc9e4-b712-414b-952b-861d65319a76 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:23.280987 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542cc9e4-b712-414b-952b-861d65319a76 None admin] PATH_INFO: `/v3/users/076e982a905245c8936850f1d0b51687` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:23.286642 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542cc9e4-b712-414b-952b-861d65319a76 None admin] RBAC: Authorizing `identity:get_user(user_id=076e982a905245c8936850f1d0b51687)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:23.288161 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542cc9e4-b712-414b-952b-861d65319a76 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:23.289800 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 143/291] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 16:08:23 2022] GET /identity/v3/users/076e982a905245c8936850f1d0b51687 => generated 297 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:23.296050 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dcb8f1-64af-4656-9123-10ace85a35a6 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:23.445684 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dcb8f1-64af-4656-9123-10ace85a35a6 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:23.451172 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:23.497568 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764c0019-a75e-41c1-9200-c1cb566c6dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:23.499059 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c0019-a75e-41c1-9200-c1cb566c6dcf None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:23.500508 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c0019-a75e-41c1-9200-c1cb566c6dcf None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:23.501013 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c0019-a75e-41c1-9200-c1cb566c6dcf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:23.578654 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764c0019-a75e-41c1-9200-c1cb566c6dcf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:23.580483 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764c0019-a75e-41c1-9200-c1cb566c6dcf None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:23.686007 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 149/292] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 16:08:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 16:08:23.691347 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542cc9e4-b712-414b-952b-861d65319a76 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:23.845845 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542cc9e4-b712-414b-952b-861d65319a76 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:23.897776 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe2e2f3-c96b-4379-8327-37bbe58a37ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:23.898684 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe2e2f3-c96b-4379-8327-37bbe58a37ef None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:23.898968 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe2e2f3-c96b-4379-8327-37bbe58a37ef None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:23.899252 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe2e2f3-c96b-4379-8327-37bbe58a37ef None admin] PATH_INFO: `/v3/projects/fe60851080e24e0db8e6af2ad2a17a54` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:23.902977 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe2e2f3-c96b-4379-8327-37bbe58a37ef None admin] RBAC: Authorizing `identity:get_project(project_id=fe60851080e24e0db8e6af2ad2a17a54)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:23.904459 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe2e2f3-c96b-4379-8327-37bbe58a37ef None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:23.906358 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 144/293] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 16:08:23 2022] GET /identity/v3/projects/fe60851080e24e0db8e6af2ad2a17a54 => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:23.912106 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764c0019-a75e-41c1-9200-c1cb566c6dcf None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:23.915848 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:24.028178 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a08deb-97ae-45a9-ae00-06c8a5d816ef None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:24.029158 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a08deb-97ae-45a9-ae00-06c8a5d816ef None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:24.030020 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a08deb-97ae-45a9-ae00-06c8a5d816ef None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:24.032421 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 145/294] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:08:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 16:08:24.038377 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad86904-4cf6-4b62-8eba-bcf6b7da4d00 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:24.038970 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad86904-4cf6-4b62-8eba-bcf6b7da4d00 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:24.039475 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad86904-4cf6-4b62-8eba-bcf6b7da4d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:24.039579 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764c0019-a75e-41c1-9200-c1cb566c6dcf None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:24.074549 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-8ad86904-4cf6-4b62-8eba-bcf6b7da4d00 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:08:24.075887 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-8ad86904-4cf6-4b62-8eba-bcf6b7da4d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:08:24.106435 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c691b3-8cd6-4d85-aae1-189e731a8e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:24.107476 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c691b3-8cd6-4d85-aae1-189e731a8e6b None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:24.107945 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c691b3-8cd6-4d85-aae1-189e731a8e6b None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:24.108642 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c691b3-8cd6-4d85-aae1-189e731a8e6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:24.110240 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c691b3-8cd6-4d85-aae1-189e731a8e6b None admin] RBAC: Adding query filter params (role.id=c8ce6d197f654598ac45f6016ecccabd, scope.project.id=fe60851080e24e0db8e6af2ad2a17a54, user.id=076e982a905245c8936850f1d0b51687) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:24.110822 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c691b3-8cd6-4d85-aae1-189e731a8e6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:24.112631 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c691b3-8cd6-4d85-aae1-189e731a8e6b None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:24.116074 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:24.129353 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 150/295] 10.222.0.62 () {56 vars in 1374 bytes} [Fri May 27 16:08:23 2022] GET /identity/v3/role_assignments?user.id=076e982a905245c8936850f1d0b51687&scope.project.id=fe60851080e24e0db8e6af2ad2a17a54&role.id=c8ce6d197f654598ac45f6016ecccabd => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:24.197404 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 146/296] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:08:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:08:24.245108 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c691b3-8cd6-4d85-aae1-189e731a8e6b None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:24.330845 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:24.351225 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b8a548-5745-4e49-ba10-b723389ba4a1 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:24.351513 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b8a548-5745-4e49-ba10-b723389ba4a1 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:24.351963 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b8a548-5745-4e49-ba10-b723389ba4a1 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:24.358928 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 147/297] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:08:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:08:24.360812 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd162d7-1fab-49a0-b08d-e62df5f2f8e9 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:24.361244 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd162d7-1fab-49a0-b08d-e62df5f2f8e9 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:24.361662 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd162d7-1fab-49a0-b08d-e62df5f2f8e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:24.392115 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c691b3-8cd6-4d85-aae1-189e731a8e6b None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:24.405560 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-cbd162d7-1fab-49a0-b08d-e62df5f2f8e9 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:08:24.406998 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-cbd162d7-1fab-49a0-b08d-e62df5f2f8e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:08:24.474803 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85da4156-3a0d-4d9f-a48e-56366d679835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:24.475909 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da4156-3a0d-4d9f-a48e-56366d679835 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:24.476511 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da4156-3a0d-4d9f-a48e-56366d679835 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:24.476965 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da4156-3a0d-4d9f-a48e-56366d679835 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:24.499238 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85da4156-3a0d-4d9f-a48e-56366d679835 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:08:24.510671 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-85da4156-3a0d-4d9f-a48e-56366d679835 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 16:08:24.510671 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:08:24.510671 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:08:24.510671 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:08:24.510671 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:08:24.510671 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:08:24.510671 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:08:24.510671 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:08:24.510671 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:08:24.510671 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:08:24.510671 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:08:24.510671 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:08:24.510671 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:08:24.510671 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:08:24.510671 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:08:24.510671 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:08:24.511600 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:08:24.511600 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:08:24.511600 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:08:24.511600 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:08:24.511600 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:08:24.511600 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:08:24.511600 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:08:24.511600 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:08:24.511600 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:08:24.511600 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:08:24.511600 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:08:24.511600 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:08:24.511600 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:08:24.511600 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:08:24.511600 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:08:24.511600 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:08:24.512394 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:08:24.512394 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:08:24.512394 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:08:24.512394 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:08:24.512394 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:08:24.512394 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:08:24.512394 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:08:24.512394 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:08:24.512394 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:08:24.512394 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:08:24.512394 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 16:08:24.512394 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:08:24.515767 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 151/298] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 16:08:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:08:24.521609 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85da4156-3a0d-4d9f-a48e-56366d679835 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:24.523778 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 148/299] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:08:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 16:08:24.525267 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca54848-7e77-4357-9ef1-3eba2d6f3e3d None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:24.525636 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca54848-7e77-4357-9ef1-3eba2d6f3e3d None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:24.526223 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca54848-7e77-4357-9ef1-3eba2d6f3e3d None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:24.528773 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 149/300] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:08:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:08:24.535986 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2bf27-65e7-4b59-ba82-abf3ee631d7a None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:24.536462 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2bf27-65e7-4b59-ba82-abf3ee631d7a None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:24.536905 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2bf27-65e7-4b59-ba82-abf3ee631d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:24.563806 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-5ee2bf27-65e7-4b59-ba82-abf3ee631d7a None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:08:24.565742 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-5ee2bf27-65e7-4b59-ba82-abf3ee631d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:08:24.643026 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85da4156-3a0d-4d9f-a48e-56366d679835 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:24.646291 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 150/301] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:08:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:08:24.646291 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2bf27-65e7-4b59-ba82-abf3ee631d7a None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:24.667078 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:24.680385 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:24.688528 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9acb4c-6ee5-4ce8-bb26-a5e641061892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:24.689203 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9acb4c-6ee5-4ce8-bb26-a5e641061892 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:24.689492 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9acb4c-6ee5-4ce8-bb26-a5e641061892 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:24.689777 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9acb4c-6ee5-4ce8-bb26-a5e641061892 None admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:24.690569 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9acb4c-6ee5-4ce8-bb26-a5e641061892 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:24.690883 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9acb4c-6ee5-4ce8-bb26-a5e641061892 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:24.692336 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9acb4c-6ee5-4ce8-bb26-a5e641061892 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:24.702363 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 152/302] 10.222.0.62 () {56 vars in 1101 bytes} [Fri May 27 16:08:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:08:24.703196 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9acb4c-6ee5-4ce8-bb26-a5e641061892 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:24.767395 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2bf27-65e7-4b59-ba82-abf3ee631d7a None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:24.812195 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f646ac93-5061-440f-9184-79e0f943d999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:24.812992 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646ac93-5061-440f-9184-79e0f943d999 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:24.813274 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646ac93-5061-440f-9184-79e0f943d999 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:24.813543 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646ac93-5061-440f-9184-79e0f943d999 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:24.814891 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f646ac93-5061-440f-9184-79e0f943d999 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:24.816343 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f646ac93-5061-440f-9184-79e0f943d999 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:24.816475 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9acb4c-6ee5-4ce8-bb26-a5e641061892 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:24.818212 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 151/303] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:08:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:24.819018 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f646ac93-5061-440f-9184-79e0f943d999 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:24.862027 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c242e6a1-fed5-4e52-ba9c-c678049b19fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:24.862870 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242e6a1-fed5-4e52-ba9c-c678049b19fc None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:24.863212 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242e6a1-fed5-4e52-ba9c-c678049b19fc None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:24.863492 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242e6a1-fed5-4e52-ba9c-c678049b19fc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:24.875418 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c242e6a1-fed5-4e52-ba9c-c678049b19fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:08:24.883103 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-c242e6a1-fed5-4e52-ba9c-c678049b19fc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 16:08:24.883103 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:08:24.883103 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:08:24.883103 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:08:24.883103 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:08:24.883103 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:08:24.883103 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:08:24.883103 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:08:24.883103 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:08:24.883103 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:08:24.883103 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:08:24.883103 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:08:24.883103 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:08:24.883103 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:08:24.883103 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:08:24.883103 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:08:24.884048 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:08:24.884048 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:08:24.884048 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:08:24.884048 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:08:24.884048 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:08:24.884048 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:08:24.884048 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:08:24.884048 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:08:24.884048 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:08:24.884048 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:08:24.884048 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:08:24.884048 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:08:24.884048 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:08:24.884048 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:08:24.884048 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:08:24.884048 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:08:24.884844 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:08:24.884844 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:08:24.884844 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:08:24.884844 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:08:24.884844 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:08:24.884844 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:08:24.884844 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:08:24.884844 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:08:24.884844 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:08:24.884844 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:08:24.884844 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 16:08:24.884844 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:08:24.884844 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 153/304] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 16:08:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:08:24.885714 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c242e6a1-fed5-4e52-ba9c-c678049b19fc None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:24.919260 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:24.941762 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f646ac93-5061-440f-9184-79e0f943d999 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:24.942925 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:24.980649 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d911a947-20e8-44f1-b82e-dd1abf7ddd14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:24.981827 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d911a947-20e8-44f1-b82e-dd1abf7ddd14 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:24.982323 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d911a947-20e8-44f1-b82e-dd1abf7ddd14 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:24.982770 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d911a947-20e8-44f1-b82e-dd1abf7ddd14 None admin] PATH_INFO: `/v3/users/5c53fb83d0fb4884bc83bea72f822bf1` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:24.996398 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c242e6a1-fed5-4e52-ba9c-c678049b19fc None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:24.996989 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d911a947-20e8-44f1-b82e-dd1abf7ddd14 None admin] RBAC: Authorizing `identity:get_user(user_id=5c53fb83d0fb4884bc83bea72f822bf1)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:24.998485 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d911a947-20e8-44f1-b82e-dd1abf7ddd14 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:25.000366 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 152/305] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 16:08:24 2022] GET /identity/v3/users/5c53fb83d0fb4884bc83bea72f822bf1 => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:25.003211 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d911a947-20e8-44f1-b82e-dd1abf7ddd14 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:25.032418 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf00504a-2316-4d40-b231-a135c18f62ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:25.033092 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf00504a-2316-4d40-b231-a135c18f62ca None admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:25.033367 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf00504a-2316-4d40-b231-a135c18f62ca None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:25.033798 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf00504a-2316-4d40-b231-a135c18f62ca None admin] PATH_INFO: `/v3/groups` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:25.034520 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf00504a-2316-4d40-b231-a135c18f62ca None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:25.035955 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf00504a-2316-4d40-b231-a135c18f62ca None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:25.103119 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 154/306] 10.222.0.62 () {60 vars in 1134 bytes} [Fri May 27 16:08:24 2022] POST /identity/v3/groups => generated 229 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:08:25.111630 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf00504a-2316-4d40-b231-a135c18f62ca None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:25.123627 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d911a947-20e8-44f1-b82e-dd1abf7ddd14 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:25.167005 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c20bcdd-e623-4f39-9ffa-29b5ebb13eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:25.167698 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c20bcdd-e623-4f39-9ffa-29b5ebb13eae None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:25.168018 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c20bcdd-e623-4f39-9ffa-29b5ebb13eae None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:25.168285 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c20bcdd-e623-4f39-9ffa-29b5ebb13eae None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:25.169062 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c20bcdd-e623-4f39-9ffa-29b5ebb13eae None admin] RBAC: Adding query filter params (name=member) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:25.169430 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c20bcdd-e623-4f39-9ffa-29b5ebb13eae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:25.170868 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c20bcdd-e623-4f39-9ffa-29b5ebb13eae None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:25.181983 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 153/307] 10.222.0.62 () {56 vars in 1101 bytes} [Fri May 27 16:08:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:25.183579 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb457faa-8bc6-4a1f-8a27-757925033732 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:25.183876 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb457faa-8bc6-4a1f-8a27-757925033732 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:25.184154 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb457faa-8bc6-4a1f-8a27-757925033732 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:25.186300 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 154/308] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:08:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:08:25.187591 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb457faa-8bc6-4a1f-8a27-757925033732 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:25.191549 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:25.242891 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf00504a-2316-4d40-b231-a135c18f62ca None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:25.255460 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:25.282068 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528eaee5-6067-4ae8-b683-49878f490a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:25.282783 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528eaee5-6067-4ae8-b683-49878f490a2e None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:25.283072 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528eaee5-6067-4ae8-b683-49878f490a2e None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:25.283352 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528eaee5-6067-4ae8-b683-49878f490a2e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:25.284199 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528eaee5-6067-4ae8-b683-49878f490a2e None admin] RBAC: Adding query filter params (role.id=6d3bcbc332ec4ad4b4910a6a9fc398ae, user.id=5c53fb83d0fb4884bc83bea72f822bf1, scope.system=all) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:25.284515 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528eaee5-6067-4ae8-b683-49878f490a2e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:25.285956 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528eaee5-6067-4ae8-b683-49878f490a2e None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:25.293750 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 155/309] 10.222.0.62 () {56 vars in 1308 bytes} [Fri May 27 16:08:25 2022] GET /identity/v3/role_assignments?user.id=5c53fb83d0fb4884bc83bea72f822bf1&scope.system=all&role.id=6d3bcbc332ec4ad4b4910a6a9fc398ae => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:25.295179 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99399186-b4d8-4f51-be56-90d170af59ab None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:25.295489 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99399186-b4d8-4f51-be56-90d170af59ab None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:25.295771 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99399186-b4d8-4f51-be56-90d170af59ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:25.312665 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb457faa-8bc6-4a1f-8a27-757925033732 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:25.314708 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-99399186-b4d8-4f51-be56-90d170af59ab None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:08:25.316287 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-99399186-b4d8-4f51-be56-90d170af59ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:08:25.360327 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e0a5dc-691b-4cc8-b762-9ab971c09b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:25.362167 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0a5dc-691b-4cc8-b762-9ab971c09b87 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:25.362851 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0a5dc-691b-4cc8-b762-9ab971c09b87 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:25.363129 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0a5dc-691b-4cc8-b762-9ab971c09b87 None admin] PATH_INFO: `/v3/users/dbe0a0395c90479bba2e493e01a7e625` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:25.364618 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e0a5dc-691b-4cc8-b762-9ab971c09b87 None admin] RBAC: Authorizing `identity:get_user(user_id=dbe0a0395c90479bba2e493e01a7e625)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:25.366147 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e0a5dc-691b-4cc8-b762-9ab971c09b87 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:25.367941 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 155/310] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 16:08:25 2022] GET /identity/v3/users/dbe0a0395c90479bba2e493e01a7e625 => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:25.374044 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e0a5dc-691b-4cc8-b762-9ab971c09b87 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:25.419897 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 156/311] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:08:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:08:25.441861 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99399186-b4d8-4f51-be56-90d170af59ab None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:25.464132 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:25.500905 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e0a5dc-691b-4cc8-b762-9ab971c09b87 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:25.536511 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b198579e-e039-479b-8858-140c34b6c9b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:25.537644 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b198579e-e039-479b-8858-140c34b6c9b9 None admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:25.537934 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b198579e-e039-479b-8858-140c34b6c9b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:25.538215 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b198579e-e039-479b-8858-140c34b6c9b9 None admin] PATH_INFO: `/v3/system/users/dbe0a0395c90479bba2e493e01a7e625/roles/c8ce6d197f654598ac45f6016ecccabd` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:25.539756 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b198579e-e039-479b-8858-140c34b6c9b9 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=dbe0a0395c90479bba2e493e01a7e625, role_id=c8ce6d197f654598ac45f6016ecccabd)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:25.541191 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b198579e-e039-479b-8858-140c34b6c9b9 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:25.559953 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99399186-b4d8-4f51-be56-90d170af59ab None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:25.563184 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:25.594923 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef86fa89-5c67-4081-8e35-9418d61a8e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:25.595714 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86fa89-5c67-4081-8e35-9418d61a8e8e None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:25.595998 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86fa89-5c67-4081-8e35-9418d61a8e8e None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:25.596274 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86fa89-5c67-4081-8e35-9418d61a8e8e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:25.607032 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef86fa89-5c67-4081-8e35-9418d61a8e8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:08:25.614833 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-ef86fa89-5c67-4081-8e35-9418d61a8e8e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 16:08:25.614833 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:08:25.614833 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:08:25.614833 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:08:25.614833 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:08:25.614833 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:08:25.614833 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:08:25.614833 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:08:25.614833 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:08:25.614833 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:08:25.614833 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:08:25.614833 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:08:25.614833 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:08:25.614833 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:08:25.614833 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:08:25.614833 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:08:25.615736 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:08:25.615736 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:08:25.615736 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:08:25.615736 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:08:25.615736 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:08:25.615736 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:08:25.615736 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:08:25.615736 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:08:25.615736 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:08:25.615736 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:08:25.615736 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:08:25.615736 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:08:25.615736 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:08:25.615736 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:08:25.615736 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:08:25.615736 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:08:25.616573 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:08:25.616573 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:08:25.616573 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:08:25.616573 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:08:25.616573 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:08:25.616573 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:08:25.616573 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:08:25.616573 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:08:25.616573 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:08:25.616573 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:08:25.616573 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 16:08:25.616573 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:08:25.616573 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 157/312] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 16:08:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:08:25.622469 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef86fa89-5c67-4081-8e35-9418d61a8e8e None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:25.636747 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 156/313] 10.222.0.62 () {58 vars in 1334 bytes} [Fri May 27 16:08:25 2022] PUT /identity/v3/system/users/dbe0a0395c90479bba2e493e01a7e625/roles/c8ce6d197f654598ac45f6016ecccabd => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:08:25.744049 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef86fa89-5c67-4081-8e35-9418d61a8e8e None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:25.787537 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d598c8e-d0d7-4b67-b1f0-ed130556d839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:25.788592 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d598c8e-d0d7-4b67-b1f0-ed130556d839 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:25.789109 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d598c8e-d0d7-4b67-b1f0-ed130556d839 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:25.789644 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d598c8e-d0d7-4b67-b1f0-ed130556d839 None admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:25.790748 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d598c8e-d0d7-4b67-b1f0-ed130556d839 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:25.791277 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d598c8e-d0d7-4b67-b1f0-ed130556d839 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:25.792911 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d598c8e-d0d7-4b67-b1f0-ed130556d839 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:25.802840 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 158/314] 10.222.0.62 () {56 vars in 1101 bytes} [Fri May 27 16:08:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:25.809861 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b198579e-e039-479b-8858-140c34b6c9b9 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:25.943741 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b198579e-e039-479b-8858-140c34b6c9b9 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:25.998928 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f35c6f8-2449-4ba4-bdac-2fa5972d1761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:26.000936 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f35c6f8-2449-4ba4-bdac-2fa5972d1761 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:26.001693 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f35c6f8-2449-4ba4-bdac-2fa5972d1761 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:26.002479 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f35c6f8-2449-4ba4-bdac-2fa5972d1761 None admin] PATH_INFO: `/v3/users/5f85e1daa5744ef68e90bc3b81a00ec0` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:26.004784 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f35c6f8-2449-4ba4-bdac-2fa5972d1761 None admin] RBAC: Authorizing `identity:get_user(user_id=5f85e1daa5744ef68e90bc3b81a00ec0)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:26.007723 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f35c6f8-2449-4ba4-bdac-2fa5972d1761 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:26.011873 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 157/315] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 16:08:25 2022] GET /identity/v3/users/5f85e1daa5744ef68e90bc3b81a00ec0 => generated 297 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:26.019029 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d598c8e-d0d7-4b67-b1f0-ed130556d839 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:26.045332 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:26.117906 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d598c8e-d0d7-4b67-b1f0-ed130556d839 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:26.158934 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52808516-19ac-45d5-95c8-e11e08636a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:26.159834 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52808516-19ac-45d5-95c8-e11e08636a47 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:26.160291 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52808516-19ac-45d5-95c8-e11e08636a47 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:26.160712 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52808516-19ac-45d5-95c8-e11e08636a47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:26.293489 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52808516-19ac-45d5-95c8-e11e08636a47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:26.294914 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52808516-19ac-45d5-95c8-e11e08636a47 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:26.325606 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:26.403536 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 159/316] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 16:08:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 16:08:26.411345 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f35c6f8-2449-4ba4-bdac-2fa5972d1761 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:26.418541 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:26.532288 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f35c6f8-2449-4ba4-bdac-2fa5972d1761 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:26.571280 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cb3c48-a200-4dcf-8ed7-cc7dd3a5b542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:26.573043 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb3c48-a200-4dcf-8ed7-cc7dd3a5b542 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:26.573532 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb3c48-a200-4dcf-8ed7-cc7dd3a5b542 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:26.574076 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb3c48-a200-4dcf-8ed7-cc7dd3a5b542 None admin] PATH_INFO: `/v3/projects/fe60851080e24e0db8e6af2ad2a17a54` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:26.575509 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cb3c48-a200-4dcf-8ed7-cc7dd3a5b542 None admin] RBAC: Authorizing `identity:get_project(project_id=fe60851080e24e0db8e6af2ad2a17a54)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:26.577148 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cb3c48-a200-4dcf-8ed7-cc7dd3a5b542 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:26.579100 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 158/317] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 16:08:26 2022] GET /identity/v3/projects/fe60851080e24e0db8e6af2ad2a17a54 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:26.587474 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52808516-19ac-45d5-95c8-e11e08636a47 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:26.687124 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52808516-19ac-45d5-95c8-e11e08636a47 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:26.716037 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:26.724892 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07af7c34-3ead-471b-95f9-c2c081a3815e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:26.725554 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af7c34-3ead-471b-95f9-c2c081a3815e None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:26.725842 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af7c34-3ead-471b-95f9-c2c081a3815e None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:26.726120 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af7c34-3ead-471b-95f9-c2c081a3815e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:26.726992 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07af7c34-3ead-471b-95f9-c2c081a3815e None admin] RBAC: Adding query filter params (role.id=6d3bcbc332ec4ad4b4910a6a9fc398ae, scope.project.id=fe60851080e24e0db8e6af2ad2a17a54, user.id=5f85e1daa5744ef68e90bc3b81a00ec0) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:26.727365 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07af7c34-3ead-471b-95f9-c2c081a3815e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:26.728834 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07af7c34-3ead-471b-95f9-c2c081a3815e None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:26.735211 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 160/318] 10.222.0.62 () {56 vars in 1374 bytes} [Fri May 27 16:08:26 2022] GET /identity/v3/role_assignments?user.id=5f85e1daa5744ef68e90bc3b81a00ec0&scope.project.id=fe60851080e24e0db8e6af2ad2a17a54&role.id=6d3bcbc332ec4ad4b4910a6a9fc398ae => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:27.419718 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55927037-ae34-4dfc-879e-a4e6674ee7f1 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:27.420235 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55927037-ae34-4dfc-879e-a4e6674ee7f1 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:27.420310 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55927037-ae34-4dfc-879e-a4e6674ee7f1 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:27.421683 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 159/319] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:08:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:08:27.426873 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc06b10e-494d-4431-b802-154ce7398f82 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:27.427176 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc06b10e-494d-4431-b802-154ce7398f82 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:27.427458 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc06b10e-494d-4431-b802-154ce7398f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:27.444906 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-dc06b10e-494d-4431-b802-154ce7398f82 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:08:27.446091 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-dc06b10e-494d-4431-b802-154ce7398f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:08:27.533858 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 161/320] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:08:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:08:27.556691 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55927037-ae34-4dfc-879e-a4e6674ee7f1 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:27.628582 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:27.660866 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55927037-ae34-4dfc-879e-a4e6674ee7f1 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:27.694953 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc9af0b-1e27-458d-bf4f-ac556e23539f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:27.695733 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9af0b-1e27-458d-bf4f-ac556e23539f None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:27.696021 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9af0b-1e27-458d-bf4f-ac556e23539f None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:27.697203 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9af0b-1e27-458d-bf4f-ac556e23539f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:27.698443 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc9af0b-1e27-458d-bf4f-ac556e23539f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:27.698758 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478ef69-b0ac-4fa8-a446-a2762592da4e None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:27.699181 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478ef69-b0ac-4fa8-a446-a2762592da4e None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:27.699335 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478ef69-b0ac-4fa8-a446-a2762592da4e None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:27.700000 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc9af0b-1e27-458d-bf4f-ac556e23539f None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:27.700826 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 162/321] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:08:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:08:27.705474 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a5d5b-7a7a-45ff-88d7-a9c9efafd370 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:27.705763 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a5d5b-7a7a-45ff-88d7-a9c9efafd370 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:27.706044 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a5d5b-7a7a-45ff-88d7-a9c9efafd370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:27.706368 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 160/322] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:08:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:27.707478 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc9af0b-1e27-458d-bf4f-ac556e23539f None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:27.722535 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-002a5d5b-7a7a-45ff-88d7-a9c9efafd370 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:08:27.723703 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-002a5d5b-7a7a-45ff-88d7-a9c9efafd370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:08:27.798052 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 163/323] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:08:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 16:08:27.820695 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002a5d5b-7a7a-45ff-88d7-a9c9efafd370 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:27.823591 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc9af0b-1e27-458d-bf4f-ac556e23539f None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:27.861150 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2777e8-806f-4864-9372-11038ef0365d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:27.862045 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2777e8-806f-4864-9372-11038ef0365d None admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:27.862611 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2777e8-806f-4864-9372-11038ef0365d None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:27.863094 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2777e8-806f-4864-9372-11038ef0365d None admin] PATH_INFO: `/v3/groups` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:27.864400 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2777e8-806f-4864-9372-11038ef0365d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:27.867137 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2777e8-806f-4864-9372-11038ef0365d None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:27.883344 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:27.945095 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002a5d5b-7a7a-45ff-88d7-a9c9efafd370 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:27.973687 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:27.979594 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256c2808-66b5-4eb7-be60-158a9420f44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:27.980124 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 161/324] 10.222.0.62 () {60 vars in 1134 bytes} [Fri May 27 16:08:27 2022] POST /identity/v3/groups => generated 226 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:08:27.980487 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c2808-66b5-4eb7-be60-158a9420f44d None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:27.980775 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c2808-66b5-4eb7-be60-158a9420f44d None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:27.981089 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c2808-66b5-4eb7-be60-158a9420f44d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:27.981519 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd931b7-6552-48ef-a389-78b25fd540d1 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:27.982046 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd931b7-6552-48ef-a389-78b25fd540d1 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:27.982366 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd931b7-6552-48ef-a389-78b25fd540d1 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:27.983738 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 162/325] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:08:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:08:27.989355 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9712d0ce-5359-42db-acab-327f94ac9848 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:27.989648 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9712d0ce-5359-42db-acab-327f94ac9848 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:27.989934 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9712d0ce-5359-42db-acab-327f94ac9848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:27.993306 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256c2808-66b5-4eb7-be60-158a9420f44d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:08:28.003087 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-256c2808-66b5-4eb7-be60-158a9420f44d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 16:08:28.003087 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:08:28.003087 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:08:28.003087 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:08:28.003087 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:08:28.003087 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:08:28.003087 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:08:28.003087 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:08:28.003087 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:08:28.003087 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:08:28.003087 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:08:28.003087 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:08:28.003087 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:08:28.003087 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:08:28.003087 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:08:28.003087 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:08:28.005109 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:08:28.005109 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:08:28.005109 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:08:28.005109 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:08:28.005109 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:08:28.005109 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:08:28.005109 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:08:28.005109 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:08:28.005109 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:08:28.005109 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:08:28.005109 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:08:28.005109 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:08:28.005109 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:08:28.005109 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:08:28.005109 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:08:28.005109 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:08:28.005919 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:08:28.005919 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:08:28.005919 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:08:28.005919 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:08:28.005919 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:08:28.005919 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:08:28.005919 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:08:28.005919 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:08:28.005919 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:08:28.005919 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:08:28.005919 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 16:08:28.005919 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:08:28.005919 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 164/326] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 16:08:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:08:28.007823 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-9712d0ce-5359-42db-acab-327f94ac9848 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:08:28.009077 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-9712d0ce-5359-42db-acab-327f94ac9848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:08:28.010940 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256c2808-66b5-4eb7-be60-158a9420f44d None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:28.085086 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 163/327] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:08:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 16:08:28.108919 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9712d0ce-5359-42db-acab-327f94ac9848 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:28.126622 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256c2808-66b5-4eb7-be60-158a9420f44d None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:28.138921 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:28.163817 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a5520f-1d7a-4226-aff2-aa41ea74626e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:28.164802 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5520f-1d7a-4226-aff2-aa41ea74626e None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:28.165784 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5520f-1d7a-4226-aff2-aa41ea74626e None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:28.166070 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5520f-1d7a-4226-aff2-aa41ea74626e None admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:28.167214 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a5520f-1d7a-4226-aff2-aa41ea74626e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:28.167214 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a5520f-1d7a-4226-aff2-aa41ea74626e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:28.168519 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a5520f-1d7a-4226-aff2-aa41ea74626e None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:28.177915 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 165/328] 10.222.0.62 () {56 vars in 1101 bytes} [Fri May 27 16:08:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:08:28.184340 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a5520f-1d7a-4226-aff2-aa41ea74626e None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:28.243762 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9712d0ce-5359-42db-acab-327f94ac9848 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:28.282651 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:28.292576 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85df97c0-3bd8-4019-9789-95816885832b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:28.293752 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df97c0-3bd8-4019-9789-95816885832b None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:28.293752 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df97c0-3bd8-4019-9789-95816885832b None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:28.294026 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df97c0-3bd8-4019-9789-95816885832b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:28.307555 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85df97c0-3bd8-4019-9789-95816885832b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:08:28.315437 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-85df97c0-3bd8-4019-9789-95816885832b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 16:08:28.315437 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:08:28.315437 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:08:28.315437 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:08:28.315437 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:08:28.315437 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:08:28.315437 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:08:28.315437 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:08:28.315437 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:08:28.315437 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:08:28.315437 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:08:28.315437 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:08:28.315437 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:08:28.315437 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:08:28.315437 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:08:28.315437 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:08:28.316328 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:08:28.316328 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:08:28.316328 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:08:28.316328 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:08:28.316328 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:08:28.316328 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:08:28.316328 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:08:28.316328 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:08:28.316328 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:08:28.316328 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:08:28.316328 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:08:28.316328 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:08:28.316328 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:08:28.316328 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:08:28.316328 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:08:28.316328 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:08:28.317138 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:08:28.317138 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:08:28.317138 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:08:28.317138 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:08:28.317138 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:08:28.317138 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:08:28.317138 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:08:28.317138 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:08:28.317138 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:08:28.317138 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:08:28.317138 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 16:08:28.317138 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:08:28.317138 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 164/329] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 16:08:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:08:28.321082 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a5520f-1d7a-4226-aff2-aa41ea74626e None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:28.323831 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85df97c0-3bd8-4019-9789-95816885832b None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:28.367358 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a831d7a-f0b8-471e-bbf2-aafbd3bfa2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:28.368824 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a831d7a-f0b8-471e-bbf2-aafbd3bfa2ae None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:28.369148 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a831d7a-f0b8-471e-bbf2-aafbd3bfa2ae None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:28.369510 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a831d7a-f0b8-471e-bbf2-aafbd3bfa2ae None admin] PATH_INFO: `/v3/users/5c53fb83d0fb4884bc83bea72f822bf1` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:28.371917 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a831d7a-f0b8-471e-bbf2-aafbd3bfa2ae None admin] RBAC: Authorizing `identity:get_user(user_id=5c53fb83d0fb4884bc83bea72f822bf1)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:28.372102 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a831d7a-f0b8-471e-bbf2-aafbd3bfa2ae None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:28.374059 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 166/330] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 16:08:28 2022] GET /identity/v3/users/5c53fb83d0fb4884bc83bea72f822bf1 => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:08:28.379413 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a831d7a-f0b8-471e-bbf2-aafbd3bfa2ae None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:28.430058 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:28.452547 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85df97c0-3bd8-4019-9789-95816885832b None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:28.498878 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efa742a-490d-410b-b82f-872f4864ebb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:28.499633 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa742a-490d-410b-b82f-872f4864ebb6 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:28.500350 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa742a-490d-410b-b82f-872f4864ebb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:28.500731 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa742a-490d-410b-b82f-872f4864ebb6 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:28.501864 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efa742a-490d-410b-b82f-872f4864ebb6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:28.502290 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efa742a-490d-410b-b82f-872f4864ebb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:28.503406 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a831d7a-f0b8-471e-bbf2-aafbd3bfa2ae None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:28.503892 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efa742a-490d-410b-b82f-872f4864ebb6 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:28.514866 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 165/331] 10.222.0.62 () {56 vars in 1101 bytes} [Fri May 27 16:08:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:28.520353 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efa742a-490d-410b-b82f-872f4864ebb6 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:28.543721 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10214e6-6b6f-46c7-add1-1ee94be8c3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:28.544886 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10214e6-6b6f-46c7-add1-1ee94be8c3c3 None admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:28.545351 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10214e6-6b6f-46c7-add1-1ee94be8c3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:28.545808 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10214e6-6b6f-46c7-add1-1ee94be8c3c3 None admin] PATH_INFO: `/v3/system/users/5c53fb83d0fb4884bc83bea72f822bf1/roles/6d3bcbc332ec4ad4b4910a6a9fc398ae` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:28.547837 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10214e6-6b6f-46c7-add1-1ee94be8c3c3 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=5c53fb83d0fb4884bc83bea72f822bf1, role_id=6d3bcbc332ec4ad4b4910a6a9fc398ae)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:28.549479 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10214e6-6b6f-46c7-add1-1ee94be8c3c3 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:28.592558 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:28.619845 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 167/332] 10.222.0.62 () {58 vars in 1334 bytes} [Fri May 27 16:08:28 2022] PUT /identity/v3/system/users/5c53fb83d0fb4884bc83bea72f822bf1/roles/6d3bcbc332ec4ad4b4910a6a9fc398ae => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:08:28.651503 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efa742a-490d-410b-b82f-872f4864ebb6 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:28.691057 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81297789-1edc-4af8-9306-9ccf608db217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:28.691980 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81297789-1edc-4af8-9306-9ccf608db217 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:28.692265 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81297789-1edc-4af8-9306-9ccf608db217 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:28.692541 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81297789-1edc-4af8-9306-9ccf608db217 None admin] PATH_INFO: `/v3/users/dbe0a0395c90479bba2e493e01a7e625` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:28.693916 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81297789-1edc-4af8-9306-9ccf608db217 None admin] RBAC: Authorizing `identity:get_user(user_id=dbe0a0395c90479bba2e493e01a7e625)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:28.695536 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81297789-1edc-4af8-9306-9ccf608db217 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:28.697922 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 166/333] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 16:08:28 2022] GET /identity/v3/users/dbe0a0395c90479bba2e493e01a7e625 => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:08:28.703902 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10214e6-6b6f-46c7-add1-1ee94be8c3c3 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:28.832816 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10214e6-6b6f-46c7-add1-1ee94be8c3c3 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:28.835503 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:28.875524 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715475c5-309f-4206-9578-90a4ba036c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:28.876193 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715475c5-309f-4206-9578-90a4ba036c64 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:28.876489 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715475c5-309f-4206-9578-90a4ba036c64 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:28.876770 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715475c5-309f-4206-9578-90a4ba036c64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:28.877621 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715475c5-309f-4206-9578-90a4ba036c64 None admin] RBAC: Adding query filter params (role.id=c8ce6d197f654598ac45f6016ecccabd, user.id=dbe0a0395c90479bba2e493e01a7e625, scope.system=all) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:28.882657 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715475c5-309f-4206-9578-90a4ba036c64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:28.882657 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715475c5-309f-4206-9578-90a4ba036c64 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:28.892086 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 168/334] 10.222.0.62 () {56 vars in 1308 bytes} [Fri May 27 16:08:28 2022] GET /identity/v3/role_assignments?user.id=dbe0a0395c90479bba2e493e01a7e625&scope.system=all&role.id=c8ce6d197f654598ac45f6016ecccabd => generated 510 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:30.882364 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ef30b-be04-44fc-b8b6-68ef125cb621 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:30.882874 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ef30b-be04-44fc-b8b6-68ef125cb621 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:30.882953 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ef30b-be04-44fc-b8b6-68ef125cb621 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:30.885108 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 167/335] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:08:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:08:30.900004 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240898f-f216-4c73-8d1c-4e310f8e4f1e None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:30.900900 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240898f-f216-4c73-8d1c-4e310f8e4f1e None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:30.901389 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240898f-f216-4c73-8d1c-4e310f8e4f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:30.922565 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-e240898f-f216-4c73-8d1c-4e310f8e4f1e None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:08:30.924085 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-e240898f-f216-4c73-8d1c-4e310f8e4f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:08:31.019096 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 169/336] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:08:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 16:08:31.044844 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183ef30b-be04-44fc-b8b6-68ef125cb621 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:31.191510 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183ef30b-be04-44fc-b8b6-68ef125cb621 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:31.212219 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:31.236391 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed4906b-469f-4aa6-89c7-1dd0d7d13b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:31.237580 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed4906b-469f-4aa6-89c7-1dd0d7d13b31 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:31.238076 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed4906b-469f-4aa6-89c7-1dd0d7d13b31 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:31.238598 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed4906b-469f-4aa6-89c7-1dd0d7d13b31 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:31.255220 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed4906b-469f-4aa6-89c7-1dd0d7d13b31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:08:31.263403 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-fed4906b-469f-4aa6-89c7-1dd0d7d13b31 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 16:08:31.263403 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:08:31.263403 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:08:31.263403 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:08:31.263403 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:08:31.263403 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:08:31.263403 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:08:31.263403 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:08:31.263403 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:08:31.263403 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:08:31.263403 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:08:31.263403 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:08:31.263403 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:08:31.263403 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:08:31.263403 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:08:31.263403 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:08:31.264324 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:08:31.264324 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:08:31.264324 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:08:31.264324 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:08:31.264324 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:08:31.264324 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:08:31.264324 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:08:31.264324 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:08:31.264324 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:08:31.264324 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:08:31.264324 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:08:31.264324 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:08:31.264324 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:08:31.264324 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:08:31.264324 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:08:31.264324 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:08:31.265164 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:08:31.265164 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:08:31.265164 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:08:31.265164 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:08:31.265164 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:08:31.265164 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:08:31.265164 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:08:31.265164 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:08:31.265164 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:08:31.265164 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:08:31.265164 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 16:08:31.265164 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:08:31.267914 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 168/337] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 16:08:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:08:31.273887 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e240898f-f216-4c73-8d1c-4e310f8e4f1e None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:31.438773 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10bcd4e-0b70-4653-ad80-8972bc2ac8f9 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:31.439474 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10bcd4e-0b70-4653-ad80-8972bc2ac8f9 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:31.439669 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:31.440158 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10bcd4e-0b70-4653-ad80-8972bc2ac8f9 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:31.441803 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 169/338] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:08:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:08:31.448848 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b853e-53bd-432e-8c8f-2b5a9b7a7b2a None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:31.454345 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b853e-53bd-432e-8c8f-2b5a9b7a7b2a None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:31.454345 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b853e-53bd-432e-8c8f-2b5a9b7a7b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:31.454540 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e240898f-f216-4c73-8d1c-4e310f8e4f1e None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:31.487289 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-2b3b853e-53bd-432e-8c8f-2b5a9b7a7b2a None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:08:31.488518 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-2b3b853e-53bd-432e-8c8f-2b5a9b7a7b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:08:31.495243 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49310368-2d13-490e-9b0b-293711e73b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:31.495925 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49310368-2d13-490e-9b0b-293711e73b96 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:31.496543 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49310368-2d13-490e-9b0b-293711e73b96 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:31.496796 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49310368-2d13-490e-9b0b-293711e73b96 None admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:31.497556 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49310368-2d13-490e-9b0b-293711e73b96 None admin] RBAC: Adding query filter params (name=member) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:31.497858 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49310368-2d13-490e-9b0b-293711e73b96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:31.499316 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49310368-2d13-490e-9b0b-293711e73b96 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:31.516798 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 170/339] 10.222.0.62 () {56 vars in 1101 bytes} [Fri May 27 16:08:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:31.523847 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49310368-2d13-490e-9b0b-293711e73b96 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:31.602882 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 170/340] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:08:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:08:31.604850 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b6ea4-0715-42f1-9557-30a5800e7731 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:31.605399 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b6ea4-0715-42f1-9557-30a5800e7731 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:31.605874 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b6ea4-0715-42f1-9557-30a5800e7731 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:31.611530 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 171/341] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:08:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:08:31.633323 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667b6ea4-0715-42f1-9557-30a5800e7731 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:31.644399 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49310368-2d13-490e-9b0b-293711e73b96 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:31.698883 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0a8861-f426-487c-bfec-460907a0762d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:31.699452 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a8861-f426-487c-bfec-460907a0762d None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:31.699735 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a8861-f426-487c-bfec-460907a0762d None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:31.700034 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a8861-f426-487c-bfec-460907a0762d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:31.732775 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:31.754867 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667b6ea4-0715-42f1-9557-30a5800e7731 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:31.767965 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:31.800200 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78be7001-847f-426d-bf72-e9138b54273c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:31.801424 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be7001-847f-426d-bf72-e9138b54273c None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:31.801993 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be7001-847f-426d-bf72-e9138b54273c None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:31.802503 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be7001-847f-426d-bf72-e9138b54273c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:31.803492 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0a8861-f426-487c-bfec-460907a0762d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:31.804976 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0a8861-f426-487c-bfec-460907a0762d None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:31.817176 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78be7001-847f-426d-bf72-e9138b54273c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:08:31.826981 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-78be7001-847f-426d-bf72-e9138b54273c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 16:08:31.826981 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:08:31.826981 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:08:31.826981 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:08:31.826981 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:08:31.826981 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:08:31.826981 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:08:31.826981 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:08:31.826981 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:08:31.826981 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:08:31.826981 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:08:31.826981 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:08:31.826981 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:08:31.826981 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:08:31.826981 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:08:31.826981 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:08:31.827870 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:08:31.827870 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:08:31.827870 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:08:31.827870 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:08:31.827870 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:08:31.827870 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:08:31.827870 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:08:31.827870 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:08:31.827870 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:08:31.827870 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:08:31.827870 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:08:31.827870 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:08:31.827870 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:08:31.827870 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:08:31.827870 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:08:31.827870 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:08:31.828669 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:08:31.828669 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:08:31.828669 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:08:31.828669 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:08:31.828669 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:08:31.828669 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:08:31.828669 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:08:31.828669 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:08:31.828669 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:08:31.828669 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:08:31.828669 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 16:08:31.828669 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:08:31.831644 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 172/342] 10.222.0.62 () {56 vars in 1114 bytes} [Fri May 27 16:08:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:08:31.833296 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f239d-a33e-40ea-9ad7-69aa19fb775b None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:31.833791 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f239d-a33e-40ea-9ad7-69aa19fb775b None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:31.838394 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f239d-a33e-40ea-9ad7-69aa19fb775b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:31.858355 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-521f239d-a33e-40ea-9ad7-69aa19fb775b None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:08:31.859972 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-521f239d-a33e-40ea-9ad7-69aa19fb775b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:08:31.929497 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 171/343] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 16:08:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 27 16:08:31.930463 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0a8861-f426-487c-bfec-460907a0762d None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:31.987863 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 173/344] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:08:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:08:31.988498 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521f239d-a33e-40ea-9ad7-69aa19fb775b None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:31.989145 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:32.060255 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0a8861-f426-487c-bfec-460907a0762d None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:32.105025 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be3caf-d019-4c56-8b5b-f6b12c6db939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:32.105702 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be3caf-d019-4c56-8b5b-f6b12c6db939 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:32.105983 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be3caf-d019-4c56-8b5b-f6b12c6db939 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:32.106279 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be3caf-d019-4c56-8b5b-f6b12c6db939 None admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:32.107037 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be3caf-d019-4c56-8b5b-f6b12c6db939 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:32.107343 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be3caf-d019-4c56-8b5b-f6b12c6db939 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:32.108807 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be3caf-d019-4c56-8b5b-f6b12c6db939 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:32.117519 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 172/345] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 16:08:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:32.118710 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be3caf-d019-4c56-8b5b-f6b12c6db939 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:32.192544 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:32.199563 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521f239d-a33e-40ea-9ad7-69aa19fb775b None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:32.236460 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be3caf-d019-4c56-8b5b-f6b12c6db939 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:32.240287 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b9d7f-9f9c-497e-88c1-e40663252379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:32.241250 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b9d7f-9f9c-497e-88c1-e40663252379 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:32.241606 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b9d7f-9f9c-497e-88c1-e40663252379 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:32.241948 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b9d7f-9f9c-497e-88c1-e40663252379 None admin] PATH_INFO: `/v3/projects/d280b4797bdd4aabacba365ec82ca978` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:32.243825 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28b9d7f-9f9c-497e-88c1-e40663252379 None admin] RBAC: Authorizing `identity:get_project(project_id=d280b4797bdd4aabacba365ec82ca978)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:32.245666 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28b9d7f-9f9c-497e-88c1-e40663252379 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:32.248026 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 174/346] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 16:08:31 2022] GET /identity/v3/projects/d280b4797bdd4aabacba365ec82ca978 => generated 298 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:32.253425 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff4f5e-84b5-4064-907c-254a58491cd1 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:32.253425 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff4f5e-84b5-4064-907c-254a58491cd1 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:32.253425 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff4f5e-84b5-4064-907c-254a58491cd1 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:32.253425 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 175/347] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:08:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:08:32.253425 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ff4f5e-84b5-4064-907c-254a58491cd1 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:32.265096 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:32.285554 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b91dfe-34e9-4c1c-b969-8bd470b65aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:32.286862 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b91dfe-34e9-4c1c-b969-8bd470b65aa0 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:32.287459 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b91dfe-34e9-4c1c-b969-8bd470b65aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:32.287945 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b91dfe-34e9-4c1c-b969-8bd470b65aa0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:32.303428 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b91dfe-34e9-4c1c-b969-8bd470b65aa0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:08:32.313503 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-23b91dfe-34e9-4c1c-b969-8bd470b65aa0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 16:08:32.313503 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:08:32.313503 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:08:32.313503 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:08:32.313503 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:08:32.313503 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:08:32.313503 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:08:32.313503 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:08:32.313503 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:08:32.313503 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:08:32.313503 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:08:32.313503 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:08:32.313503 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:08:32.313503 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:08:32.313503 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:08:32.313503 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:08:32.314573 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:08:32.314573 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:08:32.314573 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:08:32.314573 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:08:32.314573 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:08:32.314573 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:08:32.314573 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:08:32.314573 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:08:32.314573 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:08:32.314573 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:08:32.314573 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:08:32.314573 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:08:32.314573 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:08:32.314573 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:08:32.314573 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:08:32.314573 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:08:32.315400 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:08:32.315400 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:08:32.315400 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:08:32.315400 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:08:32.315400 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:08:32.315400 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:08:32.315400 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:08:32.315400 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:08:32.315400 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:08:32.315400 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:08:32.315400 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 16:08:32.315400 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:08:32.315400 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 173/348] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 16:08:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:08:32.316075 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b91dfe-34e9-4c1c-b969-8bd470b65aa0 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:32.401051 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ff4f5e-84b5-4064-907c-254a58491cd1 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:32.442877 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661605a4-b949-45e6-aecf-74b61e289b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:32.443537 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661605a4-b949-45e6-aecf-74b61e289b26 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:32.443823 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661605a4-b949-45e6-aecf-74b61e289b26 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:32.444102 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661605a4-b949-45e6-aecf-74b61e289b26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:32.452022 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b91dfe-34e9-4c1c-b969-8bd470b65aa0 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:32.484036 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:32.499752 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6cb567-f83d-44d7-9e90-4990641057a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:32.501000 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6cb567-f83d-44d7-9e90-4990641057a1 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:32.501624 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6cb567-f83d-44d7-9e90-4990641057a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:32.502096 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6cb567-f83d-44d7-9e90-4990641057a1 None admin] PATH_INFO: `/v3/groups/3c837d6f47aa437781641a4bedf6802e` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:32.510316 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6cb567-f83d-44d7-9e90-4990641057a1 None admin] RBAC: Authorizing `identity:get_group(group_id=3c837d6f47aa437781641a4bedf6802e)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:32.512341 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6cb567-f83d-44d7-9e90-4990641057a1 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:32.515326 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 174/349] 10.222.0.62 () {56 vars in 1180 bytes} [Fri May 27 16:08:32 2022] GET /identity/v3/groups/3c837d6f47aa437781641a4bedf6802e => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:32.517366 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22cb4f-d58c-4167-8703-78faf6746f32 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:32.517851 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22cb4f-d58c-4167-8703-78faf6746f32 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:32.518328 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22cb4f-d58c-4167-8703-78faf6746f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:32.523857 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661605a4-b949-45e6-aecf-74b61e289b26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:32.526090 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661605a4-b949-45e6-aecf-74b61e289b26 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:32.542421 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-0d22cb4f-d58c-4167-8703-78faf6746f32 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:08:32.544696 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-0d22cb4f-d58c-4167-8703-78faf6746f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:08:32.589862 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:32.632372 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 175/350] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:08:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:08:32.633999 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d22cb4f-d58c-4167-8703-78faf6746f32 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:32.655366 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 176/351] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 16:08:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 16:08:32.656411 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661605a4-b949-45e6-aecf-74b61e289b26 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:32.742702 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:32.789236 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661605a4-b949-45e6-aecf-74b61e289b26 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:32.790422 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d22cb4f-d58c-4167-8703-78faf6746f32 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:32.835119 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a025a575-3aca-4a73-aa64-af6a33dd4ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:32.835816 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025a575-3aca-4a73-aa64-af6a33dd4ddb None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:32.836206 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025a575-3aca-4a73-aa64-af6a33dd4ddb None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:32.836495 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025a575-3aca-4a73-aa64-af6a33dd4ddb None admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:32.838199 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a025a575-3aca-4a73-aa64-af6a33dd4ddb None admin] RBAC: Adding query filter params (name=member) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:32.838199 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a025a575-3aca-4a73-aa64-af6a33dd4ddb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:32.841601 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a025a575-3aca-4a73-aa64-af6a33dd4ddb None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:32.850055 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875927e8-4fb0-47be-93f9-5a3115201f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:32.850402 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 176/352] 10.222.0.62 () {56 vars in 1101 bytes} [Fri May 27 16:08:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:32.850500 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875927e8-4fb0-47be-93f9-5a3115201f4f None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:32.850500 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875927e8-4fb0-47be-93f9-5a3115201f4f None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:32.850500 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875927e8-4fb0-47be-93f9-5a3115201f4f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:32.850839 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875927e8-4fb0-47be-93f9-5a3115201f4f None admin] RBAC: Adding query filter params (group.id=3c837d6f47aa437781641a4bedf6802e, role.id=c8ce6d197f654598ac45f6016ecccabd, scope.project.id=d280b4797bdd4aabacba365ec82ca978) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:32.851152 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875927e8-4fb0-47be-93f9-5a3115201f4f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:32.852658 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875927e8-4fb0-47be-93f9-5a3115201f4f None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:32.854906 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5125c8da-6d67-4e08-828f-d98bb6e5e430 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:32.855397 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5125c8da-6d67-4e08-828f-d98bb6e5e430 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:32.855980 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5125c8da-6d67-4e08-828f-d98bb6e5e430 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:32.857598 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 177/353] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:08:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:08:32.858588 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5125c8da-6d67-4e08-828f-d98bb6e5e430 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:32.865417 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 177/354] 10.222.0.62 () {56 vars in 1376 bytes} [Fri May 27 16:08:32 2022] GET /identity/v3/role_assignments?group.id=3c837d6f47aa437781641a4bedf6802e&scope.project.id=d280b4797bdd4aabacba365ec82ca978&role.id=c8ce6d197f654598ac45f6016ecccabd => generated 260 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:32.865586 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875927e8-4fb0-47be-93f9-5a3115201f4f None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:32.908687 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:32.999511 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5125c8da-6d67-4e08-828f-d98bb6e5e430 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:33.014911 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875927e8-4fb0-47be-93f9-5a3115201f4f None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:33.065963 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717351cb-cbd0-48e9-9e67-071922d174b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:33.067547 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717351cb-cbd0-48e9-9e67-071922d174b5 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:33.067944 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717351cb-cbd0-48e9-9e67-071922d174b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:33.068516 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717351cb-cbd0-48e9-9e67-071922d174b5 None admin] PATH_INFO: `/v3/projects/d280b4797bdd4aabacba365ec82ca978` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:33.070213 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717351cb-cbd0-48e9-9e67-071922d174b5 None admin] RBAC: Authorizing `identity:get_project(project_id=d280b4797bdd4aabacba365ec82ca978)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:33.072255 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:33.074817 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717351cb-cbd0-48e9-9e67-071922d174b5 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:33.076956 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 178/355] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 16:08:32 2022] GET /identity/v3/projects/d280b4797bdd4aabacba365ec82ca978 => generated 298 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:33.077605 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717351cb-cbd0-48e9-9e67-071922d174b5 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:33.090134 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c98e6-2f89-46a3-a143-1865cad31fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:33.091141 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c98e6-2f89-46a3-a143-1865cad31fff None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:33.091498 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c98e6-2f89-46a3-a143-1865cad31fff None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:33.092002 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c98e6-2f89-46a3-a143-1865cad31fff None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:33.111421 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909c98e6-2f89-46a3-a143-1865cad31fff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:08:33.124380 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-909c98e6-2f89-46a3-a143-1865cad31fff None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 16:08:33.124380 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:08:33.124380 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:08:33.124380 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:08:33.124380 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:08:33.124380 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:08:33.124380 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:08:33.124380 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:08:33.124380 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:08:33.124380 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:08:33.124380 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:08:33.124380 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:08:33.124380 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:08:33.124380 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:08:33.124380 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:08:33.124380 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:08:33.125338 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:08:33.125338 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:08:33.125338 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:08:33.125338 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:08:33.125338 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:08:33.125338 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:08:33.125338 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:08:33.125338 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:08:33.125338 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:08:33.125338 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:08:33.125338 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:08:33.125338 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:08:33.125338 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:08:33.125338 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:08:33.125338 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:08:33.125338 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:08:33.126134 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:08:33.126134 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:08:33.126134 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:08:33.126134 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:08:33.126134 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:08:33.126134 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:08:33.126134 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:08:33.126134 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:08:33.126134 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:08:33.126134 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:08:33.126134 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 16:08:33.126134 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:08:33.126134 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 178/356] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 16:08:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:08:33.126857 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd15646-48ee-4e91-920e-62233cf7b029 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:33.126857 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd15646-48ee-4e91-920e-62233cf7b029 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:33.126984 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd15646-48ee-4e91-920e-62233cf7b029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:33.148423 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-8bd15646-48ee-4e91-920e-62233cf7b029 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:08:33.149617 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-8bd15646-48ee-4e91-920e-62233cf7b029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:08:33.217997 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:33.221513 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717351cb-cbd0-48e9-9e67-071922d174b5 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:33.238654 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 179/357] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:08:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:08:33.240050 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd15646-48ee-4e91-920e-62233cf7b029 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:33.282628 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a65111-94e0-4406-a42b-d580b8a2c59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:33.283601 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a65111-94e0-4406-a42b-d580b8a2c59e None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:33.283882 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a65111-94e0-4406-a42b-d580b8a2c59e None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:33.284327 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a65111-94e0-4406-a42b-d580b8a2c59e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:33.375160 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a65111-94e0-4406-a42b-d580b8a2c59e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:33.379636 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a65111-94e0-4406-a42b-d580b8a2c59e None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:33.386628 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd15646-48ee-4e91-920e-62233cf7b029 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:33.409803 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:33.433296 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48faff6c-7196-4f07-b04d-e87a4709e355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:33.434615 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48faff6c-7196-4f07-b04d-e87a4709e355 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:33.436012 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48faff6c-7196-4f07-b04d-e87a4709e355 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:33.436505 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48faff6c-7196-4f07-b04d-e87a4709e355 None admin] PATH_INFO: `/v3/groups/3c837d6f47aa437781641a4bedf6802e` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:33.438010 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48faff6c-7196-4f07-b04d-e87a4709e355 None admin] RBAC: Authorizing `identity:get_group(group_id=3c837d6f47aa437781641a4bedf6802e)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:33.439710 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48faff6c-7196-4f07-b04d-e87a4709e355 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:33.441725 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 180/358] 10.222.0.62 () {56 vars in 1180 bytes} [Fri May 27 16:08:33 2022] GET /identity/v3/groups/3c837d6f47aa437781641a4bedf6802e => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:33.442837 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48faff6c-7196-4f07-b04d-e87a4709e355 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:33.503332 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:33.508946 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 179/359] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 16:08:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 16:08:33.510513 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37941fd1-96df-472d-b5d8-6bf82890145f None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:33.510872 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37941fd1-96df-472d-b5d8-6bf82890145f None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:33.511269 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37941fd1-96df-472d-b5d8-6bf82890145f None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:33.512813 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 180/360] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:08:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:08:33.513525 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37941fd1-96df-472d-b5d8-6bf82890145f None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:33.574747 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48faff6c-7196-4f07-b04d-e87a4709e355 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:33.616839 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb5ed04-ad9f-4f86-aa8e-09a644f2c85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:33.617264 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb5ed04-ad9f-4f86-aa8e-09a644f2c85e None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:33.617585 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb5ed04-ad9f-4f86-aa8e-09a644f2c85e None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:33.617930 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb5ed04-ad9f-4f86-aa8e-09a644f2c85e None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:33.619349 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb5ed04-ad9f-4f86-aa8e-09a644f2c85e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:33.619651 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb5ed04-ad9f-4f86-aa8e-09a644f2c85e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:33.621055 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb5ed04-ad9f-4f86-aa8e-09a644f2c85e None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:33.634991 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 181/361] 10.222.0.62 () {56 vars in 1101 bytes} [Fri May 27 16:08:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:33.635778 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb5ed04-ad9f-4f86-aa8e-09a644f2c85e None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:33.659656 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37941fd1-96df-472d-b5d8-6bf82890145f None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:33.703294 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46afa75a-ba0c-42ee-a626-5b5b7ecc8b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:33.704118 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46afa75a-ba0c-42ee-a626-5b5b7ecc8b66 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:33.704395 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46afa75a-ba0c-42ee-a626-5b5b7ecc8b66 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:33.704664 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46afa75a-ba0c-42ee-a626-5b5b7ecc8b66 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:33.709800 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:33.718675 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46afa75a-ba0c-42ee-a626-5b5b7ecc8b66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:08:33.729832 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-46afa75a-ba0c-42ee-a626-5b5b7ecc8b66 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 16:08:33.729832 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:08:33.729832 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:08:33.729832 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:08:33.729832 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:08:33.729832 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:08:33.729832 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:08:33.729832 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:08:33.729832 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:08:33.729832 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:08:33.729832 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:08:33.729832 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:08:33.729832 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:08:33.729832 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:08:33.729832 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:08:33.729832 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:08:33.730815 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:08:33.730815 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:08:33.730815 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:08:33.730815 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:08:33.730815 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:08:33.730815 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:08:33.730815 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:08:33.730815 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:08:33.730815 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:08:33.730815 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:08:33.730815 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:08:33.730815 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:08:33.730815 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:08:33.730815 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:08:33.730815 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:08:33.730815 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:08:33.731619 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:08:33.731619 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:08:33.731619 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:08:33.731619 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:08:33.731619 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:08:33.731619 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:08:33.731619 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:08:33.731619 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:08:33.731619 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:08:33.731619 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:08:33.731619 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 16:08:33.731619 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:08:33.731619 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 181/362] 10.222.0.62 () {56 vars in 1114 bytes} [Fri May 27 16:08:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:08:33.731619 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46afa75a-ba0c-42ee-a626-5b5b7ecc8b66 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:33.779843 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb5ed04-ad9f-4f86-aa8e-09a644f2c85e None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:33.815275 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:33.827294 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04506cd6-80f7-40b8-8e2c-8107523fe2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:33.827967 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04506cd6-80f7-40b8-8e2c-8107523fe2b2 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:33.829553 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04506cd6-80f7-40b8-8e2c-8107523fe2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:33.829553 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04506cd6-80f7-40b8-8e2c-8107523fe2b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:33.829553 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04506cd6-80f7-40b8-8e2c-8107523fe2b2 None admin] RBAC: Adding query filter params (group.id=3c837d6f47aa437781641a4bedf6802e, role.id=404d2ea20e7c4842892e5001133f1b93, scope.project.id=d280b4797bdd4aabacba365ec82ca978) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:33.829769 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04506cd6-80f7-40b8-8e2c-8107523fe2b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:33.831155 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04506cd6-80f7-40b8-8e2c-8107523fe2b2 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:33.837534 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 182/363] 10.222.0.62 () {56 vars in 1376 bytes} [Fri May 27 16:08:33 2022] GET /identity/v3/role_assignments?group.id=3c837d6f47aa437781641a4bedf6802e&scope.project.id=d280b4797bdd4aabacba365ec82ca978&role.id=404d2ea20e7c4842892e5001133f1b93 => generated 260 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:33.838432 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21420eb7-1de4-42f6-9416-66c8659f6c41 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:33.838728 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21420eb7-1de4-42f6-9416-66c8659f6c41 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:33.839015 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21420eb7-1de4-42f6-9416-66c8659f6c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:33.860122 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-21420eb7-1de4-42f6-9416-66c8659f6c41 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:08:33.861365 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-21420eb7-1de4-42f6-9416-66c8659f6c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:08:33.884327 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46afa75a-ba0c-42ee-a626-5b5b7ecc8b66 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:33.923520 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a29bb9f-c6a6-4cf0-9aad-a51e782421fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:33.924843 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a29bb9f-c6a6-4cf0-9aad-a51e782421fa None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:33.925345 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a29bb9f-c6a6-4cf0-9aad-a51e782421fa None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:33.925796 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a29bb9f-c6a6-4cf0-9aad-a51e782421fa None admin] PATH_INFO: `/v3/projects/fe60851080e24e0db8e6af2ad2a17a54` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:33.927500 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a29bb9f-c6a6-4cf0-9aad-a51e782421fa None admin] RBAC: Authorizing `identity:get_project(project_id=fe60851080e24e0db8e6af2ad2a17a54)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:33.929568 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a29bb9f-c6a6-4cf0-9aad-a51e782421fa None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:33.932097 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 182/364] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 16:08:33 2022] GET /identity/v3/projects/fe60851080e24e0db8e6af2ad2a17a54 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:33.934116 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a29bb9f-c6a6-4cf0-9aad-a51e782421fa None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:33.946172 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 183/365] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:08:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:08:33.947104 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21420eb7-1de4-42f6-9416-66c8659f6c41 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:34.018668 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:34.089242 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a29bb9f-c6a6-4cf0-9aad-a51e782421fa None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:34.105660 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21420eb7-1de4-42f6-9416-66c8659f6c41 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:34.137522 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8509cf-4c73-4c0a-ae9f-d3d0f6299d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:34.138731 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8509cf-4c73-4c0a-ae9f-d3d0f6299d0c None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:34.139033 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8509cf-4c73-4c0a-ae9f-d3d0f6299d0c None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:34.139321 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8509cf-4c73-4c0a-ae9f-d3d0f6299d0c None admin] PATH_INFO: `/v3/users/5c53fb83d0fb4884bc83bea72f822bf1` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:34.141228 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8509cf-4c73-4c0a-ae9f-d3d0f6299d0c None admin] RBAC: Authorizing `identity:get_user(user_id=5c53fb83d0fb4884bc83bea72f822bf1)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:34.143383 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8509cf-4c73-4c0a-ae9f-d3d0f6299d0c None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:34.146283 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 183/366] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 16:08:33 2022] GET /identity/v3/users/5c53fb83d0fb4884bc83bea72f822bf1 => generated 293 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:34.146990 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8509cf-4c73-4c0a-ae9f-d3d0f6299d0c None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:34.154676 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:34.164057 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c2e760-7831-42b6-9467-03aac1914f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:34.165591 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2e760-7831-42b6-9467-03aac1914f8e None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:34.165890 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2e760-7831-42b6-9467-03aac1914f8e None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:34.166173 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2e760-7831-42b6-9467-03aac1914f8e None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:34.167322 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c2e760-7831-42b6-9467-03aac1914f8e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:34.167640 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c2e760-7831-42b6-9467-03aac1914f8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:34.169231 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c2e760-7831-42b6-9467-03aac1914f8e None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:34.181505 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 184/367] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 16:08:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:34.186709 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c2e760-7831-42b6-9467-03aac1914f8e None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:34.285691 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8509cf-4c73-4c0a-ae9f-d3d0f6299d0c None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:34.312904 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c2e760-7831-42b6-9467-03aac1914f8e None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:34.322648 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:34.332180 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b31085-8881-42fa-adfe-77db9e120b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:34.333072 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b31085-8881-42fa-adfe-77db9e120b1e None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:34.333340 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b31085-8881-42fa-adfe-77db9e120b1e None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:34.333626 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b31085-8881-42fa-adfe-77db9e120b1e None admin] PATH_INFO: `/v3/groups/3c837d6f47aa437781641a4bedf6802e` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:34.335373 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b31085-8881-42fa-adfe-77db9e120b1e None admin] RBAC: Authorizing `identity:get_group(group_id=3c837d6f47aa437781641a4bedf6802e)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:34.337536 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b31085-8881-42fa-adfe-77db9e120b1e None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:34.339745 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 184/368] 10.222.0.62 () {56 vars in 1180 bytes} [Fri May 27 16:08:34 2022] GET /identity/v3/groups/3c837d6f47aa437781641a4bedf6802e => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:34.342151 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b31085-8881-42fa-adfe-77db9e120b1e None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:34.360098 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e122737-3d35-4c59-8133-3b4f388f08fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:34.361347 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e122737-3d35-4c59-8133-3b4f388f08fb None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:34.362042 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e122737-3d35-4c59-8133-3b4f388f08fb None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:34.362664 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e122737-3d35-4c59-8133-3b4f388f08fb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:34.379921 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e122737-3d35-4c59-8133-3b4f388f08fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:08:34.390833 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-5e122737-3d35-4c59-8133-3b4f388f08fb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:08:34.390833 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:08:34.390833 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:08:34.390833 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:08:34.390833 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:08:34.390833 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:08:34.390833 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:08:34.390833 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:08:34.390833 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:08:34.390833 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:08:34.390833 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:08:34.390833 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:08:34.390833 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:08:34.390833 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:08:34.390833 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:08:34.390833 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:08:34.391724 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:08:34.391724 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:08:34.391724 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:08:34.391724 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:08:34.391724 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:08:34.391724 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:08:34.391724 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:08:34.391724 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:08:34.391724 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:08:34.391724 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:08:34.391724 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:08:34.391724 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:08:34.391724 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:08:34.391724 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:08:34.391724 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:08:34.391724 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:08:34.392518 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:08:34.392518 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:08:34.392518 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:08:34.392518 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:08:34.392518 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:08:34.392518 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:08:34.392518 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:08:34.392518 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:08:34.392518 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:08:34.392518 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:08:34.392518 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:08:34.392518 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:08:34.392518 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 185/369] 10.222.0.62 () {56 vars in 1096 bytes} [Fri May 27 16:08:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:08:34.393182 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e122737-3d35-4c59-8133-3b4f388f08fb None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:34.439581 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:34.483984 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b31085-8881-42fa-adfe-77db9e120b1e None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:34.516267 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e122737-3d35-4c59-8133-3b4f388f08fb None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:34.523167 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a1e93-17d2-427f-be9b-ae7faf4b79dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:34.524916 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a1e93-17d2-427f-be9b-ae7faf4b79dc None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:34.525209 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a1e93-17d2-427f-be9b-ae7faf4b79dc None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:34.525493 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a1e93-17d2-427f-be9b-ae7faf4b79dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:34.526874 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25a1e93-17d2-427f-be9b-ae7faf4b79dc None admin] RBAC: Adding query filter params (role.id=6d3bcbc332ec4ad4b4910a6a9fc398ae, user.id=5c53fb83d0fb4884bc83bea72f822bf1, scope.system=all) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:34.527196 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25a1e93-17d2-427f-be9b-ae7faf4b79dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:34.529353 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25a1e93-17d2-427f-be9b-ae7faf4b79dc None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:34.544812 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 185/370] 10.222.0.62 () {56 vars in 1308 bytes} [Fri May 27 16:08:34 2022] GET /identity/v3/role_assignments?user.id=5c53fb83d0fb4884bc83bea72f822bf1&scope.system=all&role.id=6d3bcbc332ec4ad4b4910a6a9fc398ae => generated 510 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:34.545661 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a1e93-17d2-427f-be9b-ae7faf4b79dc None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:34.553654 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d787a9a9-b56a-49ce-8e37-f42115f950ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:34.554353 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787a9a9-b56a-49ce-8e37-f42115f950ad None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:34.554642 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787a9a9-b56a-49ce-8e37-f42115f950ad None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:34.555090 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787a9a9-b56a-49ce-8e37-f42115f950ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:34.598042 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:34.663401 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d787a9a9-b56a-49ce-8e37-f42115f950ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:34.666687 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d787a9a9-b56a-49ce-8e37-f42115f950ad None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:34.795300 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 186/371] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 16:08:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 16:08:34.796961 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d787a9a9-b56a-49ce-8e37-f42115f950ad None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:34.862501 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a1e93-17d2-427f-be9b-ae7faf4b79dc None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:34.872942 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:34.902668 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:34.918536 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c1dc9-0f79-46e6-85bb-498051c9deb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:34.919206 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c1dc9-0f79-46e6-85bb-498051c9deb7 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:34.919496 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c1dc9-0f79-46e6-85bb-498051c9deb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:34.919621 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d787a9a9-b56a-49ce-8e37-f42115f950ad None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:34.919789 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c1dc9-0f79-46e6-85bb-498051c9deb7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:34.922111 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8c1dc9-0f79-46e6-85bb-498051c9deb7 None admin] RBAC: Adding query filter params (group.id=3c837d6f47aa437781641a4bedf6802e, role.id=c8ce6d197f654598ac45f6016ecccabd, scope.project.id=fe60851080e24e0db8e6af2ad2a17a54) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:34.923755 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8c1dc9-0f79-46e6-85bb-498051c9deb7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:34.925223 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8c1dc9-0f79-46e6-85bb-498051c9deb7 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:34.933331 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 186/372] 10.222.0.62 () {56 vars in 1376 bytes} [Fri May 27 16:08:34 2022] GET /identity/v3/role_assignments?group.id=3c837d6f47aa437781641a4bedf6802e&scope.project.id=fe60851080e24e0db8e6af2ad2a17a54&role.id=c8ce6d197f654598ac45f6016ecccabd => generated 260 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:34.934170 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c1dc9-0f79-46e6-85bb-498051c9deb7 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:34.973135 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d767ab-d11e-438a-98d9-55fc715f4d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:34.973838 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d767ab-d11e-438a-98d9-55fc715f4d36 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:34.974295 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d767ab-d11e-438a-98d9-55fc715f4d36 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:34.974590 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d767ab-d11e-438a-98d9-55fc715f4d36 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:34.975695 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d767ab-d11e-438a-98d9-55fc715f4d36 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:34.976290 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d767ab-d11e-438a-98d9-55fc715f4d36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:34.980805 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d767ab-d11e-438a-98d9-55fc715f4d36 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:34.996709 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 187/373] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 16:08:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:35.002604 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d767ab-d11e-438a-98d9-55fc715f4d36 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:35.135108 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c1dc9-0f79-46e6-85bb-498051c9deb7 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:35.167371 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d767ab-d11e-438a-98d9-55fc715f4d36 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:35.198596 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:35.207163 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72966e8-ff61-4ac0-b5c4-13a4696b95a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:35.207832 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72966e8-ff61-4ac0-b5c4-13a4696b95a4 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:35.208125 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72966e8-ff61-4ac0-b5c4-13a4696b95a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:35.208403 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72966e8-ff61-4ac0-b5c4-13a4696b95a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:35.218107 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd1488c-e5fc-4f6d-8d88-1d03b4e6b5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:35.219276 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1488c-e5fc-4f6d-8d88-1d03b4e6b5c3 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:35.219734 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1488c-e5fc-4f6d-8d88-1d03b4e6b5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:35.220181 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1488c-e5fc-4f6d-8d88-1d03b4e6b5c3 None admin] PATH_INFO: `/v3/projects/fe60851080e24e0db8e6af2ad2a17a54` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:35.221655 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd1488c-e5fc-4f6d-8d88-1d03b4e6b5c3 None admin] RBAC: Authorizing `identity:get_project(project_id=fe60851080e24e0db8e6af2ad2a17a54)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:35.223310 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd1488c-e5fc-4f6d-8d88-1d03b4e6b5c3 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:35.225188 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 187/374] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 16:08:34 2022] GET /identity/v3/projects/fe60851080e24e0db8e6af2ad2a17a54 => generated 302 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:35.231937 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd1488c-e5fc-4f6d-8d88-1d03b4e6b5c3 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:35.293324 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72966e8-ff61-4ac0-b5c4-13a4696b95a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:35.295393 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72966e8-ff61-4ac0-b5c4-13a4696b95a4 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:35.308634 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:35.364352 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd1488c-e5fc-4f6d-8d88-1d03b4e6b5c3 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:35.403520 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b859b45-c06f-47b9-85ff-4f7379a3cf98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:35.404414 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b859b45-c06f-47b9-85ff-4f7379a3cf98 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:35.404854 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b859b45-c06f-47b9-85ff-4f7379a3cf98 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:35.405184 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b859b45-c06f-47b9-85ff-4f7379a3cf98 None admin] PATH_INFO: `/v3/groups/3c837d6f47aa437781641a4bedf6802e` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:35.406563 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b859b45-c06f-47b9-85ff-4f7379a3cf98 None admin] RBAC: Authorizing `identity:get_group(group_id=3c837d6f47aa437781641a4bedf6802e)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:35.408107 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b859b45-c06f-47b9-85ff-4f7379a3cf98 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:35.413282 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 188/376] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 16:08:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 16:08:35.417892 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 188/376] 10.222.0.62 () {56 vars in 1180 bytes} [Fri May 27 16:08:35 2022] GET /identity/v3/groups/3c837d6f47aa437781641a4bedf6802e => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:08:35.418036 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72966e8-ff61-4ac0-b5c4-13a4696b95a4 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:35.419520 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b859b45-c06f-47b9-85ff-4f7379a3cf98 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:35.452408 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:35.539196 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72966e8-ff61-4ac0-b5c4-13a4696b95a4 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:35.580294 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b859b45-c06f-47b9-85ff-4f7379a3cf98 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:35.584871 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d545077-2b8e-44b3-aea8-d75c3300861a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:35.585545 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d545077-2b8e-44b3-aea8-d75c3300861a None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:35.585833 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d545077-2b8e-44b3-aea8-d75c3300861a None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:35.586116 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d545077-2b8e-44b3-aea8-d75c3300861a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:35.587534 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d545077-2b8e-44b3-aea8-d75c3300861a None admin] RBAC: Adding query filter params (group.id=3c837d6f47aa437781641a4bedf6802e, role.id=404d2ea20e7c4842892e5001133f1b93, scope.project.id=fe60851080e24e0db8e6af2ad2a17a54) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:35.587849 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d545077-2b8e-44b3-aea8-d75c3300861a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:35.589739 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d545077-2b8e-44b3-aea8-d75c3300861a None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:35.597476 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 189/377] 10.222.0.62 () {56 vars in 1376 bytes} [Fri May 27 16:08:35 2022] GET /identity/v3/role_assignments?group.id=3c837d6f47aa437781641a4bedf6802e&scope.project.id=fe60851080e24e0db8e6af2ad2a17a54&role.id=404d2ea20e7c4842892e5001133f1b93 => generated 260 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:35.599024 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed3c810-9693-4592-8cc4-a8a9bdedd213 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:35.599327 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed3c810-9693-4592-8cc4-a8a9bdedd213 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:35.599896 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed3c810-9693-4592-8cc4-a8a9bdedd213 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:35.601131 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 190/378] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:08:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:08:35.609242 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f874839-88de-4d90-b3c8-dadc18a447b3 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:35.609534 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f874839-88de-4d90-b3c8-dadc18a447b3 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:35.609813 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f874839-88de-4d90-b3c8-dadc18a447b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:35.610365 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:35.640932 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb93726-f357-4822-9d00-43a229fd7c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:35.641836 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb93726-f357-4822-9d00-43a229fd7c18 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:35.642128 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb93726-f357-4822-9d00-43a229fd7c18 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:35.642440 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb93726-f357-4822-9d00-43a229fd7c18 None admin] PATH_INFO: `/v3/projects/793e0b7f54284522b67bc42f3a9f9fdd` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:35.644015 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-2f874839-88de-4d90-b3c8-dadc18a447b3 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:08:35.645261 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-2f874839-88de-4d90-b3c8-dadc18a447b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:08:35.648116 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb93726-f357-4822-9d00-43a229fd7c18 None admin] RBAC: Authorizing `identity:get_project(project_id=793e0b7f54284522b67bc42f3a9f9fdd)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:35.649677 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb93726-f357-4822-9d00-43a229fd7c18 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:35.651942 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 189/379] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 16:08:35 2022] GET /identity/v3/projects/793e0b7f54284522b67bc42f3a9f9fdd => generated 344 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:35.657563 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb93726-f357-4822-9d00-43a229fd7c18 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:35.799267 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 191/380] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:08:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:08:35.825911 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb93726-f357-4822-9d00-43a229fd7c18 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:35.835658 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f874839-88de-4d90-b3c8-dadc18a447b3 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:35.865543 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634ebdd1-c263-4208-a358-1fa28aed0275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:35.866460 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ebdd1-c263-4208-a358-1fa28aed0275 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:35.866745 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ebdd1-c263-4208-a358-1fa28aed0275 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:35.867025 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ebdd1-c263-4208-a358-1fa28aed0275 None admin] PATH_INFO: `/v3/groups/3afd8aff1782409793dd982c8956d7e1` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:35.869039 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:35.874019 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634ebdd1-c263-4208-a358-1fa28aed0275 None admin] RBAC: Authorizing `identity:get_group(group_id=3afd8aff1782409793dd982c8956d7e1)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:35.875509 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634ebdd1-c263-4208-a358-1fa28aed0275 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:35.877425 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 190/381] 10.222.0.62 () {56 vars in 1180 bytes} [Fri May 27 16:08:35 2022] GET /identity/v3/groups/3afd8aff1782409793dd982c8956d7e1 => generated 229 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:08:35.884885 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634ebdd1-c263-4208-a358-1fa28aed0275 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:35.960987 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:36.003613 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f874839-88de-4d90-b3c8-dadc18a447b3 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:36.041762 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634ebdd1-c263-4208-a358-1fa28aed0275 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:36.067666 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b04f62d-4566-46b4-817d-6d88f05524c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:36.068472 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b04f62d-4566-46b4-817d-6d88f05524c4 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:36.068753 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b04f62d-4566-46b4-817d-6d88f05524c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:36.069027 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b04f62d-4566-46b4-817d-6d88f05524c4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:36.089097 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b04f62d-4566-46b4-817d-6d88f05524c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:08:36.096824 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-7b04f62d-4566-46b4-817d-6d88f05524c4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 16:08:36.096824 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:08:36.096824 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:08:36.096824 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:08:36.096824 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:08:36.096824 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:08:36.096824 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:08:36.096824 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:08:36.096824 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:08:36.096824 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:08:36.096824 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:08:36.096824 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:08:36.096824 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:08:36.096824 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:08:36.096824 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:08:36.096824 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:08:36.097711 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:08:36.097711 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:08:36.097711 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:08:36.097711 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:08:36.097711 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:08:36.097711 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:08:36.097711 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:08:36.097711 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:08:36.097711 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:08:36.097711 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:08:36.097711 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:08:36.097711 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:08:36.097711 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:08:36.097711 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:08:36.097711 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:08:36.097711 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:08:36.098514 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:08:36.098514 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:08:36.098514 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:08:36.098514 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:08:36.098514 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:08:36.098514 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:08:36.098514 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:08:36.098514 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:08:36.098514 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:08:36.098514 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:08:36.098514 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 16:08:36.098514 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:08:36.098514 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 192/382] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 16:08:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:08:36.105158 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b04f62d-4566-46b4-817d-6d88f05524c4 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:36.118926 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecad60ce-f90b-4c4c-a0b6-e50ae2aa561b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:36.119963 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecad60ce-f90b-4c4c-a0b6-e50ae2aa561b None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:36.120538 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecad60ce-f90b-4c4c-a0b6-e50ae2aa561b None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:36.120947 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecad60ce-f90b-4c4c-a0b6-e50ae2aa561b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:36.121962 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecad60ce-f90b-4c4c-a0b6-e50ae2aa561b None admin] RBAC: Adding query filter params (group.id=3afd8aff1782409793dd982c8956d7e1, role.id=e04fe3eb1f714d74901ac83e33ea8a16, scope.project.id=793e0b7f54284522b67bc42f3a9f9fdd) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:36.122316 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecad60ce-f90b-4c4c-a0b6-e50ae2aa561b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:36.124180 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecad60ce-f90b-4c4c-a0b6-e50ae2aa561b None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:36.138560 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 191/383] 10.222.0.62 () {56 vars in 1376 bytes} [Fri May 27 16:08:35 2022] GET /identity/v3/role_assignments?group.id=3afd8aff1782409793dd982c8956d7e1&scope.project.id=793e0b7f54284522b67bc42f3a9f9fdd&role.id=e04fe3eb1f714d74901ac83e33ea8a16 => generated 260 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:36.235809 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:36.257712 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b04f62d-4566-46b4-817d-6d88f05524c4 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:36.297593 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df33ead1-3dc4-41e5-9f9d-c0147a14ca0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:36.298287 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df33ead1-3dc4-41e5-9f9d-c0147a14ca0e None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:36.298581 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df33ead1-3dc4-41e5-9f9d-c0147a14ca0e None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:36.298860 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df33ead1-3dc4-41e5-9f9d-c0147a14ca0e None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:36.299610 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df33ead1-3dc4-41e5-9f9d-c0147a14ca0e None admin] RBAC: Adding query filter params (name=member) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:36.299922 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df33ead1-3dc4-41e5-9f9d-c0147a14ca0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:36.301307 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df33ead1-3dc4-41e5-9f9d-c0147a14ca0e None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:36.314149 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 193/384] 10.222.0.62 () {56 vars in 1101 bytes} [Fri May 27 16:08:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:08:36.322477 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecad60ce-f90b-4c4c-a0b6-e50ae2aa561b None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:36.471542 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecad60ce-f90b-4c4c-a0b6-e50ae2aa561b None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:36.493081 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:36.511315 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdb42e8-8472-44ed-97dc-8d13c500d3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:36.512187 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb42e8-8472-44ed-97dc-8d13c500d3e1 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:36.512473 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb42e8-8472-44ed-97dc-8d13c500d3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:36.512759 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb42e8-8472-44ed-97dc-8d13c500d3e1 None admin] PATH_INFO: `/v3/groups/3c837d6f47aa437781641a4bedf6802e` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:36.513996 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdb42e8-8472-44ed-97dc-8d13c500d3e1 None admin] RBAC: Authorizing `identity:get_group(group_id=3c837d6f47aa437781641a4bedf6802e)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:36.515509 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdb42e8-8472-44ed-97dc-8d13c500d3e1 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:36.519560 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 192/385] 10.222.0.62 () {56 vars in 1180 bytes} [Fri May 27 16:08:36 2022] GET /identity/v3/groups/3c837d6f47aa437781641a4bedf6802e => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:36.523356 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df33ead1-3dc4-41e5-9f9d-c0147a14ca0e None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:36.655093 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df33ead1-3dc4-41e5-9f9d-c0147a14ca0e None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:36.697957 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0cec1b-4ba6-445f-b754-eac87a461a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:36.699203 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0cec1b-4ba6-445f-b754-eac87a461a70 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:36.699684 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0cec1b-4ba6-445f-b754-eac87a461a70 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:36.700190 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0cec1b-4ba6-445f-b754-eac87a461a70 None admin] PATH_INFO: `/v3/projects/d280b4797bdd4aabacba365ec82ca978` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:36.701575 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0cec1b-4ba6-445f-b754-eac87a461a70 None admin] RBAC: Authorizing `identity:get_project(project_id=d280b4797bdd4aabacba365ec82ca978)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:36.703277 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0cec1b-4ba6-445f-b754-eac87a461a70 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:36.705466 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 194/386] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 16:08:36 2022] GET /identity/v3/projects/d280b4797bdd4aabacba365ec82ca978 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:08:36.711288 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdb42e8-8472-44ed-97dc-8d13c500d3e1 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:36.830303 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdb42e8-8472-44ed-97dc-8d13c500d3e1 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:36.888670 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee001380-76e2-435b-9652-aecda7b56fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:36.889921 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee001380-76e2-435b-9652-aecda7b56fd7 None admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:36.890456 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee001380-76e2-435b-9652-aecda7b56fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:36.890927 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee001380-76e2-435b-9652-aecda7b56fd7 None admin] PATH_INFO: `/v3/projects/d280b4797bdd4aabacba365ec82ca978/groups/3c837d6f47aa437781641a4bedf6802e/roles/c8ce6d197f654598ac45f6016ecccabd` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:36.894564 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10a0da-0cdd-4cae-8703-c029e4a9b459 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:36.895080 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10a0da-0cdd-4cae-8703-c029e4a9b459 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:36.895546 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10a0da-0cdd-4cae-8703-c029e4a9b459 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:36.897093 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 195/387] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:08:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 16:08:36.899617 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee001380-76e2-435b-9652-aecda7b56fd7 None admin] RBAC: Authorizing `identity:create_grant(project_id=d280b4797bdd4aabacba365ec82ca978, group_id=3c837d6f47aa437781641a4bedf6802e, role_id=c8ce6d197f654598ac45f6016ecccabd)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:36.901275 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee001380-76e2-435b-9652-aecda7b56fd7 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:36.909041 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0bb81-b350-4828-b22f-2dea28d1e791 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:36.909335 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0bb81-b350-4828-b22f-2dea28d1e791 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:36.909615 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0bb81-b350-4828-b22f-2dea28d1e791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:36.935971 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-acc0bb81-b350-4828-b22f-2dea28d1e791 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:08:36.937154 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-acc0bb81-b350-4828-b22f-2dea28d1e791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:08:36.947228 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:37.018595 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 193/388] 10.222.0.62 () {58 vars in 1442 bytes} [Fri May 27 16:08:36 2022] PUT /identity/v3/projects/d280b4797bdd4aabacba365ec82ca978/groups/3c837d6f47aa437781641a4bedf6802e/roles/c8ce6d197f654598ac45f6016ecccabd => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:08:37.026203 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 196/389] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:08:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 16:08:37.053447 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee001380-76e2-435b-9652-aecda7b56fd7 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:37.107674 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:37.175480 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee001380-76e2-435b-9652-aecda7b56fd7 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:37.217895 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c8a46-fa1b-41f3-932c-2bc315518816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:37.218817 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c8a46-fa1b-41f3-932c-2bc315518816 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:37.219107 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c8a46-fa1b-41f3-932c-2bc315518816 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:37.219384 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c8a46-fa1b-41f3-932c-2bc315518816 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:37.232060 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033c8a46-fa1b-41f3-932c-2bc315518816 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:08:37.240413 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-033c8a46-fa1b-41f3-932c-2bc315518816 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 16:08:37.240413 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:08:37.240413 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:08:37.240413 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:08:37.240413 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:08:37.240413 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:08:37.240413 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:08:37.240413 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:08:37.240413 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:08:37.240413 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:08:37.240413 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:08:37.240413 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:08:37.240413 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:08:37.240413 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:08:37.240413 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:08:37.240413 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:08:37.241304 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:08:37.241304 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:08:37.241304 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:08:37.241304 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:08:37.241304 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:08:37.241304 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:08:37.241304 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:08:37.241304 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:08:37.241304 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:08:37.241304 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:08:37.241304 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:08:37.241304 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:08:37.241304 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:08:37.241304 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:08:37.241304 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:08:37.241304 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:08:37.242103 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:08:37.242103 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:08:37.242103 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:08:37.242103 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:08:37.242103 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:08:37.242103 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:08:37.242103 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:08:37.242103 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:08:37.242103 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:08:37.242103 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:08:37.242103 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 16:08:37.242103 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:08:37.242103 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 194/390] 10.222.0.62 () {56 vars in 1114 bytes} [Fri May 27 16:08:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:08:37.248980 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc0bb81-b350-4828-b22f-2dea28d1e791 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:37.363704 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc0bb81-b350-4828-b22f-2dea28d1e791 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:37.415122 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3f9f7b-a5e9-4154-a431-502894fc5b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:37.416226 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f9f7b-a5e9-4154-a431-502894fc5b35 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:37.416703 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f9f7b-a5e9-4154-a431-502894fc5b35 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:37.417168 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f9f7b-a5e9-4154-a431-502894fc5b35 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:37.418123 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3f9f7b-a5e9-4154-a431-502894fc5b35 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:37.418669 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3f9f7b-a5e9-4154-a431-502894fc5b35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:37.420243 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3f9f7b-a5e9-4154-a431-502894fc5b35 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:37.435134 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 197/391] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 16:08:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:37.440524 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c8a46-fa1b-41f3-932c-2bc315518816 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:37.565391 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c8a46-fa1b-41f3-932c-2bc315518816 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:37.574897 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:37.615026 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e92c94c-3e73-41fe-976c-7244c177d808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:37.616209 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e92c94c-3e73-41fe-976c-7244c177d808 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:37.616688 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e92c94c-3e73-41fe-976c-7244c177d808 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:37.617159 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e92c94c-3e73-41fe-976c-7244c177d808 None admin] PATH_INFO: `/v3/groups/3c837d6f47aa437781641a4bedf6802e` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:37.620111 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e92c94c-3e73-41fe-976c-7244c177d808 None admin] RBAC: Authorizing `identity:get_group(group_id=3c837d6f47aa437781641a4bedf6802e)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:37.621803 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e92c94c-3e73-41fe-976c-7244c177d808 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:37.623654 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 195/392] 10.222.0.62 () {56 vars in 1180 bytes} [Fri May 27 16:08:37 2022] GET /identity/v3/groups/3c837d6f47aa437781641a4bedf6802e => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:37.629257 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3f9f7b-a5e9-4154-a431-502894fc5b35 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:37.633444 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:37.705133 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d681d-ffdc-49f6-b899-0a36b3025ba9 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:37.705781 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d681d-ffdc-49f6-b899-0a36b3025ba9 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:37.706272 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d681d-ffdc-49f6-b899-0a36b3025ba9 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:37.707819 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 196/393] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:08:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 16:08:37.715522 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be2861d-cdc5-4d09-8392-a63a13c809e1 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:37.715813 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be2861d-cdc5-4d09-8392-a63a13c809e1 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:37.716096 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be2861d-cdc5-4d09-8392-a63a13c809e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:37.747262 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-8be2861d-cdc5-4d09-8392-a63a13c809e1 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:08:37.748763 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-8be2861d-cdc5-4d09-8392-a63a13c809e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:08:37.770886 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3f9f7b-a5e9-4154-a431-502894fc5b35 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:37.806392 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec627c5-e0d6-48c2-8d71-2525e56680a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:37.807782 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec627c5-e0d6-48c2-8d71-2525e56680a1 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:37.808261 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec627c5-e0d6-48c2-8d71-2525e56680a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:37.808776 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec627c5-e0d6-48c2-8d71-2525e56680a1 None admin] PATH_INFO: `/v3/projects/d280b4797bdd4aabacba365ec82ca978` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:37.810140 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec627c5-e0d6-48c2-8d71-2525e56680a1 None admin] RBAC: Authorizing `identity:get_project(project_id=d280b4797bdd4aabacba365ec82ca978)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:37.811845 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec627c5-e0d6-48c2-8d71-2525e56680a1 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:37.813854 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 198/394] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 16:08:37 2022] GET /identity/v3/projects/d280b4797bdd4aabacba365ec82ca978 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:37.822452 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec627c5-e0d6-48c2-8d71-2525e56680a1 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:37.853091 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 197/395] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:08:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:08:37.899790 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be2861d-cdc5-4d09-8392-a63a13c809e1 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:37.932710 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:37.972571 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec627c5-e0d6-48c2-8d71-2525e56680a1 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:38.015789 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f21514-42bd-4f65-9a4c-9f52749a2613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:38.016690 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f21514-42bd-4f65-9a4c-9f52749a2613 None admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:38.017088 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f21514-42bd-4f65-9a4c-9f52749a2613 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:38.017369 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f21514-42bd-4f65-9a4c-9f52749a2613 None admin] PATH_INFO: `/v3/projects/d280b4797bdd4aabacba365ec82ca978/groups/3c837d6f47aa437781641a4bedf6802e/roles/404d2ea20e7c4842892e5001133f1b93` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:38.021367 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f21514-42bd-4f65-9a4c-9f52749a2613 None admin] RBAC: Authorizing `identity:create_grant(project_id=d280b4797bdd4aabacba365ec82ca978, group_id=3c837d6f47aa437781641a4bedf6802e, role_id=404d2ea20e7c4842892e5001133f1b93)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:38.022864 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f21514-42bd-4f65-9a4c-9f52749a2613 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:38.070342 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be2861d-cdc5-4d09-8392-a63a13c809e1 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:38.073438 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:38.109340 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef44188b-ad5d-4de5-997f-5b53322861eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:38.110149 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44188b-ad5d-4de5-997f-5b53322861eb None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:38.110519 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44188b-ad5d-4de5-997f-5b53322861eb None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:38.110859 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44188b-ad5d-4de5-997f-5b53322861eb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:38.125091 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 199/396] 10.222.0.62 () {58 vars in 1442 bytes} [Fri May 27 16:08:37 2022] PUT /identity/v3/projects/d280b4797bdd4aabacba365ec82ca978/groups/3c837d6f47aa437781641a4bedf6802e/roles/404d2ea20e7c4842892e5001133f1b93 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:08:38.126084 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef44188b-ad5d-4de5-997f-5b53322861eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:08:38.137862 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-ef44188b-ad5d-4de5-997f-5b53322861eb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 16:08:38.137862 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:08:38.137862 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:08:38.137862 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:08:38.137862 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:08:38.137862 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:08:38.137862 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:08:38.137862 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:08:38.137862 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:08:38.137862 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:08:38.137862 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:08:38.137862 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:08:38.137862 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:08:38.137862 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:08:38.137862 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:08:38.137862 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:08:38.139803 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:08:38.139803 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:08:38.139803 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:08:38.139803 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:08:38.139803 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:08:38.139803 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:08:38.139803 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:08:38.139803 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:08:38.139803 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:08:38.139803 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:08:38.139803 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:08:38.139803 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:08:38.139803 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:08:38.139803 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:08:38.139803 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:08:38.139803 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:08:38.140607 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:08:38.140607 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:08:38.140607 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:08:38.140607 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:08:38.140607 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:08:38.140607 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:08:38.140607 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:08:38.140607 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:08:38.140607 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:08:38.140607 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:08:38.140607 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 16:08:38.140607 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:08:38.143970 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 198/397] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 16:08:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:08:38.145324 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f21514-42bd-4f65-9a4c-9f52749a2613 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:38.291703 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f21514-42bd-4f65-9a4c-9f52749a2613 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:38.326116 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:38.332005 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb40daa4-4c5b-4d2a-878b-7c24e8469ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:38.332692 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40daa4-4c5b-4d2a-878b-7c24e8469ce3 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:38.332974 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40daa4-4c5b-4d2a-878b-7c24e8469ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:38.333249 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40daa4-4c5b-4d2a-878b-7c24e8469ce3 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:38.334005 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb40daa4-4c5b-4d2a-878b-7c24e8469ce3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:38.334341 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb40daa4-4c5b-4d2a-878b-7c24e8469ce3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:38.335755 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb40daa4-4c5b-4d2a-878b-7c24e8469ce3 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:38.346924 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 200/398] 10.222.0.62 () {56 vars in 1101 bytes} [Fri May 27 16:08:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:38.353193 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef44188b-ad5d-4de5-997f-5b53322861eb None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:38.510674 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef44188b-ad5d-4de5-997f-5b53322861eb None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:38.567967 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87991ffc-4324-432b-a663-d0d1272213c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:38.568841 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87991ffc-4324-432b-a663-d0d1272213c1 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:38.569126 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87991ffc-4324-432b-a663-d0d1272213c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:38.569405 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87991ffc-4324-432b-a663-d0d1272213c1 None admin] PATH_INFO: `/v3/groups/3c837d6f47aa437781641a4bedf6802e` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:38.571050 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87991ffc-4324-432b-a663-d0d1272213c1 None admin] RBAC: Authorizing `identity:get_group(group_id=3c837d6f47aa437781641a4bedf6802e)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:38.572497 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87991ffc-4324-432b-a663-d0d1272213c1 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:38.575110 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 199/399] 10.222.0.62 () {56 vars in 1180 bytes} [Fri May 27 16:08:38 2022] GET /identity/v3/groups/3c837d6f47aa437781641a4bedf6802e => generated 226 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:38.579555 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb40daa4-4c5b-4d2a-878b-7c24e8469ce3 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:38.704551 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87319758-9498-47f0-9cba-03f9a64833c6 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:38.704892 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87319758-9498-47f0-9cba-03f9a64833c6 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:38.705117 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87319758-9498-47f0-9cba-03f9a64833c6 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:38.710347 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 200/400] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:08:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:08:38.719693 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8ff1a-0185-4015-a806-949aa397f43d None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:38.719985 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8ff1a-0185-4015-a806-949aa397f43d None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:38.720270 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8ff1a-0185-4015-a806-949aa397f43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:38.734120 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb40daa4-4c5b-4d2a-878b-7c24e8469ce3 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:38.763562 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-c7d8ff1a-0185-4015-a806-949aa397f43d None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:08:38.764700 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-c7d8ff1a-0185-4015-a806-949aa397f43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:08:38.777115 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c923a9-946b-46a4-b179-83185aae9dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:38.777328 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c923a9-946b-46a4-b179-83185aae9dff None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:38.777560 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c923a9-946b-46a4-b179-83185aae9dff None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:38.777817 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c923a9-946b-46a4-b179-83185aae9dff None admin] PATH_INFO: `/v3/projects/fe60851080e24e0db8e6af2ad2a17a54` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:38.779530 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c923a9-946b-46a4-b179-83185aae9dff None admin] RBAC: Authorizing `identity:get_project(project_id=fe60851080e24e0db8e6af2ad2a17a54)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:38.781009 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c923a9-946b-46a4-b179-83185aae9dff None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:38.783086 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 201/401] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 16:08:38 2022] GET /identity/v3/projects/fe60851080e24e0db8e6af2ad2a17a54 => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:38.796496 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c923a9-946b-46a4-b179-83185aae9dff None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:38.827860 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:38.867318 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:38.909773 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c923a9-946b-46a4-b179-83185aae9dff None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:38.950758 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f7361b-f9a6-4a82-9d7e-ec80dc2f3b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:38.951658 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f7361b-f9a6-4a82-9d7e-ec80dc2f3b2f None admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:38.951946 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f7361b-f9a6-4a82-9d7e-ec80dc2f3b2f None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:38.952227 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f7361b-f9a6-4a82-9d7e-ec80dc2f3b2f None admin] PATH_INFO: `/v3/projects/fe60851080e24e0db8e6af2ad2a17a54/groups/3c837d6f47aa437781641a4bedf6802e/roles/c8ce6d197f654598ac45f6016ecccabd` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:38.954635 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 201/402] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:08:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:08:38.960223 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f7361b-f9a6-4a82-9d7e-ec80dc2f3b2f None admin] RBAC: Authorizing `identity:create_grant(project_id=fe60851080e24e0db8e6af2ad2a17a54, group_id=3c837d6f47aa437781641a4bedf6802e, role_id=c8ce6d197f654598ac45f6016ecccabd)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:38.961806 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f7361b-f9a6-4a82-9d7e-ec80dc2f3b2f None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:38.976800 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d8ff1a-0185-4015-a806-949aa397f43d None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:39.067725 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 202/403] 10.222.0.62 () {58 vars in 1442 bytes} [Fri May 27 16:08:38 2022] PUT /identity/v3/projects/fe60851080e24e0db8e6af2ad2a17a54/groups/3c837d6f47aa437781641a4bedf6802e/roles/c8ce6d197f654598ac45f6016ecccabd => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:08:39.097145 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d8ff1a-0185-4015-a806-949aa397f43d None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:39.141610 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438dba67-1e60-4231-9f9c-de7a4e440eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:39.142865 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438dba67-1e60-4231-9f9c-de7a4e440eea None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:39.143346 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438dba67-1e60-4231-9f9c-de7a4e440eea None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:39.143842 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438dba67-1e60-4231-9f9c-de7a4e440eea None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:39.161767 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438dba67-1e60-4231-9f9c-de7a4e440eea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:08:39.171133 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-438dba67-1e60-4231-9f9c-de7a4e440eea None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 16:08:39.171133 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:08:39.171133 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:08:39.171133 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:08:39.171133 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:08:39.171133 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:08:39.171133 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:08:39.171133 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:08:39.171133 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:08:39.171133 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:08:39.171133 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:08:39.171133 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:08:39.171133 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:08:39.171133 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:08:39.171133 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:08:39.171133 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:08:39.172076 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:08:39.172076 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:08:39.172076 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:08:39.172076 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:08:39.172076 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:08:39.172076 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:08:39.172076 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:08:39.172076 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:08:39.172076 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:08:39.172076 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:08:39.172076 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:08:39.172076 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:08:39.172076 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:08:39.172076 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:08:39.172076 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:08:39.172076 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:08:39.172869 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:08:39.172869 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:08:39.172869 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:08:39.172869 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:08:39.172869 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:08:39.172869 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:08:39.172869 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:08:39.172869 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:08:39.172869 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:08:39.172869 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:08:39.172869 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 16:08:39.172869 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:08:39.175388 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 202/404] 10.222.0.62 () {56 vars in 1114 bytes} [Fri May 27 16:08:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:08:39.182024 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f7361b-f9a6-4a82-9d7e-ec80dc2f3b2f None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:39.241892 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31af3c4-c56c-4de7-9dd6-59667604ae02 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:39.242613 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31af3c4-c56c-4de7-9dd6-59667604ae02 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:39.243170 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31af3c4-c56c-4de7-9dd6-59667604ae02 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:39.245034 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 203/405] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:08:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 16:08:39.250635 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b70157-da34-4e1d-8ad0-abd0e24a903f None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:39.251185 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b70157-da34-4e1d-8ad0-abd0e24a903f None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:39.251682 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b70157-da34-4e1d-8ad0-abd0e24a903f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:39.269390 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-54b70157-da34-4e1d-8ad0-abd0e24a903f None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:08:39.271020 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-54b70157-da34-4e1d-8ad0-abd0e24a903f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:08:39.295065 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:39.359612 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f7361b-f9a6-4a82-9d7e-ec80dc2f3b2f None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:39.371346 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 204/406] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:08:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 16:08:39.386204 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:39.393851 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b70157-da34-4e1d-8ad0-abd0e24a903f None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:39.400701 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87bbb96-343e-4c9e-9944-1cb15d7b12de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:39.401640 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87bbb96-343e-4c9e-9944-1cb15d7b12de None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:39.402447 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87bbb96-343e-4c9e-9944-1cb15d7b12de None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:39.402958 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87bbb96-343e-4c9e-9944-1cb15d7b12de None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:39.403922 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87bbb96-343e-4c9e-9944-1cb15d7b12de None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:39.404504 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87bbb96-343e-4c9e-9944-1cb15d7b12de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:39.406371 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87bbb96-343e-4c9e-9944-1cb15d7b12de None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:39.416321 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 203/407] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 16:08:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:39.423798 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87bbb96-343e-4c9e-9944-1cb15d7b12de None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:39.557937 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b70157-da34-4e1d-8ad0-abd0e24a903f None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:39.559206 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87bbb96-343e-4c9e-9944-1cb15d7b12de None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:39.596431 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4678851-63f6-4684-aa87-84d798230994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:39.597742 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4678851-63f6-4684-aa87-84d798230994 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:39.598284 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4678851-63f6-4684-aa87-84d798230994 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:39.598756 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4678851-63f6-4684-aa87-84d798230994 None admin] PATH_INFO: `/v3/groups/3c837d6f47aa437781641a4bedf6802e` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:39.600143 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4678851-63f6-4684-aa87-84d798230994 None admin] RBAC: Authorizing `identity:get_group(group_id=3c837d6f47aa437781641a4bedf6802e)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:39.601805 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4678851-63f6-4684-aa87-84d798230994 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:39.603942 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 204/408] 10.222.0.62 () {56 vars in 1180 bytes} [Fri May 27 16:08:39 2022] GET /identity/v3/groups/3c837d6f47aa437781641a4bedf6802e => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:08:39.609336 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4678851-63f6-4684-aa87-84d798230994 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:39.633875 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122f8c99-65a4-4445-97a8-29793b1c8009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:39.635043 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f8c99-65a4-4445-97a8-29793b1c8009 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:39.635520 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f8c99-65a4-4445-97a8-29793b1c8009 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:39.636030 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f8c99-65a4-4445-97a8-29793b1c8009 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:39.660239 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122f8c99-65a4-4445-97a8-29793b1c8009 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:08:39.672514 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-122f8c99-65a4-4445-97a8-29793b1c8009 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:08:39.672514 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:08:39.672514 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:08:39.672514 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:08:39.672514 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:08:39.672514 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:08:39.672514 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:08:39.672514 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:08:39.672514 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:08:39.672514 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:08:39.672514 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:08:39.672514 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:08:39.672514 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:08:39.672514 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:08:39.672514 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:08:39.672514 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:08:39.673443 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:08:39.673443 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:08:39.673443 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:08:39.673443 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:08:39.673443 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:08:39.673443 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:08:39.673443 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:08:39.673443 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:08:39.673443 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:08:39.673443 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:08:39.673443 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:08:39.673443 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:08:39.673443 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:08:39.673443 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:08:39.673443 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:08:39.673443 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:08:39.674303 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:08:39.674303 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:08:39.674303 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:08:39.674303 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:08:39.674303 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:08:39.674303 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:08:39.674303 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:08:39.674303 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:08:39.674303 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:08:39.674303 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:08:39.674303 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:08:39.674303 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:08:39.680039 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 205/409] 10.222.0.62 () {56 vars in 1096 bytes} [Fri May 27 16:08:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:08:39.697849 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122f8c99-65a4-4445-97a8-29793b1c8009 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:39.714690 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:39.725595 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:39.764897 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4678851-63f6-4684-aa87-84d798230994 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:39.809440 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406837c3-860e-4293-88f8-74ce7bfd6b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:39.810347 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406837c3-860e-4293-88f8-74ce7bfd6b53 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:39.810634 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406837c3-860e-4293-88f8-74ce7bfd6b53 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:39.810915 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406837c3-860e-4293-88f8-74ce7bfd6b53 None admin] PATH_INFO: `/v3/projects/fe60851080e24e0db8e6af2ad2a17a54` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:39.812189 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406837c3-860e-4293-88f8-74ce7bfd6b53 None admin] RBAC: Authorizing `identity:get_project(project_id=fe60851080e24e0db8e6af2ad2a17a54)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:39.813741 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406837c3-860e-4293-88f8-74ce7bfd6b53 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:39.816374 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 205/410] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 16:08:39 2022] GET /identity/v3/projects/fe60851080e24e0db8e6af2ad2a17a54 => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:39.821789 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406837c3-860e-4293-88f8-74ce7bfd6b53 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:39.906392 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122f8c99-65a4-4445-97a8-29793b1c8009 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:39.941622 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6568dc28-a607-4d6b-ba9c-3996a67ee799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:39.942322 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6568dc28-a607-4d6b-ba9c-3996a67ee799 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:39.942614 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6568dc28-a607-4d6b-ba9c-3996a67ee799 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:39.942889 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6568dc28-a607-4d6b-ba9c-3996a67ee799 None admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:39.943633 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6568dc28-a607-4d6b-ba9c-3996a67ee799 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:39.943942 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6568dc28-a607-4d6b-ba9c-3996a67ee799 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:39.945311 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6568dc28-a607-4d6b-ba9c-3996a67ee799 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:39.954200 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 206/411] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 16:08:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:39.955602 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc48826c-5521-4cc5-ab25-947bd89d3a49 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:39.955891 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc48826c-5521-4cc5-ab25-947bd89d3a49 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:39.956172 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc48826c-5521-4cc5-ab25-947bd89d3a49 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:39.957537 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 207/412] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:08:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:08:39.962765 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc48826c-5521-4cc5-ab25-947bd89d3a49 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:39.968436 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406837c3-860e-4293-88f8-74ce7bfd6b53 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:39.989595 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:40.005961 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c165b0b-8ba8-46c8-b838-1ace58e21014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:40.006872 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c165b0b-8ba8-46c8-b838-1ace58e21014 None admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:40.007157 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c165b0b-8ba8-46c8-b838-1ace58e21014 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:40.007435 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c165b0b-8ba8-46c8-b838-1ace58e21014 None admin] PATH_INFO: `/v3/projects/fe60851080e24e0db8e6af2ad2a17a54/groups/3c837d6f47aa437781641a4bedf6802e/roles/404d2ea20e7c4842892e5001133f1b93` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:40.009936 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c165b0b-8ba8-46c8-b838-1ace58e21014 None admin] RBAC: Authorizing `identity:create_grant(project_id=fe60851080e24e0db8e6af2ad2a17a54, group_id=3c837d6f47aa437781641a4bedf6802e, role_id=404d2ea20e7c4842892e5001133f1b93)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:40.013312 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c165b0b-8ba8-46c8-b838-1ace58e21014 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:40.045985 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:40.071388 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc48826c-5521-4cc5-ab25-947bd89d3a49 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:40.105538 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f05fb3-06d6-4151-92d2-5c4ca2ee5328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:40.106732 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f05fb3-06d6-4151-92d2-5c4ca2ee5328 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:40.107025 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f05fb3-06d6-4151-92d2-5c4ca2ee5328 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:40.107304 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f05fb3-06d6-4151-92d2-5c4ca2ee5328 None admin] PATH_INFO: `/v3/groups/3afd8aff1782409793dd982c8956d7e1` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:40.108785 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f05fb3-06d6-4151-92d2-5c4ca2ee5328 None admin] RBAC: Authorizing `identity:get_group(group_id=3afd8aff1782409793dd982c8956d7e1)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:40.110229 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f05fb3-06d6-4151-92d2-5c4ca2ee5328 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:40.112239 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 208/413] 10.222.0.62 () {56 vars in 1180 bytes} [Fri May 27 16:08:39 2022] GET /identity/v3/groups/3afd8aff1782409793dd982c8956d7e1 => generated 229 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:40.113471 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8f2bc2-2095-4956-968d-57716af3dcba None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:40.113761 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8f2bc2-2095-4956-968d-57716af3dcba None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:40.114086 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8f2bc2-2095-4956-968d-57716af3dcba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:40.114655 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 206/414] 10.222.0.62 () {58 vars in 1442 bytes} [Fri May 27 16:08:39 2022] PUT /identity/v3/projects/fe60851080e24e0db8e6af2ad2a17a54/groups/3c837d6f47aa437781641a4bedf6802e/roles/404d2ea20e7c4842892e5001133f1b93 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:08:40.117846 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c165b0b-8ba8-46c8-b838-1ace58e21014 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:40.152986 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-bc8f2bc2-2095-4956-968d-57716af3dcba None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:08:40.156379 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-bc8f2bc2-2095-4956-968d-57716af3dcba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:08:40.281546 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 209/415] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:08:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:08:40.317080 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8f2bc2-2095-4956-968d-57716af3dcba None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:40.321831 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c165b0b-8ba8-46c8-b838-1ace58e21014 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:40.356636 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3890aacd-f750-4747-beab-f1585f4ee1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:40.357511 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890aacd-f750-4747-beab-f1585f4ee1cc None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:40.357791 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890aacd-f750-4747-beab-f1585f4ee1cc None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:40.358069 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890aacd-f750-4747-beab-f1585f4ee1cc None admin] PATH_INFO: `/v3/projects/793e0b7f54284522b67bc42f3a9f9fdd` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:40.359302 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3890aacd-f750-4747-beab-f1585f4ee1cc None admin] RBAC: Authorizing `identity:get_project(project_id=793e0b7f54284522b67bc42f3a9f9fdd)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:40.360751 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3890aacd-f750-4747-beab-f1585f4ee1cc None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:40.362828 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 207/416] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 16:08:40 2022] GET /identity/v3/projects/793e0b7f54284522b67bc42f3a9f9fdd => generated 344 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:40.368133 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3890aacd-f750-4747-beab-f1585f4ee1cc None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:40.402231 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:40.430640 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:40.435077 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8f2bc2-2095-4956-968d-57716af3dcba None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:40.477457 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dd2b8f-f193-4e1f-b003-efb3d22348b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:40.478389 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd2b8f-f193-4e1f-b003-efb3d22348b9 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:40.478753 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd2b8f-f193-4e1f-b003-efb3d22348b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:40.479133 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd2b8f-f193-4e1f-b003-efb3d22348b9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:40.482934 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3890aacd-f750-4747-beab-f1585f4ee1cc None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:40.490403 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dd2b8f-f193-4e1f-b003-efb3d22348b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:08:40.499275 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-d8dd2b8f-f193-4e1f-b003-efb3d22348b9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 16:08:40.499275 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:08:40.499275 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:08:40.499275 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:08:40.499275 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:08:40.499275 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:08:40.499275 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:08:40.499275 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:08:40.499275 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:08:40.499275 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:08:40.499275 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:08:40.499275 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:08:40.499275 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:08:40.499275 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:08:40.499275 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:08:40.499275 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:08:40.500376 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:08:40.500376 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:08:40.500376 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:08:40.500376 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:08:40.500376 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:08:40.500376 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:08:40.500376 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:08:40.500376 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:08:40.500376 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:08:40.500376 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:08:40.500376 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:08:40.500376 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:08:40.500376 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:08:40.500376 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:08:40.500376 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:08:40.500376 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:08:40.501170 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:08:40.501170 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:08:40.501170 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:08:40.501170 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:08:40.501170 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:08:40.501170 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:08:40.501170 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:08:40.501170 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:08:40.501170 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:08:40.501170 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:08:40.501170 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 16:08:40.501170 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:08:40.501889 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 210/417] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 16:08:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:08:40.511248 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dd2b8f-f193-4e1f-b003-efb3d22348b9 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:40.532693 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb060520-4c1c-4f3b-93ce-f3c4a59ea0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:40.533512 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb060520-4c1c-4f3b-93ce-f3c4a59ea0d6 None admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:40.533800 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb060520-4c1c-4f3b-93ce-f3c4a59ea0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:40.534084 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb060520-4c1c-4f3b-93ce-f3c4a59ea0d6 None admin] PATH_INFO: `/v3/projects/793e0b7f54284522b67bc42f3a9f9fdd/groups/3afd8aff1782409793dd982c8956d7e1/roles/e04fe3eb1f714d74901ac83e33ea8a16` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:40.536913 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb060520-4c1c-4f3b-93ce-f3c4a59ea0d6 None admin] RBAC: Authorizing `identity:create_grant(project_id=793e0b7f54284522b67bc42f3a9f9fdd, group_id=3afd8aff1782409793dd982c8956d7e1, role_id=e04fe3eb1f714d74901ac83e33ea8a16)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:40.538390 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb060520-4c1c-4f3b-93ce-f3c4a59ea0d6 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:40.622724 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 208/418] 10.222.0.62 () {58 vars in 1442 bytes} [Fri May 27 16:08:40 2022] PUT /identity/v3/projects/793e0b7f54284522b67bc42f3a9f9fdd/groups/3afd8aff1782409793dd982c8956d7e1/roles/e04fe3eb1f714d74901ac83e33ea8a16 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:08:40.642747 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dd2b8f-f193-4e1f-b003-efb3d22348b9 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:40.706170 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:40.710834 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c628a698-649b-4f9b-a6ca-0a3c30951a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:40.711599 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c628a698-649b-4f9b-a6ca-0a3c30951a92 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:40.711890 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c628a698-649b-4f9b-a6ca-0a3c30951a92 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:40.712170 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c628a698-649b-4f9b-a6ca-0a3c30951a92 None admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:40.718529 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c628a698-649b-4f9b-a6ca-0a3c30951a92 None admin] RBAC: Adding query filter params (name=member) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:40.718998 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c628a698-649b-4f9b-a6ca-0a3c30951a92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:40.720605 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c628a698-649b-4f9b-a6ca-0a3c30951a92 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:40.735405 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 211/419] 10.222.0.62 () {56 vars in 1101 bytes} [Fri May 27 16:08:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:40.741189 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb060520-4c1c-4f3b-93ce-f3c4a59ea0d6 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:40.915404 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb060520-4c1c-4f3b-93ce-f3c4a59ea0d6 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:40.925449 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:40.951991 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9f5738-94ad-4490-b980-c228dc256ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:40.952649 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f5738-94ad-4490-b980-c228dc256ddd None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:40.952936 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f5738-94ad-4490-b980-c228dc256ddd None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:40.953217 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f5738-94ad-4490-b980-c228dc256ddd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:40.980114 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48617169-6ac2-49e4-b75a-f859c6264408 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:40.980404 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48617169-6ac2-49e4-b75a-f859c6264408 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:40.980679 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48617169-6ac2-49e4-b75a-f859c6264408 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:40.982234 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 212/420] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:08:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 16:08:40.987462 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa21761-a385-40d8-9fff-ae01b1e796c2 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:40.987745 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa21761-a385-40d8-9fff-ae01b1e796c2 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:40.988023 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa21761-a385-40d8-9fff-ae01b1e796c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:41.009920 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-6aa21761-a385-40d8-9fff-ae01b1e796c2 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:08:41.011516 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-6aa21761-a385-40d8-9fff-ae01b1e796c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:08:41.064543 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9f5738-94ad-4490-b980-c228dc256ddd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:41.066027 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9f5738-94ad-4490-b980-c228dc256ddd None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:41.132700 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 213/421] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:08:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:08:41.219754 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa21761-a385-40d8-9fff-ae01b1e796c2 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:41.249050 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 209/422] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 16:08:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 16:08:41.253296 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9f5738-94ad-4490-b980-c228dc256ddd None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:41.263443 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:41.362295 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9f5738-94ad-4490-b980-c228dc256ddd None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:41.391158 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1cac0f-a0d2-4bdb-8cd8-3aa88df99ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:41.391887 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1cac0f-a0d2-4bdb-8cd8-3aa88df99ac8 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:41.392168 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1cac0f-a0d2-4bdb-8cd8-3aa88df99ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:41.392443 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1cac0f-a0d2-4bdb-8cd8-3aa88df99ac8 None admin] PATH_INFO: `/v3/projects/d280b4797bdd4aabacba365ec82ca978` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:41.393623 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1cac0f-a0d2-4bdb-8cd8-3aa88df99ac8 None admin] RBAC: Authorizing `identity:get_project(project_id=d280b4797bdd4aabacba365ec82ca978)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:41.395102 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1cac0f-a0d2-4bdb-8cd8-3aa88df99ac8 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:41.397161 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 210/423] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 16:08:41 2022] GET /identity/v3/projects/d280b4797bdd4aabacba365ec82ca978 => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:41.405463 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1cac0f-a0d2-4bdb-8cd8-3aa88df99ac8 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:41.410139 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa21761-a385-40d8-9fff-ae01b1e796c2 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:41.463471 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:41.510961 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45863ef1-7b58-42fb-88af-8ac980c9ba94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:41.511794 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45863ef1-7b58-42fb-88af-8ac980c9ba94 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:41.512080 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45863ef1-7b58-42fb-88af-8ac980c9ba94 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:41.512363 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45863ef1-7b58-42fb-88af-8ac980c9ba94 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:41.512573 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:41.524001 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1cac0f-a0d2-4bdb-8cd8-3aa88df99ac8 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:41.541350 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45863ef1-7b58-42fb-88af-8ac980c9ba94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:08:41.549823 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-45863ef1-7b58-42fb-88af-8ac980c9ba94 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 16:08:41.549823 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:08:41.549823 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:08:41.549823 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:08:41.549823 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:08:41.549823 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:08:41.549823 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:08:41.549823 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:08:41.549823 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:08:41.549823 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:08:41.549823 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:08:41.549823 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:08:41.549823 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:08:41.549823 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:08:41.549823 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:08:41.549823 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:08:41.550836 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:08:41.550836 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:08:41.550836 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:08:41.550836 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:08:41.550836 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:08:41.550836 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:08:41.550836 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:08:41.550836 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:08:41.550836 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:08:41.550836 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:08:41.550836 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:08:41.550836 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:08:41.550836 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:08:41.550836 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:08:41.550836 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:08:41.550836 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:08:41.551651 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:08:41.551651 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:08:41.551651 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:08:41.551651 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:08:41.551651 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:08:41.551651 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:08:41.551651 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:08:41.551651 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:08:41.551651 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:08:41.551651 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:08:41.551651 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 16:08:41.551651 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:08:41.561818 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 214/424] 10.222.0.62 () {56 vars in 1114 bytes} [Fri May 27 16:08:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:08:41.563962 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd060ab-2830-4fd5-a946-055cb61b2efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:41.565001 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd060ab-2830-4fd5-a946-055cb61b2efb None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:41.565427 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd060ab-2830-4fd5-a946-055cb61b2efb None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:41.565841 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd060ab-2830-4fd5-a946-055cb61b2efb None admin] PATH_INFO: `/v3/groups/3c837d6f47aa437781641a4bedf6802e` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:41.567397 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd060ab-2830-4fd5-a946-055cb61b2efb None admin] RBAC: Authorizing `identity:get_group(group_id=3c837d6f47aa437781641a4bedf6802e)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:41.567696 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45863ef1-7b58-42fb-88af-8ac980c9ba94 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:41.569153 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd060ab-2830-4fd5-a946-055cb61b2efb None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:41.571725 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 211/425] 10.222.0.62 () {56 vars in 1180 bytes} [Fri May 27 16:08:41 2022] GET /identity/v3/groups/3c837d6f47aa437781641a4bedf6802e => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:41.583501 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd060ab-2830-4fd5-a946-055cb61b2efb None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:41.680567 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45863ef1-7b58-42fb-88af-8ac980c9ba94 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:41.715527 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3519587-839a-48ce-b7a1-07f233731624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:41.716200 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3519587-839a-48ce-b7a1-07f233731624 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:41.716482 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3519587-839a-48ce-b7a1-07f233731624 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:41.716756 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3519587-839a-48ce-b7a1-07f233731624 None admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:41.717503 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3519587-839a-48ce-b7a1-07f233731624 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:41.717811 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3519587-839a-48ce-b7a1-07f233731624 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:41.719222 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3519587-839a-48ce-b7a1-07f233731624 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:41.728026 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 215/426] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 16:08:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:41.733408 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3519587-839a-48ce-b7a1-07f233731624 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:41.783051 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:41.847254 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3519587-839a-48ce-b7a1-07f233731624 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:41.866217 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd060ab-2830-4fd5-a946-055cb61b2efb None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:41.890614 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a6740-ed54-44f1-8973-64cac25532ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:41.891590 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a6740-ed54-44f1-8973-64cac25532ec None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:41.892055 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a6740-ed54-44f1-8973-64cac25532ec None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:41.892481 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a6740-ed54-44f1-8973-64cac25532ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:41.907398 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9af60bd-d920-495a-b169-0ee2968094c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:41.908067 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af60bd-d920-495a-b169-0ee2968094c9 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:41.908352 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af60bd-d920-495a-b169-0ee2968094c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:41.908630 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af60bd-d920-495a-b169-0ee2968094c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:41.909625 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9af60bd-d920-495a-b169-0ee2968094c9 None admin] RBAC: Adding query filter params (group.id=3c837d6f47aa437781641a4bedf6802e, role.id=c8ce6d197f654598ac45f6016ecccabd, scope.project.id=d280b4797bdd4aabacba365ec82ca978) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:41.909939 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9af60bd-d920-495a-b169-0ee2968094c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:41.912086 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9af60bd-d920-495a-b169-0ee2968094c9 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:41.924152 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 212/427] 10.222.0.62 () {56 vars in 1376 bytes} [Fri May 27 16:08:41 2022] GET /identity/v3/role_assignments?group.id=3c837d6f47aa437781641a4bedf6802e&scope.project.id=d280b4797bdd4aabacba365ec82ca978&role.id=c8ce6d197f654598ac45f6016ecccabd => generated 611 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:41.925808 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d43d8c-708a-4a52-818e-976677cdb948 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:41.926262 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d43d8c-708a-4a52-818e-976677cdb948 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:41.926742 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d43d8c-708a-4a52-818e-976677cdb948 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:41.928776 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 213/428] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:08:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:08:41.939919 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3724bd-9fe3-4296-83fb-352af8e148dd None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:41.940560 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3724bd-9fe3-4296-83fb-352af8e148dd None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:41.941047 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3724bd-9fe3-4296-83fb-352af8e148dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:41.967313 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-2c3724bd-9fe3-4296-83fb-352af8e148dd None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:08:41.970082 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-2c3724bd-9fe3-4296-83fb-352af8e148dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:08:41.975926 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:42.002118 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18a6740-ed54-44f1-8973-64cac25532ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:42.003652 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18a6740-ed54-44f1-8973-64cac25532ec None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:42.102635 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:42.128583 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 214/429] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:08:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:08:42.157964 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3724bd-9fe3-4296-83fb-352af8e148dd None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:42.174827 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 216/430] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 16:08:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 16:08:42.183200 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a6740-ed54-44f1-8973-64cac25532ec None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:42.290298 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3724bd-9fe3-4296-83fb-352af8e148dd None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:42.309092 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a6740-ed54-44f1-8973-64cac25532ec None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:42.331800 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf80fc1-f94a-4b9b-bcc5-f1412bcdf3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:42.332614 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf80fc1-f94a-4b9b-bcc5-f1412bcdf3e1 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:42.332897 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf80fc1-f94a-4b9b-bcc5-f1412bcdf3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:42.333174 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf80fc1-f94a-4b9b-bcc5-f1412bcdf3e1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:42.340757 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:42.346817 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf80fc1-f94a-4b9b-bcc5-f1412bcdf3e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:08:42.355266 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-bcf80fc1-f94a-4b9b-bcc5-f1412bcdf3e1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 16:08:42.355266 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:08:42.355266 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:08:42.355266 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:08:42.355266 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:08:42.355266 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:08:42.355266 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:08:42.355266 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:08:42.355266 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:08:42.355266 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:08:42.355266 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:08:42.355266 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:08:42.355266 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:08:42.355266 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:08:42.355266 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:08:42.355266 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:08:42.356517 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:08:42.356517 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:08:42.356517 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:08:42.356517 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:08:42.356517 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:08:42.356517 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:08:42.356517 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:08:42.356517 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:08:42.356517 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:08:42.356517 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:08:42.356517 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:08:42.356517 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:08:42.356517 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:08:42.356517 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:08:42.356517 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:08:42.356517 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:08:42.357330 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:08:42.357330 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:08:42.357330 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:08:42.357330 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:08:42.357330 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:08:42.357330 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:08:42.357330 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:08:42.357330 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:08:42.357330 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:08:42.357330 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:08:42.357330 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 16:08:42.357330 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:08:42.357330 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 215/431] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 16:08:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:08:42.363040 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c31cd8a-face-4f82-9c41-b60eb8adde8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:42.363935 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31cd8a-face-4f82-9c41-b60eb8adde8c None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:42.364226 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31cd8a-face-4f82-9c41-b60eb8adde8c None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:42.364511 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31cd8a-face-4f82-9c41-b60eb8adde8c None admin] PATH_INFO: `/v3/projects/d280b4797bdd4aabacba365ec82ca978` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:42.366502 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c31cd8a-face-4f82-9c41-b60eb8adde8c None admin] RBAC: Authorizing `identity:get_project(project_id=d280b4797bdd4aabacba365ec82ca978)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:42.366931 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf80fc1-f94a-4b9b-bcc5-f1412bcdf3e1 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:42.368569 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c31cd8a-face-4f82-9c41-b60eb8adde8c None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:42.370572 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 217/432] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 16:08:42 2022] GET /identity/v3/projects/d280b4797bdd4aabacba365ec82ca978 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:08:42.377007 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c31cd8a-face-4f82-9c41-b60eb8adde8c None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:42.396352 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:42.500016 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf80fc1-f94a-4b9b-bcc5-f1412bcdf3e1 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:42.505245 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c31cd8a-face-4f82-9c41-b60eb8adde8c None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:42.541215 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91484a2-94c0-4390-8de7-a74912f0c94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:42.541734 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91484a2-94c0-4390-8de7-a74912f0c94a None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:42.542025 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91484a2-94c0-4390-8de7-a74912f0c94a None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:42.542331 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91484a2-94c0-4390-8de7-a74912f0c94a None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:42.543208 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91484a2-94c0-4390-8de7-a74912f0c94a None admin] RBAC: Adding query filter params (name=member) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:42.543528 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91484a2-94c0-4390-8de7-a74912f0c94a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:42.544907 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91484a2-94c0-4390-8de7-a74912f0c94a None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:42.546949 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bd9f61-d4e4-4ef5-b12e-967ddd73e262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:42.548075 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd9f61-d4e4-4ef5-b12e-967ddd73e262 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:42.548565 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd9f61-d4e4-4ef5-b12e-967ddd73e262 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:42.549037 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd9f61-d4e4-4ef5-b12e-967ddd73e262 None admin] PATH_INFO: `/v3/groups/3c837d6f47aa437781641a4bedf6802e` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:42.550937 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bd9f61-d4e4-4ef5-b12e-967ddd73e262 None admin] RBAC: Authorizing `identity:get_group(group_id=3c837d6f47aa437781641a4bedf6802e)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:42.552856 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bd9f61-d4e4-4ef5-b12e-967ddd73e262 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:42.555635 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 218/433] 10.222.0.62 () {56 vars in 1180 bytes} [Fri May 27 16:08:42 2022] GET /identity/v3/groups/3c837d6f47aa437781641a4bedf6802e => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:08:42.555862 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 216/434] 10.222.0.62 () {56 vars in 1101 bytes} [Fri May 27 16:08:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:08:42.560972 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91484a2-94c0-4390-8de7-a74912f0c94a None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:42.563027 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bd9f61-d4e4-4ef5-b12e-967ddd73e262 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:42.627219 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:42.672233 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:42.681657 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91484a2-94c0-4390-8de7-a74912f0c94a None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:42.695062 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bd9f61-d4e4-4ef5-b12e-967ddd73e262 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:42.729480 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516f76da-9c35-4d81-a681-2dbeb38ce156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:42.731615 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f76da-9c35-4d81-a681-2dbeb38ce156 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:42.731919 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f76da-9c35-4d81-a681-2dbeb38ce156 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:42.732199 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f76da-9c35-4d81-a681-2dbeb38ce156 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:42.743708 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47937b23-782a-4a9e-98d7-9dfdd1a51d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:42.744750 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47937b23-782a-4a9e-98d7-9dfdd1a51d76 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:42.745260 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47937b23-782a-4a9e-98d7-9dfdd1a51d76 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:42.745740 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47937b23-782a-4a9e-98d7-9dfdd1a51d76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:42.746875 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47937b23-782a-4a9e-98d7-9dfdd1a51d76 None admin] RBAC: Adding query filter params (group.id=3c837d6f47aa437781641a4bedf6802e, role.id=404d2ea20e7c4842892e5001133f1b93, scope.project.id=d280b4797bdd4aabacba365ec82ca978) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:42.747546 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47937b23-782a-4a9e-98d7-9dfdd1a51d76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:42.749210 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47937b23-782a-4a9e-98d7-9dfdd1a51d76 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:42.758875 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 219/435] 10.222.0.62 () {56 vars in 1376 bytes} [Fri May 27 16:08:42 2022] GET /identity/v3/role_assignments?group.id=3c837d6f47aa437781641a4bedf6802e&scope.project.id=d280b4797bdd4aabacba365ec82ca978&role.id=404d2ea20e7c4842892e5001133f1b93 => generated 611 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:08:42.760548 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5419c7-075f-4b0d-a3eb-83a86d6b96ce None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:42.761061 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5419c7-075f-4b0d-a3eb-83a86d6b96ce None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:42.761542 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5419c7-075f-4b0d-a3eb-83a86d6b96ce None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:42.763553 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 220/436] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:08:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:08:42.769139 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a230081-a62c-4f4f-b241-eaf039721adc None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:42.769647 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a230081-a62c-4f4f-b241-eaf039721adc None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:42.770066 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a230081-a62c-4f4f-b241-eaf039721adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:42.791196 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-8a230081-a62c-4f4f-b241-eaf039721adc None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:08:42.792810 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-8a230081-a62c-4f4f-b241-eaf039721adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:08:42.825903 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516f76da-9c35-4d81-a681-2dbeb38ce156 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:42.827748 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516f76da-9c35-4d81-a681-2dbeb38ce156 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:42.888710 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 221/437] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:08:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:08:42.913182 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a230081-a62c-4f4f-b241-eaf039721adc None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:42.919606 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:42.967905 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 217/438] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 16:08:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 16:08:42.973356 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516f76da-9c35-4d81-a681-2dbeb38ce156 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:43.000649 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:43.027020 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a230081-a62c-4f4f-b241-eaf039721adc None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:43.073400 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a357ce40-e5a6-46d5-bbcb-1b48951f7f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:43.074216 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a357ce40-e5a6-46d5-bbcb-1b48951f7f83 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:43.074964 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a357ce40-e5a6-46d5-bbcb-1b48951f7f83 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:43.075244 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a357ce40-e5a6-46d5-bbcb-1b48951f7f83 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:43.091217 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a357ce40-e5a6-46d5-bbcb-1b48951f7f83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:08:43.106605 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-a357ce40-e5a6-46d5-bbcb-1b48951f7f83 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 16:08:43.106605 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:08:43.106605 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:08:43.106605 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:08:43.106605 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:08:43.106605 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:08:43.106605 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:08:43.106605 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:08:43.106605 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:08:43.106605 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:08:43.106605 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:08:43.106605 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:08:43.106605 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:08:43.106605 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:08:43.106605 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:08:43.106605 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:08:43.107578 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:08:43.107578 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:08:43.107578 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:08:43.107578 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:08:43.107578 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:08:43.107578 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:08:43.107578 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:08:43.107578 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:08:43.107578 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:08:43.107578 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:08:43.107578 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:08:43.107578 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:08:43.107578 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:08:43.107578 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:08:43.107578 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:08:43.107578 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:08:43.108383 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:08:43.108383 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:08:43.108383 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:08:43.108383 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:08:43.108383 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:08:43.108383 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:08:43.108383 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:08:43.108383 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:08:43.108383 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:08:43.108383 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:08:43.108383 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 16:08:43.108383 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:08:43.108996 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516f76da-9c35-4d81-a681-2dbeb38ce156 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:43.116038 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 222/439] 10.222.0.62 () {56 vars in 1114 bytes} [Fri May 27 16:08:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:08:43.117431 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a357ce40-e5a6-46d5-bbcb-1b48951f7f83 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:43.157445 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d006730-a0af-4cee-bce5-1d74ecb79e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:43.158474 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d006730-a0af-4cee-bce5-1d74ecb79e4f None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:43.158763 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d006730-a0af-4cee-bce5-1d74ecb79e4f None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:43.159039 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d006730-a0af-4cee-bce5-1d74ecb79e4f None admin] PATH_INFO: `/v3/projects/fe60851080e24e0db8e6af2ad2a17a54` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:43.160347 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d006730-a0af-4cee-bce5-1d74ecb79e4f None admin] RBAC: Authorizing `identity:get_project(project_id=fe60851080e24e0db8e6af2ad2a17a54)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:43.161825 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d006730-a0af-4cee-bce5-1d74ecb79e4f None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:43.164011 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 218/440] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 16:08:42 2022] GET /identity/v3/projects/fe60851080e24e0db8e6af2ad2a17a54 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:08:43.169320 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d006730-a0af-4cee-bce5-1d74ecb79e4f None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:43.203745 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:43.240506 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a357ce40-e5a6-46d5-bbcb-1b48951f7f83 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:43.281866 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6225b34b-588b-4664-9be1-ac5069af35b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:43.282603 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225b34b-588b-4664-9be1-ac5069af35b1 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:43.282892 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225b34b-588b-4664-9be1-ac5069af35b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:43.283173 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225b34b-588b-4664-9be1-ac5069af35b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:43.283938 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6225b34b-588b-4664-9be1-ac5069af35b1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:43.284252 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6225b34b-588b-4664-9be1-ac5069af35b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:43.285645 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6225b34b-588b-4664-9be1-ac5069af35b1 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:43.288099 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:43.295856 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 223/441] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 16:08:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:43.299871 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d006730-a0af-4cee-bce5-1d74ecb79e4f None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:43.301465 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6225b34b-588b-4664-9be1-ac5069af35b1 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:43.337266 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f443e-14e0-4e15-a48c-36f14db15792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:43.338048 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f443e-14e0-4e15-a48c-36f14db15792 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:43.338369 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f443e-14e0-4e15-a48c-36f14db15792 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:43.338649 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f443e-14e0-4e15-a48c-36f14db15792 None admin] PATH_INFO: `/v3/groups/3c837d6f47aa437781641a4bedf6802e` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:43.339849 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0f443e-14e0-4e15-a48c-36f14db15792 None admin] RBAC: Authorizing `identity:get_group(group_id=3c837d6f47aa437781641a4bedf6802e)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:43.341295 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0f443e-14e0-4e15-a48c-36f14db15792 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:43.342948 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 219/442] 10.222.0.62 () {56 vars in 1180 bytes} [Fri May 27 16:08:43 2022] GET /identity/v3/groups/3c837d6f47aa437781641a4bedf6802e => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:08:43.344115 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46e714-5998-47cd-8e08-0a02f661454e None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:43.344401 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46e714-5998-47cd-8e08-0a02f661454e None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:43.344683 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46e714-5998-47cd-8e08-0a02f661454e None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:43.345896 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 220/443] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:08:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:08:43.348681 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce46e714-5998-47cd-8e08-0a02f661454e None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:43.406951 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6225b34b-588b-4664-9be1-ac5069af35b1 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:43.441011 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6936d736-acdb-4e66-9629-469c2ce68a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:43.441669 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936d736-acdb-4e66-9629-469c2ce68a56 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:43.441954 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936d736-acdb-4e66-9629-469c2ce68a56 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:43.442232 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936d736-acdb-4e66-9629-469c2ce68a56 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:43.443448 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:43.451508 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce46e714-5998-47cd-8e08-0a02f661454e None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:43.486613 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0903e43d-7823-4b6a-80f5-99ce292bcd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:43.487277 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0903e43d-7823-4b6a-80f5-99ce292bcd85 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:43.487567 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0903e43d-7823-4b6a-80f5-99ce292bcd85 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:43.487847 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0903e43d-7823-4b6a-80f5-99ce292bcd85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:43.488684 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0903e43d-7823-4b6a-80f5-99ce292bcd85 None admin] RBAC: Adding query filter params (group.id=3c837d6f47aa437781641a4bedf6802e, role.id=c8ce6d197f654598ac45f6016ecccabd, scope.project.id=fe60851080e24e0db8e6af2ad2a17a54) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:43.489003 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0903e43d-7823-4b6a-80f5-99ce292bcd85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:43.490482 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0903e43d-7823-4b6a-80f5-99ce292bcd85 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:43.497038 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 221/444] 10.222.0.62 () {56 vars in 1376 bytes} [Fri May 27 16:08:43 2022] GET /identity/v3/role_assignments?group.id=3c837d6f47aa437781641a4bedf6802e&scope.project.id=fe60851080e24e0db8e6af2ad2a17a54&role.id=c8ce6d197f654598ac45f6016ecccabd => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:08:43.500395 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4f407c-d5bd-4423-950a-655cc33aca48 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:43.500682 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4f407c-d5bd-4423-950a-655cc33aca48 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:43.500955 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4f407c-d5bd-4423-950a-655cc33aca48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:43.519634 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-fa4f407c-d5bd-4423-950a-655cc33aca48 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:08:43.520603 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:43.521047 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-fa4f407c-d5bd-4423-950a-655cc33aca48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:08:43.524623 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6936d736-acdb-4e66-9629-469c2ce68a56 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:43.526102 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6936d736-acdb-4e66-9629-469c2ce68a56 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:43.600508 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 222/445] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:08:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:08:43.624551 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4f407c-d5bd-4423-950a-655cc33aca48 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:43.636665 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 224/446] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 16:08:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 27 16:08:43.642348 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6936d736-acdb-4e66-9629-469c2ce68a56 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:43.735332 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:43.746494 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4f407c-d5bd-4423-950a-655cc33aca48 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:43.754871 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:43.760314 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6936d736-acdb-4e66-9629-469c2ce68a56 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:43.788110 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db63242-1269-4025-9367-db3664d85fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:43.788942 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db63242-1269-4025-9367-db3664d85fec None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:43.789798 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db63242-1269-4025-9367-db3664d85fec None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:43.790211 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db63242-1269-4025-9367-db3664d85fec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:43.804082 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90834e7-739c-4b9e-95cc-09b6e69d9462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:43.805355 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90834e7-739c-4b9e-95cc-09b6e69d9462 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:43.805636 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90834e7-739c-4b9e-95cc-09b6e69d9462 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:43.805909 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90834e7-739c-4b9e-95cc-09b6e69d9462 None admin] PATH_INFO: `/v3/projects/fe60851080e24e0db8e6af2ad2a17a54` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:43.806839 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db63242-1269-4025-9367-db3664d85fec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:08:43.808032 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90834e7-739c-4b9e-95cc-09b6e69d9462 None admin] RBAC: Authorizing `identity:get_project(project_id=fe60851080e24e0db8e6af2ad2a17a54)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:43.809489 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90834e7-739c-4b9e-95cc-09b6e69d9462 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:43.811397 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 225/447] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 16:08:43 2022] GET /identity/v3/projects/fe60851080e24e0db8e6af2ad2a17a54 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:08:43.815095 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-4db63242-1269-4025-9367-db3664d85fec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:08:43.815095 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:08:43.815095 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:08:43.815095 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:08:43.815095 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:08:43.815095 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:08:43.815095 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:08:43.815095 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:08:43.815095 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:08:43.815095 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:08:43.815095 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:08:43.815095 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:08:43.815095 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:08:43.815095 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:08:43.815095 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:08:43.815095 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:08:43.816019 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:08:43.816019 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:08:43.816019 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:08:43.816019 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:08:43.816019 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:08:43.816019 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:08:43.816019 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:08:43.816019 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:08:43.816019 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:08:43.816019 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:08:43.816019 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:08:43.816019 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:08:43.816019 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:08:43.816019 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:08:43.816019 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:08:43.816019 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:08:43.816806 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:08:43.816806 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:08:43.816806 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:08:43.816806 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:08:43.816806 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:08:43.816806 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:08:43.816806 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:08:43.816806 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:08:43.816806 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:08:43.816806 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:08:43.816806 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:08:43.816806 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:08:43.816806 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 223/448] 10.222.0.62 () {56 vars in 1096 bytes} [Fri May 27 16:08:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:08:43.817474 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90834e7-739c-4b9e-95cc-09b6e69d9462 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:43.822242 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db63242-1269-4025-9367-db3664d85fec None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:43.933153 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db63242-1269-4025-9367-db3664d85fec None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:43.939298 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90834e7-739c-4b9e-95cc-09b6e69d9462 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:43.966974 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc59377a-5f91-47b8-a376-7eb1481e945d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:43.967837 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc59377a-5f91-47b8-a376-7eb1481e945d None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:43.968130 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc59377a-5f91-47b8-a376-7eb1481e945d None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:43.968409 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc59377a-5f91-47b8-a376-7eb1481e945d None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:43.969151 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc59377a-5f91-47b8-a376-7eb1481e945d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:43.969463 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc59377a-5f91-47b8-a376-7eb1481e945d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:43.970894 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc59377a-5f91-47b8-a376-7eb1481e945d None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:43.973212 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21d651e-e3b7-4786-a9ea-9be9f84c46a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:43.974057 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d651e-e3b7-4786-a9ea-9be9f84c46a3 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:43.974374 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d651e-e3b7-4786-a9ea-9be9f84c46a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:43.974654 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d651e-e3b7-4786-a9ea-9be9f84c46a3 None admin] PATH_INFO: `/v3/groups/3c837d6f47aa437781641a4bedf6802e` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:43.975812 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21d651e-e3b7-4786-a9ea-9be9f84c46a3 None admin] RBAC: Authorizing `identity:get_group(group_id=3c837d6f47aa437781641a4bedf6802e)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:43.977358 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21d651e-e3b7-4786-a9ea-9be9f84c46a3 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:43.979145 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 224/450] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 16:08:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:08:43.979254 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 226/450] 10.222.0.62 () {56 vars in 1180 bytes} [Fri May 27 16:08:43 2022] GET /identity/v3/groups/3c837d6f47aa437781641a4bedf6802e => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:08:43.984445 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc59377a-5f91-47b8-a376-7eb1481e945d None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:43.984568 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21d651e-e3b7-4786-a9ea-9be9f84c46a3 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:43.998966 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:44.018067 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:44.082511 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc59377a-5f91-47b8-a376-7eb1481e945d None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:44.086613 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21d651e-e3b7-4786-a9ea-9be9f84c46a3 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:44.116861 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dccdf8d-072c-48ef-b894-475ae4e69585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:44.118099 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dccdf8d-072c-48ef-b894-475ae4e69585 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:44.118466 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dccdf8d-072c-48ef-b894-475ae4e69585 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:44.118700 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dccdf8d-072c-48ef-b894-475ae4e69585 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:44.120351 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b340337-2b3f-481e-a411-f2d3204d28b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:44.121011 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b340337-2b3f-481e-a411-f2d3204d28b2 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:44.121293 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b340337-2b3f-481e-a411-f2d3204d28b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:44.121567 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b340337-2b3f-481e-a411-f2d3204d28b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:44.122427 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b340337-2b3f-481e-a411-f2d3204d28b2 None admin] RBAC: Adding query filter params (group.id=3c837d6f47aa437781641a4bedf6802e, role.id=404d2ea20e7c4842892e5001133f1b93, scope.project.id=fe60851080e24e0db8e6af2ad2a17a54) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:44.122738 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b340337-2b3f-481e-a411-f2d3204d28b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:44.124184 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b340337-2b3f-481e-a411-f2d3204d28b2 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:44.130483 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 227/451] 10.222.0.62 () {56 vars in 1376 bytes} [Fri May 27 16:08:43 2022] GET /identity/v3/role_assignments?group.id=3c837d6f47aa437781641a4bedf6802e&scope.project.id=fe60851080e24e0db8e6af2ad2a17a54&role.id=404d2ea20e7c4842892e5001133f1b93 => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:08:44.205742 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dccdf8d-072c-48ef-b894-475ae4e69585 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:44.207274 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dccdf8d-072c-48ef-b894-475ae4e69585 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:44.223034 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:44.312345 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 225/452] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 16:08:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 16:08:44.318039 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b340337-2b3f-481e-a411-f2d3204d28b2 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:44.416218 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:44.419947 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b340337-2b3f-481e-a411-f2d3204d28b2 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:44.454866 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e69293-6161-40f5-9834-228207fc8767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:44.455744 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e69293-6161-40f5-9834-228207fc8767 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:44.456032 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e69293-6161-40f5-9834-228207fc8767 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:44.456309 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e69293-6161-40f5-9834-228207fc8767 None admin] PATH_INFO: `/v3/projects/793e0b7f54284522b67bc42f3a9f9fdd` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:44.457511 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e69293-6161-40f5-9834-228207fc8767 None admin] RBAC: Authorizing `identity:get_project(project_id=793e0b7f54284522b67bc42f3a9f9fdd)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:44.458992 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e69293-6161-40f5-9834-228207fc8767 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:44.460676 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 228/453] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 16:08:44 2022] GET /identity/v3/projects/793e0b7f54284522b67bc42f3a9f9fdd => generated 344 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:44.466864 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dccdf8d-072c-48ef-b894-475ae4e69585 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:44.565606 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dccdf8d-072c-48ef-b894-475ae4e69585 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:44.578186 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:44.598580 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4937c551-7482-4adb-a570-6d95537693cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:44.599527 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4937c551-7482-4adb-a570-6d95537693cb None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:44.599815 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4937c551-7482-4adb-a570-6d95537693cb None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:44.600094 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4937c551-7482-4adb-a570-6d95537693cb None admin] PATH_INFO: `/v3/groups/3afd8aff1782409793dd982c8956d7e1` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:44.601249 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4937c551-7482-4adb-a570-6d95537693cb None admin] RBAC: Authorizing `identity:get_group(group_id=3afd8aff1782409793dd982c8956d7e1)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:44.603409 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4937c551-7482-4adb-a570-6d95537693cb None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:44.605096 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 226/454] 10.222.0.62 () {56 vars in 1180 bytes} [Fri May 27 16:08:44 2022] GET /identity/v3/groups/3afd8aff1782409793dd982c8956d7e1 => generated 229 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:44.611003 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e69293-6161-40f5-9834-228207fc8767 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:44.709272 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e69293-6161-40f5-9834-228207fc8767 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:44.741583 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a631136-27f7-4f12-be9f-890edb4c2194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:44.742277 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a631136-27f7-4f12-be9f-890edb4c2194 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:44.744226 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a631136-27f7-4f12-be9f-890edb4c2194 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:44.744515 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a631136-27f7-4f12-be9f-890edb4c2194 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:44.749341 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a631136-27f7-4f12-be9f-890edb4c2194 None admin] RBAC: Adding query filter params (group.id=3afd8aff1782409793dd982c8956d7e1, role.id=e04fe3eb1f714d74901ac83e33ea8a16, scope.project.id=793e0b7f54284522b67bc42f3a9f9fdd) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:44.749666 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a631136-27f7-4f12-be9f-890edb4c2194 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:44.755770 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a631136-27f7-4f12-be9f-890edb4c2194 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:44.762642 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 229/455] 10.222.0.62 () {56 vars in 1376 bytes} [Fri May 27 16:08:44 2022] GET /identity/v3/role_assignments?group.id=3afd8aff1782409793dd982c8956d7e1&scope.project.id=793e0b7f54284522b67bc42f3a9f9fdd&role.id=e04fe3eb1f714d74901ac83e33ea8a16 => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:47.397816 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7e4bc-6565-4c7a-b5b6-74bbc39fd61a None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:47.399470 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7e4bc-6565-4c7a-b5b6-74bbc39fd61a None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:47.400055 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7e4bc-6565-4c7a-b5b6-74bbc39fd61a None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:47.401824 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 227/456] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:08:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:08:47.410282 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d28ab-ba91-4e33-9301-3024e3a8c333 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:47.411149 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d28ab-ba91-4e33-9301-3024e3a8c333 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:47.411649 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d28ab-ba91-4e33-9301-3024e3a8c333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:47.435122 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-f10d28ab-ba91-4e33-9301-3024e3a8c333 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:08:47.436644 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-f10d28ab-ba91-4e33-9301-3024e3a8c333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:08:47.475340 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:47.531689 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 230/457] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:08:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 16:08:47.564036 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d7e4bc-6565-4c7a-b5b6-74bbc39fd61a None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:47.700074 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d7e4bc-6565-4c7a-b5b6-74bbc39fd61a None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:47.747693 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cc6880-6df2-4f9a-919a-19a7006795d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:47.748949 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cc6880-6df2-4f9a-919a-19a7006795d0 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:47.749438 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cc6880-6df2-4f9a-919a-19a7006795d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:47.749919 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cc6880-6df2-4f9a-919a-19a7006795d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:47.765202 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cc6880-6df2-4f9a-919a-19a7006795d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:47.767068 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cc6880-6df2-4f9a-919a-19a7006795d0 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:47.791557 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-86cc6880-6df2-4f9a-919a-19a7006795d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:08:47.791557 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:08:47.791557 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:08:47.791557 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:08:47.791557 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:08:47.791557 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:08:47.791557 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:08:47.791557 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:08:47.791557 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:08:47.791557 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:08:47.791557 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:08:47.791557 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:08:47.791557 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:08:47.791557 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:08:47.791557 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:08:47.792476 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:08:47.792476 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:08:47.792476 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:08:47.792476 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:08:47.792476 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:08:47.792476 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:08:47.792476 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:08:47.792476 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:08:47.792476 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:08:47.792476 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:08:47.792476 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:08:47.792476 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:08:47.792476 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:08:47.792476 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:08:47.792476 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:08:47.792476 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:08:47.792476 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:08:47.793933 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:08:47.793933 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:08:47.793933 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:08:47.793933 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:08:47.793933 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 228/458] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:08:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:08:47.802649 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10d28ab-ba91-4e33-9301-3024e3a8c333 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:47.806196 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c97d6fe-6a21-49da-a56c-6a5c03cf3d48 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:47.806527 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c97d6fe-6a21-49da-a56c-6a5c03cf3d48 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:47.806798 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c97d6fe-6a21-49da-a56c-6a5c03cf3d48 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:47.809284 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 229/459] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:08:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:08:47.818720 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dfcfc2-1e2f-4936-8dd2-691a8f9d540f None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:47.819004 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dfcfc2-1e2f-4936-8dd2-691a8f9d540f None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:47.819280 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dfcfc2-1e2f-4936-8dd2-691a8f9d540f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:47.849598 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-e4dfcfc2-1e2f-4936-8dd2-691a8f9d540f None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:08:47.850857 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-e4dfcfc2-1e2f-4936-8dd2-691a8f9d540f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:08:47.908474 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:47.964409 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10d28ab-ba91-4e33-9301-3024e3a8c333 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:47.989401 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 230/460] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:08:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:08:47.994689 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f39fe12-5253-4891-9932-662c03d8025c None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:47.994987 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f39fe12-5253-4891-9932-662c03d8025c None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:47.995270 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f39fe12-5253-4891-9932-662c03d8025c None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:47.996788 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 231/461] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:08:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:08:48.004011 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b201fe0-2c7c-4eb9-809c-15519291f2e8 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:48.004470 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b201fe0-2c7c-4eb9-809c-15519291f2e8 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:48.004888 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b201fe0-2c7c-4eb9-809c-15519291f2e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:48.008703 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae2ba6a-383b-47d8-856b-dd15caccb147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:48.009437 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2ba6a-383b-47d8-856b-dd15caccb147 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:48.009724 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2ba6a-383b-47d8-856b-dd15caccb147 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:48.009998 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2ba6a-383b-47d8-856b-dd15caccb147 None admin] PATH_INFO: `/v3/domains` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:48.010817 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae2ba6a-383b-47d8-856b-dd15caccb147 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:48.011125 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae2ba6a-383b-47d8-856b-dd15caccb147 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:48.012497 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae2ba6a-383b-47d8-856b-dd15caccb147 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:48.025137 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 231/462] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 16:08:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:48.030627 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae2ba6a-383b-47d8-856b-dd15caccb147 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:48.030748 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-8b201fe0-2c7c-4eb9-809c-15519291f2e8 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:08:48.031891 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-8b201fe0-2c7c-4eb9-809c-15519291f2e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:08:48.054167 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:48.110109 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 232/463] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:08:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:08:48.111998 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b37eb0-517f-42a1-b7b9-ec7246557412 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:48.112493 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b37eb0-517f-42a1-b7b9-ec7246557412 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:48.112992 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b37eb0-517f-42a1-b7b9-ec7246557412 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:48.114565 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 233/464] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:08:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:08:48.115459 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b37eb0-517f-42a1-b7b9-ec7246557412 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:48.147964 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae2ba6a-383b-47d8-856b-dd15caccb147 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:48.189718 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd25a4e-f389-4318-9d88-b0aa092692ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:48.190596 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd25a4e-f389-4318-9d88-b0aa092692ba None admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:48.190884 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd25a4e-f389-4318-9d88-b0aa092692ba None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:48.191160 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd25a4e-f389-4318-9d88-b0aa092692ba None admin] PATH_INFO: `/v3/users` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:48.191885 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd25a4e-f389-4318-9d88-b0aa092692ba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:48.193303 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd25a4e-f389-4318-9d88-b0aa092692ba None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:48.222354 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:48.230341 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b37eb0-517f-42a1-b7b9-ec7246557412 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:48.263637 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836694a5-c8c1-46ac-b752-c949f2bb3e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:48.264432 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836694a5-c8c1-46ac-b752-c949f2bb3e14 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:48.264719 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836694a5-c8c1-46ac-b752-c949f2bb3e14 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:48.265000 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836694a5-c8c1-46ac-b752-c949f2bb3e14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:48.275599 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836694a5-c8c1-46ac-b752-c949f2bb3e14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:48.277083 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836694a5-c8c1-46ac-b752-c949f2bb3e14 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:48.295128 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-836694a5-c8c1-46ac-b752-c949f2bb3e14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:08:48.295128 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:08:48.295128 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:08:48.295128 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:08:48.295128 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:08:48.295128 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:08:48.295128 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:08:48.295128 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:08:48.295128 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:08:48.295128 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:08:48.295128 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:08:48.295128 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:08:48.295128 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:08:48.295128 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:08:48.295128 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:08:48.296073 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:08:48.296073 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:08:48.296073 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:08:48.296073 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:08:48.296073 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:08:48.296073 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:08:48.296073 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:08:48.296073 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:08:48.296073 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:08:48.296073 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:08:48.296073 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:08:48.296073 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:08:48.296073 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:08:48.296073 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:08:48.296073 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:08:48.296073 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:08:48.296073 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:08:48.297409 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:08:48.297409 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:08:48.297409 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:08:48.297409 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:08:48.297409 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 234/465] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:08:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:08:48.299759 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3540c914-9950-449c-8637-55456c3f317d None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:48.300330 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3540c914-9950-449c-8637-55456c3f317d None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:48.301167 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3540c914-9950-449c-8637-55456c3f317d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:48.305867 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 232/466] 10.222.0.62 () {60 vars in 1132 bytes} [Fri May 27 16:08:48 2022] POST /identity/v3/users => generated 246 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:08:48.315388 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd25a4e-f389-4318-9d88-b0aa092692ba None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:48.318782 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-3540c914-9950-449c-8637-55456c3f317d None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:08:48.320087 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-3540c914-9950-449c-8637-55456c3f317d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:08:48.421713 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 235/467] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:08:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:08:48.423501 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3540c914-9950-449c-8637-55456c3f317d None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:48.445635 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:48.481298 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd25a4e-f389-4318-9d88-b0aa092692ba None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:48.522042 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76921fa-6b60-4fcc-ad79-28acb1ace2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:48.522888 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76921fa-6b60-4fcc-ad79-28acb1ace2f4 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:48.523175 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76921fa-6b60-4fcc-ad79-28acb1ace2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:48.524033 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76921fa-6b60-4fcc-ad79-28acb1ace2f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:48.532151 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:48.535441 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76921fa-6b60-4fcc-ad79-28acb1ace2f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:48.536897 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76921fa-6b60-4fcc-ad79-28acb1ace2f4 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:48.557502 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3540c914-9950-449c-8637-55456c3f317d None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:48.557677 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-d76921fa-6b60-4fcc-ad79-28acb1ace2f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:08:48.557677 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:08:48.557677 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:08:48.557677 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:08:48.557677 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:08:48.557677 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:08:48.557677 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:08:48.557677 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:08:48.557677 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:08:48.557677 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:08:48.557677 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:08:48.557677 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:08:48.557677 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:08:48.557677 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:08:48.557677 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:08:48.558543 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:08:48.558543 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:08:48.558543 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:08:48.558543 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:08:48.558543 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:08:48.558543 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:08:48.558543 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:08:48.558543 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:08:48.558543 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:08:48.558543 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:08:48.558543 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:08:48.558543 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:08:48.558543 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:08:48.558543 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:08:48.558543 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:08:48.558543 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:08:48.558543 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:08:48.559390 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:08:48.559390 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:08:48.559390 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:08:48.559390 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:08:48.559390 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 233/468] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:08:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:08:48.559390 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76921fa-6b60-4fcc-ad79-28acb1ace2f4 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:48.610292 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdc697f-c969-4bcd-a200-051d24cea11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:48.610990 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc697f-c969-4bcd-a200-051d24cea11a None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:48.611279 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc697f-c969-4bcd-a200-051d24cea11a None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:48.611563 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc697f-c969-4bcd-a200-051d24cea11a None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:48.612771 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdc697f-c969-4bcd-a200-051d24cea11a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:48.613086 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdc697f-c969-4bcd-a200-051d24cea11a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:48.615154 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdc697f-c969-4bcd-a200-051d24cea11a None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:48.631469 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 236/469] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 16:08:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:48.632173 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdc697f-c969-4bcd-a200-051d24cea11a None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:48.692930 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76921fa-6b60-4fcc-ad79-28acb1ace2f4 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:48.721270 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:48.730167 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cc5bfc-6c2d-4c64-abd9-2a20859b9104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:48.731394 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc5bfc-6c2d-4c64-abd9-2a20859b9104 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:48.731887 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc5bfc-6c2d-4c64-abd9-2a20859b9104 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:48.732381 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc5bfc-6c2d-4c64-abd9-2a20859b9104 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:48.741269 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdc697f-c969-4bcd-a200-051d24cea11a None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:48.744269 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cc5bfc-6c2d-4c64-abd9-2a20859b9104 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:48.745955 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cc5bfc-6c2d-4c64-abd9-2a20859b9104 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:48.764159 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-87cc5bfc-6c2d-4c64-abd9-2a20859b9104 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:08:48.764159 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:08:48.764159 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:08:48.764159 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:08:48.764159 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:08:48.764159 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:08:48.764159 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:08:48.764159 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:08:48.764159 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:08:48.764159 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:08:48.764159 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:08:48.764159 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:08:48.764159 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:08:48.764159 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:08:48.764159 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:08:48.765080 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:08:48.765080 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:08:48.765080 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:08:48.765080 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:08:48.765080 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:08:48.765080 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:08:48.765080 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:08:48.765080 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:08:48.765080 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:08:48.765080 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:08:48.765080 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:08:48.765080 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:08:48.765080 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:08:48.765080 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:08:48.765080 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:08:48.765080 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:08:48.765080 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:08:48.765938 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:08:48.765938 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:08:48.765938 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:08:48.765938 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:08:48.768197 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 234/470] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:08:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:08:48.769233 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cc5bfc-6c2d-4c64-abd9-2a20859b9104 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:48.777206 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b631b9dc-c9de-4f57-9d9a-fa9fcefb0409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:48.777887 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631b9dc-c9de-4f57-9d9a-fa9fcefb0409 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:48.778180 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631b9dc-c9de-4f57-9d9a-fa9fcefb0409 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:48.778499 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631b9dc-c9de-4f57-9d9a-fa9fcefb0409 None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:48.779233 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b631b9dc-c9de-4f57-9d9a-fa9fcefb0409 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:48.779609 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b631b9dc-c9de-4f57-9d9a-fa9fcefb0409 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:48.781056 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b631b9dc-c9de-4f57-9d9a-fa9fcefb0409 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:48.802657 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 237/471] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 16:08:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:48.803457 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b631b9dc-c9de-4f57-9d9a-fa9fcefb0409 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:48.810461 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:48.891710 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cc5bfc-6c2d-4c64-abd9-2a20859b9104 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:48.925482 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b631b9dc-c9de-4f57-9d9a-fa9fcefb0409 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:48.926603 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db147f3c-7e95-4ad8-9126-bc4bea831d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:48.927533 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db147f3c-7e95-4ad8-9126-bc4bea831d02 None admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:48.927821 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db147f3c-7e95-4ad8-9126-bc4bea831d02 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:48.928107 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db147f3c-7e95-4ad8-9126-bc4bea831d02 None admin] PATH_INFO: `/v3/users` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:48.928817 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db147f3c-7e95-4ad8-9126-bc4bea831d02 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:48.930813 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db147f3c-7e95-4ad8-9126-bc4bea831d02 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:48.963051 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11434483-c880-4996-968c-f821846dc926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:48.963718 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11434483-c880-4996-968c-f821846dc926 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:48.964003 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11434483-c880-4996-968c-f821846dc926 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:48.964288 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11434483-c880-4996-968c-f821846dc926 None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:48.965053 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11434483-c880-4996-968c-f821846dc926 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:48.965365 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11434483-c880-4996-968c-f821846dc926 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:48.966771 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11434483-c880-4996-968c-f821846dc926 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:48.978308 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 238/472] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 16:08:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:48.980112 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11434483-c880-4996-968c-f821846dc926 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:49.006937 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 235/473] 10.222.0.62 () {60 vars in 1132 bytes} [Fri May 27 16:08:48 2022] POST /identity/v3/users => generated 248 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:08:49.009214 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306e2c9-1dc2-484d-8d46-448ff07db4d5 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:49.009574 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306e2c9-1dc2-484d-8d46-448ff07db4d5 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:49.009928 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306e2c9-1dc2-484d-8d46-448ff07db4d5 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:49.015765 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 236/474] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:08:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:08:49.015765 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9306e2c9-1dc2-484d-8d46-448ff07db4d5 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:49.050234 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:49.071256 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:49.118181 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11434483-c880-4996-968c-f821846dc926 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:49.152590 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9306e2c9-1dc2-484d-8d46-448ff07db4d5 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:49.165688 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c12d983-eadc-4e60-8a15-85d943dced82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:49.166935 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c12d983-eadc-4e60-8a15-85d943dced82 None admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:49.167227 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c12d983-eadc-4e60-8a15-85d943dced82 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:49.167509 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c12d983-eadc-4e60-8a15-85d943dced82 None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:49.168245 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c12d983-eadc-4e60-8a15-85d943dced82 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:49.169713 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c12d983-eadc-4e60-8a15-85d943dced82 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:49.197399 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b03e52-7ff6-4a65-990e-4f137578cf89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:49.198082 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b03e52-7ff6-4a65-990e-4f137578cf89 None admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:49.198401 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b03e52-7ff6-4a65-990e-4f137578cf89 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:49.198709 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b03e52-7ff6-4a65-990e-4f137578cf89 None admin] PATH_INFO: `/v3/users` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:49.199664 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b03e52-7ff6-4a65-990e-4f137578cf89 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:49.204035 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b03e52-7ff6-4a65-990e-4f137578cf89 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:49.293540 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 239/475] 10.222.0.62 () {60 vars in 1132 bytes} [Fri May 27 16:08:48 2022] POST /identity/v3/users => generated 248 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:08:49.295378 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e97370-8d99-4dcd-96b7-47c4793a1d7f None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:49.295604 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e97370-8d99-4dcd-96b7-47c4793a1d7f None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:49.295893 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e97370-8d99-4dcd-96b7-47c4793a1d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:49.321301 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-12e97370-8d99-4dcd-96b7-47c4793a1d7f None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:08:49.323241 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-12e97370-8d99-4dcd-96b7-47c4793a1d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:08:49.329978 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 237/476] 10.222.0.62 () {60 vars in 1132 bytes} [Fri May 27 16:08:49 2022] POST /identity/v3/users => generated 249 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:08:49.408672 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 240/477] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:08:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:08:49.455980 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b03e52-7ff6-4a65-990e-4f137578cf89 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:49.594451 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:49.605086 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b03e52-7ff6-4a65-990e-4f137578cf89 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:49.643077 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a6c3a3-091f-4302-977a-95532c3bc511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:49.643765 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6c3a3-091f-4302-977a-95532c3bc511 None admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:49.644050 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6c3a3-091f-4302-977a-95532c3bc511 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:49.644328 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6c3a3-091f-4302-977a-95532c3bc511 None admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:49.645096 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a6c3a3-091f-4302-977a-95532c3bc511 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:49.646501 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a6c3a3-091f-4302-977a-95532c3bc511 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:49.703375 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.sql.core [None req-47a6c3a3-091f-4302-977a-95532c3bc511 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 27 16:08:49.703375 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 27 16:08:49.703375 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [parameters: {'id': 'c12bfbda09b4421e9eada783820ce586', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 27 16:08:49.703375 dv-cinder-840493-2-smb devstack@keystone.service[80288]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80288) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 27 16:08:49.722655 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-47a6c3a3-091f-4302-977a-95532c3bc511 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 27 16:08:49.722655 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:08:49.722655 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 27 16:08:49.722655 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application self.dialect.do_execute( May 27 16:08:49.722655 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 27 16:08:49.722655 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 27 16:08:49.722655 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 27 16:08:49.722655 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application result = self._query(query) May 27 16:08:49.722655 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 27 16:08:49.722655 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application conn.query(q) May 27 16:08:49.722655 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 27 16:08:49.722655 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 27 16:08:49.722655 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 27 16:08:49.722655 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application result.read() May 27 16:08:49.722655 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 27 16:08:49.723591 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 27 16:08:49.723591 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 27 16:08:49.723591 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application packet.raise_for_error() May 27 16:08:49.723591 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 27 16:08:49.723591 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 27 16:08:49.723591 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 27 16:08:49.723591 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 27 16:08:49.723591 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 27 16:08:49.723591 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:08:49.723591 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 27 16:08:49.723591 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:08:49.723591 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:08:49.723591 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 27 16:08:49.723591 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 27 16:08:49.723591 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 27 16:08:49.723591 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return ref.to_dict() May 27 16:08:49.723591 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 27 16:08:49.723591 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application next(self.gen) May 27 16:08:49.724965 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 27 16:08:49.724965 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application yield resource May 27 16:08:49.724965 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 27 16:08:49.724965 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application next(self.gen) May 27 16:08:49.724965 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 27 16:08:49.724965 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application self.session.rollback() May 27 16:08:49.724965 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 27 16:08:49.724965 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application self.force_reraise() May 27 16:08:49.724965 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 27 16:08:49.724965 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise self.value May 27 16:08:49.724965 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 27 16:08:49.724965 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 27 16:08:49.724965 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 27 16:08:49.724965 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application session.commit() May 27 16:08:49.724965 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 27 16:08:49.724965 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 27 16:08:49.724965 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 27 16:08:49.725839 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application self._prepare_impl() May 27 16:08:49.725839 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 27 16:08:49.725839 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application self.session.flush() May 27 16:08:49.725839 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 27 16:08:49.725839 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application self._flush(objects) May 27 16:08:49.725839 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 27 16:08:49.725839 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 27 16:08:49.725839 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 27 16:08:49.725839 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application compat.raise_( May 27 16:08:49.725839 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 27 16:08:49.725839 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception May 27 16:08:49.725839 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 27 16:08:49.725839 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application flush_context.execute() May 27 16:08:49.725839 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 27 16:08:49.725839 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rec.execute(self) May 27 16:08:49.725839 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 27 16:08:49.725839 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 27 16:08:49.726833 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 27 16:08:49.726833 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application _emit_insert_statements( May 27 16:08:49.726833 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 27 16:08:49.726833 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application c = connection._execute_20( May 27 16:08:49.726833 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 27 16:08:49.726833 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 27 16:08:49.726833 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 27 16:08:49.726833 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 27 16:08:49.726833 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 27 16:08:49.726833 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application ret = self._execute_context( May 27 16:08:49.726833 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 27 16:08:49.726833 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 27 16:08:49.726833 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 27 16:08:49.726833 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 27 16:08:49.726833 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 27 16:08:49.726833 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception May 27 16:08:49.727651 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 27 16:08:49.727651 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application self.dialect.do_execute( May 27 16:08:49.727651 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 27 16:08:49.727651 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 27 16:08:49.727651 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 27 16:08:49.727651 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application result = self._query(query) May 27 16:08:49.727651 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 27 16:08:49.727651 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application conn.query(q) May 27 16:08:49.727651 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 27 16:08:49.727651 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 27 16:08:49.727651 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 27 16:08:49.727651 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application result.read() May 27 16:08:49.727651 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 27 16:08:49.727651 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 27 16:08:49.727651 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 27 16:08:49.727651 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application packet.raise_for_error() May 27 16:08:49.728541 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 27 16:08:49.728541 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 27 16:08:49.728541 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 27 16:08:49.728541 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 27 16:08:49.728541 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 27 16:08:49.728541 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 27 16:08:49.728541 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [parameters: {'id': 'c12bfbda09b4421e9eada783820ce586', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 27 16:08:49.728541 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 27 16:08:49.728541 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:08:49.728541 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 16:08:49.728541 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:08:49.728541 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:08:49.728541 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:08:49.728541 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:08:49.728541 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:08:49.728541 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:08:49.729336 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:08:49.729336 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:08:49.729336 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:08:49.729336 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:08:49.729336 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:08:49.729336 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:08:49.729336 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 27 16:08:49.729336 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 27 16:08:49.729336 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:08:49.729336 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:08:49.729336 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 27 16:08:49.729336 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 27 16:08:49.729336 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 27 16:08:49.729336 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 27 16:08:49.729336 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 27 16:08:49.729336 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:08:49.730153 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 238/478] 10.222.0.62 () {60 vars in 1131 bytes} [Fri May 27 16:08:49 2022] POST /identity/v3/roles => generated 144 bytes in 269 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 27 16:08:49.737209 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e97370-8d99-4dcd-96b7-47c4793a1d7f None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:49.797192 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:49.868759 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e97370-8d99-4dcd-96b7-47c4793a1d7f None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:49.921712 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467c3ffe-6730-4c80-ace3-0a5ff5aff937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:49.922618 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c3ffe-6730-4c80-ace3-0a5ff5aff937 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:49.922907 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c3ffe-6730-4c80-ace3-0a5ff5aff937 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:49.923185 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c3ffe-6730-4c80-ace3-0a5ff5aff937 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:49.939193 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467c3ffe-6730-4c80-ace3-0a5ff5aff937 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:08:49.947919 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-467c3ffe-6730-4c80-ace3-0a5ff5aff937 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 16:08:49.947919 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:08:49.947919 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:08:49.947919 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:08:49.947919 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:08:49.947919 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:08:49.947919 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:08:49.947919 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:08:49.947919 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:08:49.947919 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:08:49.947919 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:08:49.947919 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:08:49.947919 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:08:49.947919 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:08:49.947919 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:08:49.947919 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:08:49.950085 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:08:49.950085 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:08:49.950085 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:08:49.950085 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:08:49.950085 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:08:49.950085 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:08:49.950085 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:08:49.950085 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:08:49.950085 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:08:49.950085 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:08:49.950085 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:08:49.950085 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:08:49.950085 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:08:49.950085 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:08:49.950085 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:08:49.950085 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:08:49.952123 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:08:49.952123 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:08:49.952123 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:08:49.952123 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:08:49.952123 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:08:49.952123 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:08:49.952123 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:08:49.952123 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:08:49.952123 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:08:49.952123 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:08:49.952123 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 16:08:49.952123 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:08:49.952123 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 241/479] 10.222.0.62 () {56 vars in 1114 bytes} [Fri May 27 16:08:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:08:49.959447 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a6c3a3-091f-4302-977a-95532c3bc511 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:50.114611 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a6c3a3-091f-4302-977a-95532c3bc511 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:50.163133 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2041e250-0f75-40a7-bba1-21877b24560b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:50.164264 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041e250-0f75-40a7-bba1-21877b24560b None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:50.164557 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041e250-0f75-40a7-bba1-21877b24560b None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:50.164839 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041e250-0f75-40a7-bba1-21877b24560b None admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:50.165600 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2041e250-0f75-40a7-bba1-21877b24560b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:50.165912 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2041e250-0f75-40a7-bba1-21877b24560b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:50.167323 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2041e250-0f75-40a7-bba1-21877b24560b None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:50.178183 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 239/480] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 16:08:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:50.931508 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb8553-6d14-4ca1-bb6b-430b49f54903 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:50.932008 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb8553-6d14-4ca1-bb6b-430b49f54903 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:50.932113 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb8553-6d14-4ca1-bb6b-430b49f54903 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:50.933653 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 242/481] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:08:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:08:50.939594 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db84fb4-6f9b-4856-8012-e0cbe77fa988 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:50.940400 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db84fb4-6f9b-4856-8012-e0cbe77fa988 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:50.940889 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db84fb4-6f9b-4856-8012-e0cbe77fa988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:50.963551 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-0db84fb4-6f9b-4856-8012-e0cbe77fa988 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:08:50.965067 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-0db84fb4-6f9b-4856-8012-e0cbe77fa988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:08:50.979374 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:51.037443 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 240/482] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:08:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:08:51.072868 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb8553-6d14-4ca1-bb6b-430b49f54903 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:51.205639 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:51.210476 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb8553-6d14-4ca1-bb6b-430b49f54903 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:51.262174 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd8eeda-6df3-4c46-a786-11a43e2fcfba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:51.263353 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd8eeda-6df3-4c46-a786-11a43e2fcfba None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:51.263860 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd8eeda-6df3-4c46-a786-11a43e2fcfba None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:51.264336 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd8eeda-6df3-4c46-a786-11a43e2fcfba None admin] PATH_INFO: `/v3/roles/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:51.283155 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd8eeda-6df3-4c46-a786-11a43e2fcfba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:08:51.291928 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-edd8eeda-6df3-4c46-a786-11a43e2fcfba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 16:08:51.291928 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:08:51.291928 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:08:51.291928 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:08:51.291928 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:08:51.291928 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:08:51.291928 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:08:51.291928 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:08:51.291928 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:08:51.291928 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:08:51.291928 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:08:51.291928 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:08:51.291928 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:08:51.291928 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:08:51.291928 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:08:51.291928 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:08:51.292815 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:08:51.292815 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:08:51.292815 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:08:51.292815 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:08:51.292815 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:08:51.292815 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:08:51.292815 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:08:51.292815 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:08:51.292815 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:08:51.292815 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:08:51.292815 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:08:51.292815 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:08:51.292815 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:08:51.292815 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:08:51.292815 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:08:51.292815 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:08:51.293631 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:08:51.293631 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:08:51.293631 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:08:51.293631 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:08:51.293631 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:08:51.293631 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:08:51.293631 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:08:51.293631 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:08:51.293631 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:08:51.293631 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:08:51.293631 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 16:08:51.293631 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:08:51.296030 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 243/483] 10.222.0.62 () {56 vars in 1102 bytes} [Fri May 27 16:08:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:08:51.301840 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db84fb4-6f9b-4856-8012-e0cbe77fa988 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:51.437908 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db84fb4-6f9b-4856-8012-e0cbe77fa988 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:51.488847 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fd66f0-c168-4dcd-805a-451df1dd08b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:51.489440 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fd66f0-c168-4dcd-805a-451df1dd08b8 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:51.489720 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fd66f0-c168-4dcd-805a-451df1dd08b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:51.489991 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fd66f0-c168-4dcd-805a-451df1dd08b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:51.490772 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fd66f0-c168-4dcd-805a-451df1dd08b8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:51.491078 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fd66f0-c168-4dcd-805a-451df1dd08b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:51.492482 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fd66f0-c168-4dcd-805a-451df1dd08b8 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:51.503660 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 241/484] 10.222.0.62 () {56 vars in 1103 bytes} [Fri May 27 16:08:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:51.509254 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd8eeda-6df3-4c46-a786-11a43e2fcfba None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:51.678407 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd8eeda-6df3-4c46-a786-11a43e2fcfba None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:51.729542 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decf8b2d-8ba2-4032-97b5-d8d18382f225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:51.730793 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf8b2d-8ba2-4032-97b5-d8d18382f225 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:51.731286 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf8b2d-8ba2-4032-97b5-d8d18382f225 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:51.731764 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf8b2d-8ba2-4032-97b5-d8d18382f225 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:51.752398 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decf8b2d-8ba2-4032-97b5-d8d18382f225 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:51.754201 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decf8b2d-8ba2-4032-97b5-d8d18382f225 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:51.779210 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-decf8b2d-8ba2-4032-97b5-d8d18382f225 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:08:51.779210 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:08:51.779210 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:08:51.779210 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:08:51.779210 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:08:51.779210 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:08:51.779210 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:08:51.779210 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:08:51.779210 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:08:51.779210 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:08:51.779210 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:08:51.779210 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:08:51.779210 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:08:51.779210 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:08:51.779210 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:08:51.780111 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:08:51.780111 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:08:51.780111 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:08:51.780111 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:08:51.780111 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:08:51.780111 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:08:51.780111 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:08:51.780111 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:08:51.780111 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:08:51.780111 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:08:51.780111 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:08:51.780111 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:08:51.780111 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:08:51.780111 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:08:51.780111 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:08:51.780111 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:08:51.780111 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:08:51.780944 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:08:51.780944 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:08:51.780944 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:08:51.780944 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:08:51.782883 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 244/485] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:08:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:08:51.788399 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fd66f0-c168-4dcd-805a-451df1dd08b8 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:51.810685 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:51.816807 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1937781-03ab-4502-8599-d77c75756102 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:51.817626 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1937781-03ab-4502-8599-d77c75756102 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:51.818118 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1937781-03ab-4502-8599-d77c75756102 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:51.821100 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 245/486] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:08:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:08:51.828449 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119593b5-d121-40d4-98d2-112d9c7f3b93 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:51.829204 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119593b5-d121-40d4-98d2-112d9c7f3b93 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:51.829655 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119593b5-d121-40d4-98d2-112d9c7f3b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:51.862186 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-119593b5-d121-40d4-98d2-112d9c7f3b93 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:08:51.863402 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-119593b5-d121-40d4-98d2-112d9c7f3b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:08:51.878608 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:51.929294 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fd66f0-c168-4dcd-805a-451df1dd08b8 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:51.963134 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 246/487] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:08:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:08:51.964583 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dababa0b-0803-4e71-93c7-912b6a65bbee None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:51.964882 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dababa0b-0803-4e71-93c7-912b6a65bbee None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:51.965163 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dababa0b-0803-4e71-93c7-912b6a65bbee None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:51.966715 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 247/488] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:08:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:08:51.975775 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4756d35b-63e3-41e2-9cf1-f4b2f32a45f3 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:51.976075 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4756d35b-63e3-41e2-9cf1-f4b2f32a45f3 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:51.976926 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4756d35b-63e3-41e2-9cf1-f4b2f32a45f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:51.978352 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec228d6-7d84-4963-99a9-4e59fd2731da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:51.979024 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec228d6-7d84-4963-99a9-4e59fd2731da None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:51.979311 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec228d6-7d84-4963-99a9-4e59fd2731da None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:51.979592 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec228d6-7d84-4963-99a9-4e59fd2731da None admin] PATH_INFO: `/v3/domains` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:51.980326 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec228d6-7d84-4963-99a9-4e59fd2731da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:51.980638 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec228d6-7d84-4963-99a9-4e59fd2731da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:51.982013 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec228d6-7d84-4963-99a9-4e59fd2731da None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:51.996463 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 242/489] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 16:08:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:52.001771 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec228d6-7d84-4963-99a9-4e59fd2731da None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:52.008626 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-4756d35b-63e3-41e2-9cf1-f4b2f32a45f3 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:08:52.010063 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-4756d35b-63e3-41e2-9cf1-f4b2f32a45f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:08:52.081967 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:52.083325 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 248/490] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:08:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:08:52.084034 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4756d35b-63e3-41e2-9cf1-f4b2f32a45f3 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:52.121205 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec228d6-7d84-4963-99a9-4e59fd2731da None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:52.156101 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:52.158895 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7faae2-c72e-47f0-847b-dea07573be74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:52.159691 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7faae2-c72e-47f0-847b-dea07573be74 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:52.159973 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7faae2-c72e-47f0-847b-dea07573be74 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:52.160252 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7faae2-c72e-47f0-847b-dea07573be74 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:52.171835 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7faae2-c72e-47f0-847b-dea07573be74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:08:52.180140 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-0a7faae2-c72e-47f0-847b-dea07573be74 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 16:08:52.180140 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:08:52.180140 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:08:52.180140 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:08:52.180140 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:08:52.180140 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:08:52.180140 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:08:52.180140 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:08:52.180140 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:08:52.180140 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:08:52.180140 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:08:52.180140 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:08:52.180140 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:08:52.180140 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:08:52.180140 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:08:52.180140 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:08:52.181079 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:08:52.181079 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:08:52.181079 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:08:52.181079 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:08:52.181079 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:08:52.181079 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:08:52.181079 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:08:52.181079 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:08:52.181079 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:08:52.181079 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:08:52.181079 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:08:52.181079 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:08:52.181079 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:08:52.181079 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:08:52.181079 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:08:52.181079 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:08:52.181879 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:08:52.181879 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:08:52.181879 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:08:52.181879 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:08:52.181879 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:08:52.181879 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:08:52.181879 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:08:52.181879 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:08:52.181879 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:08:52.181879 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:08:52.181879 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 16:08:52.181879 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:08:52.181879 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 243/491] 10.222.0.62 () {56 vars in 1102 bytes} [Fri May 27 16:08:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:08:52.188498 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4343a2-6001-470d-80c7-3b1617c949fd None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:52.188498 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4343a2-6001-470d-80c7-3b1617c949fd None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:52.188498 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4343a2-6001-470d-80c7-3b1617c949fd None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:52.188498 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 244/492] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:08:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:08:52.188498 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4343a2-6001-470d-80c7-3b1617c949fd None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:52.195673 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4756d35b-63e3-41e2-9cf1-f4b2f32a45f3 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:52.233402 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5cbcbb-53b3-40a1-94aa-8ed35c32fbe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:52.234193 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5cbcbb-53b3-40a1-94aa-8ed35c32fbe0 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:52.234530 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5cbcbb-53b3-40a1-94aa-8ed35c32fbe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:52.235082 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5cbcbb-53b3-40a1-94aa-8ed35c32fbe0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:52.242664 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5cbcbb-53b3-40a1-94aa-8ed35c32fbe0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:52.244394 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5cbcbb-53b3-40a1-94aa-8ed35c32fbe0 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:52.260813 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-4b5cbcbb-53b3-40a1-94aa-8ed35c32fbe0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 16:08:52.260813 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:08:52.260813 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:08:52.260813 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:08:52.260813 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:08:52.260813 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:08:52.260813 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:08:52.260813 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:08:52.260813 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:08:52.260813 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:08:52.260813 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:08:52.260813 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:08:52.260813 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 16:08:52.260813 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 16:08:52.260813 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 16:08:52.260813 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 16:08:52.261720 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:08:52.261720 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:08:52.261720 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 16:08:52.261720 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:08:52.261720 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 16:08:52.261720 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:08:52.261720 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:08:52.261720 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:08:52.261720 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:08:52.261720 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:08:52.261720 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:08:52.261720 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:08:52.261720 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:08:52.261720 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:08:52.261720 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:08:52.261720 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:08:52.261720 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:08:52.261720 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:08:52.263176 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:08:52.263176 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:08:52.263176 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 16:08:52.263176 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 16:08:52.263176 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 16:08:52.263176 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 16:08:52.263176 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 16:08:52.263176 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 16:08:52.263176 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 16:08:52.263176 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:08:52.263176 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 249/493] 10.222.0.62 () {56 vars in 1093 bytes} [Fri May 27 16:08:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:08:52.263176 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5cbcbb-53b3-40a1-94aa-8ed35c32fbe0 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:52.305754 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4343a2-6001-470d-80c7-3b1617c949fd None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:52.337678 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:52.343464 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97104e21-52d2-47c3-8b06-d34076a538f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:52.344284 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97104e21-52d2-47c3-8b06-d34076a538f2 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:52.351572 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97104e21-52d2-47c3-8b06-d34076a538f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:52.351572 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97104e21-52d2-47c3-8b06-d34076a538f2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:52.356150 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97104e21-52d2-47c3-8b06-d34076a538f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:08:52.364045 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-97104e21-52d2-47c3-8b06-d34076a538f2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 16:08:52.364045 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:08:52.364045 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:08:52.364045 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:08:52.364045 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:08:52.364045 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:08:52.364045 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:08:52.364045 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:08:52.364045 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:08:52.364045 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:08:52.364045 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:08:52.364045 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:08:52.364045 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:08:52.364045 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:08:52.364045 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:08:52.364045 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:08:52.364937 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:08:52.364937 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:08:52.364937 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:08:52.364937 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:08:52.364937 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:08:52.364937 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:08:52.364937 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:08:52.364937 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:08:52.364937 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:08:52.364937 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:08:52.364937 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:08:52.364937 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:08:52.364937 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:08:52.364937 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:08:52.364937 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:08:52.364937 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:08:52.365729 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:08:52.365729 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:08:52.365729 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:08:52.365729 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:08:52.365729 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:08:52.365729 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:08:52.365729 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:08:52.365729 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:08:52.365729 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:08:52.365729 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:08:52.365729 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 16:08:52.365729 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:08:52.365729 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 245/494] 10.222.0.62 () {56 vars in 1102 bytes} [Fri May 27 16:08:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:08:52.366912 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c327c21-30bc-4b67-b048-dcfb8433a364 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:52.366912 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c327c21-30bc-4b67-b048-dcfb8433a364 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:52.367032 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c327c21-30bc-4b67-b048-dcfb8433a364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:52.372780 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5cbcbb-53b3-40a1-94aa-8ed35c32fbe0 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:52.384208 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-4c327c21-30bc-4b67-b048-dcfb8433a364 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:08:52.385588 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-4c327c21-30bc-4b67-b048-dcfb8433a364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:08:52.404598 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:52.411327 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3e74e4-0a94-4c97-9eed-04ef9f2e844c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:52.412073 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e74e4-0a94-4c97-9eed-04ef9f2e844c None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:52.412374 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e74e4-0a94-4c97-9eed-04ef9f2e844c None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:52.437562 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e74e4-0a94-4c97-9eed-04ef9f2e844c None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:52.437562 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3e74e4-0a94-4c97-9eed-04ef9f2e844c None admin] RBAC: Adding query filter params (name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:52.437562 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3e74e4-0a94-4c97-9eed-04ef9f2e844c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:52.437562 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3e74e4-0a94-4c97-9eed-04ef9f2e844c None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:52.437562 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 250/495] 10.222.0.62 () {56 vars in 1103 bytes} [Fri May 27 16:08:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:52.437562 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3e74e4-0a94-4c97-9eed-04ef9f2e844c None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:52.458743 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 246/496] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:08:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:08:52.459798 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c327c21-30bc-4b67-b048-dcfb8433a364 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:52.543153 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3e74e4-0a94-4c97-9eed-04ef9f2e844c None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:52.570702 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c327c21-30bc-4b67-b048-dcfb8433a364 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:52.577963 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5efcfd-71d9-49c6-af87-28a8ec568d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:52.578783 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5efcfd-71d9-49c6-af87-28a8ec568d07 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:52.579073 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5efcfd-71d9-49c6-af87-28a8ec568d07 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:52.579359 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5efcfd-71d9-49c6-af87-28a8ec568d07 None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:52.580197 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5efcfd-71d9-49c6-af87-28a8ec568d07 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:52.580511 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5efcfd-71d9-49c6-af87-28a8ec568d07 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:52.582172 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5efcfd-71d9-49c6-af87-28a8ec568d07 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:52.592002 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:52.606907 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a455de8-c007-4d18-b6b5-1f2f661ef0a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:52.607577 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a455de8-c007-4d18-b6b5-1f2f661ef0a0 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:52.608862 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a455de8-c007-4d18-b6b5-1f2f661ef0a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:52.608862 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a455de8-c007-4d18-b6b5-1f2f661ef0a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:52.609831 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a455de8-c007-4d18-b6b5-1f2f661ef0a0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:52.610149 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a455de8-c007-4d18-b6b5-1f2f661ef0a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:52.611557 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a455de8-c007-4d18-b6b5-1f2f661ef0a0 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:52.624986 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 247/497] 10.222.0.62 () {56 vars in 1103 bytes} [Fri May 27 16:08:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:52.624986 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a455de8-c007-4d18-b6b5-1f2f661ef0a0 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:52.625492 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 251/498] 10.222.0.62 () {56 vars in 1133 bytes} [Fri May 27 16:08:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:52.626185 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5efcfd-71d9-49c6-af87-28a8ec568d07 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:52.682262 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:52.732448 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5efcfd-71d9-49c6-af87-28a8ec568d07 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:52.733715 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a455de8-c007-4d18-b6b5-1f2f661ef0a0 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:52.767492 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b3cbe5-90de-4208-acdb-53d48e5f6244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:52.768286 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b3cbe5-90de-4208-acdb-53d48e5f6244 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:52.768572 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b3cbe5-90de-4208-acdb-53d48e5f6244 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:52.768850 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b3cbe5-90de-4208-acdb-53d48e5f6244 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:52.770667 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4626af77-8d06-4743-8e18-e7ef5ecc70e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:52.771464 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4626af77-8d06-4743-8e18-e7ef5ecc70e6 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:52.771877 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4626af77-8d06-4743-8e18-e7ef5ecc70e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:52.772134 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4626af77-8d06-4743-8e18-e7ef5ecc70e6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:52.780423 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b3cbe5-90de-4208-acdb-53d48e5f6244 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:52.781880 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b3cbe5-90de-4208-acdb-53d48e5f6244 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:52.783588 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4626af77-8d06-4743-8e18-e7ef5ecc70e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:08:52.791756 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-4626af77-8d06-4743-8e18-e7ef5ecc70e6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 16:08:52.791756 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:08:52.791756 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:08:52.791756 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:08:52.791756 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:08:52.791756 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:08:52.791756 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:08:52.791756 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:08:52.791756 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:08:52.791756 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:08:52.791756 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:08:52.791756 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:08:52.791756 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:08:52.791756 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:08:52.791756 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:08:52.791756 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:08:52.792826 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:08:52.792826 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:08:52.792826 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:08:52.792826 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:08:52.792826 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:08:52.792826 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:08:52.792826 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:08:52.792826 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:08:52.792826 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:08:52.792826 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:08:52.792826 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:08:52.792826 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:08:52.792826 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:08:52.792826 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:08:52.792826 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:08:52.792826 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:08:52.793850 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:08:52.793850 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:08:52.793850 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:08:52.793850 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:08:52.793850 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:08:52.793850 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:08:52.793850 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:08:52.793850 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:08:52.793850 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:08:52.793850 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:08:52.793850 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 16:08:52.793850 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:08:52.803947 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 252/499] 10.222.0.62 () {56 vars in 1102 bytes} [Fri May 27 16:08:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:08:52.803947 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4626af77-8d06-4743-8e18-e7ef5ecc70e6 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:52.804698 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-d3b3cbe5-90de-4208-acdb-53d48e5f6244 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:08:52.804698 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:08:52.804698 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:08:52.804698 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:08:52.804698 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:08:52.804698 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:08:52.804698 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:08:52.804698 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:08:52.804698 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:08:52.804698 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:08:52.804698 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:08:52.804698 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:08:52.804698 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:08:52.804698 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:08:52.804698 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:08:52.805464 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:08:52.805464 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:08:52.805464 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:08:52.805464 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:08:52.805464 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:08:52.805464 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:08:52.805464 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:08:52.805464 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:08:52.805464 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:08:52.805464 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:08:52.805464 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:08:52.805464 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:08:52.805464 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:08:52.805464 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:08:52.805464 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:08:52.805464 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:08:52.805464 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:08:52.806815 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:08:52.806815 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:08:52.806815 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:08:52.806815 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:08:52.806815 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 248/500] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:08:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:08:52.806815 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b3cbe5-90de-4208-acdb-53d48e5f6244 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:52.852607 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:52.922259 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4626af77-8d06-4743-8e18-e7ef5ecc70e6 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:52.931797 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b3cbe5-90de-4208-acdb-53d48e5f6244 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:52.938389 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:52.959971 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38256eff-8847-43f1-a15e-fc18a9d1f9b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:52.960961 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38256eff-8847-43f1-a15e-fc18a9d1f9b9 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:52.961297 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38256eff-8847-43f1-a15e-fc18a9d1f9b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:52.961580 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38256eff-8847-43f1-a15e-fc18a9d1f9b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:52.968016 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c27e0-07da-4cd0-8b97-0c6e57bc3ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:52.968671 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c27e0-07da-4cd0-8b97-0c6e57bc3ea4 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:52.968956 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c27e0-07da-4cd0-8b97-0c6e57bc3ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:52.969232 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c27e0-07da-4cd0-8b97-0c6e57bc3ea4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:52.974996 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38256eff-8847-43f1-a15e-fc18a9d1f9b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:52.977152 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38256eff-8847-43f1-a15e-fc18a9d1f9b9 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:52.995138 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-38256eff-8847-43f1-a15e-fc18a9d1f9b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:08:52.995138 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:08:52.995138 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:08:52.995138 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:08:52.995138 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:08:52.995138 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:08:52.995138 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:08:52.995138 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:08:52.995138 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:08:52.995138 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:08:52.995138 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:08:52.995138 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:08:52.995138 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:08:52.995138 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:08:52.995138 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:08:52.995985 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:08:52.995985 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:08:52.995985 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:08:52.995985 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:08:52.995985 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:08:52.995985 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:08:52.995985 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:08:52.995985 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:08:52.995985 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:08:52.995985 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:08:52.995985 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:08:52.995985 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:08:52.995985 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:08:52.995985 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:08:52.995985 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:08:52.995985 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:08:52.995985 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:08:52.997472 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:08:52.997472 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:08:52.997472 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:08:52.997472 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:08:52.997472 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 253/501] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:08:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:08:52.997472 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38256eff-8847-43f1-a15e-fc18a9d1f9b9 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:53.046169 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16c27e0-07da-4cd0-8b97-0c6e57bc3ea4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:53.047931 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16c27e0-07da-4cd0-8b97-0c6e57bc3ea4 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:53.081954 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:53.102535 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38256eff-8847-43f1-a15e-fc18a9d1f9b9 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:53.140403 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ca35f7-2995-437a-b102-7208095b754f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:53.141076 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ca35f7-2995-437a-b102-7208095b754f None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:53.141362 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ca35f7-2995-437a-b102-7208095b754f None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:53.141638 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ca35f7-2995-437a-b102-7208095b754f None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:53.142416 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ca35f7-2995-437a-b102-7208095b754f None admin] RBAC: Adding query filter params (name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:53.142722 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ca35f7-2995-437a-b102-7208095b754f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:53.144098 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ca35f7-2995-437a-b102-7208095b754f None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:53.156760 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 254/502] 10.222.0.62 () {56 vars in 1103 bytes} [Fri May 27 16:08:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:53.156760 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ca35f7-2995-437a-b102-7208095b754f None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:53.156980 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 249/503] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 16:08:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 16:08:53.156980 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c27e0-07da-4cd0-8b97-0c6e57bc3ea4 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:53.187079 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:53.261071 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c27e0-07da-4cd0-8b97-0c6e57bc3ea4 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:53.261517 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ca35f7-2995-437a-b102-7208095b754f None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:53.299867 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab51af50-4965-4ba0-b1f1-b4076f032488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:53.300550 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab51af50-4965-4ba0-b1f1-b4076f032488 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:53.300907 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab51af50-4965-4ba0-b1f1-b4076f032488 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:53.301282 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab51af50-4965-4ba0-b1f1-b4076f032488 None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:53.302357 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab51af50-4965-4ba0-b1f1-b4076f032488 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:53.302527 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8955ad-87e1-462d-b2d6-a28313d4b00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:53.302633 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab51af50-4965-4ba0-b1f1-b4076f032488 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:53.303190 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8955ad-87e1-462d-b2d6-a28313d4b00a None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:53.303473 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8955ad-87e1-462d-b2d6-a28313d4b00a None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:53.303748 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8955ad-87e1-462d-b2d6-a28313d4b00a None admin] PATH_INFO: `/v3/domains` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:53.303985 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab51af50-4965-4ba0-b1f1-b4076f032488 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:53.304503 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8955ad-87e1-462d-b2d6-a28313d4b00a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:53.304806 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8955ad-87e1-462d-b2d6-a28313d4b00a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:53.306173 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8955ad-87e1-462d-b2d6-a28313d4b00a None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:53.307706 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:53.316224 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 255/504] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 16:08:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:53.317100 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab51af50-4965-4ba0-b1f1-b4076f032488 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:53.326847 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 250/505] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 16:08:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:53.326847 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8955ad-87e1-462d-b2d6-a28313d4b00a None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:53.402546 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:53.416648 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab51af50-4965-4ba0-b1f1-b4076f032488 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:53.424531 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8955ad-87e1-462d-b2d6-a28313d4b00a None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:53.450141 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87cc1d0-89b9-40fe-8740-b1b84507db0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:53.450950 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87cc1d0-89b9-40fe-8740-b1b84507db0b None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:53.451230 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87cc1d0-89b9-40fe-8740-b1b84507db0b None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:53.451508 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87cc1d0-89b9-40fe-8740-b1b84507db0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:53.457892 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4512492-3150-49ae-b8e2-d13ec845eee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:53.458754 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4512492-3150-49ae-b8e2-d13ec845eee9 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:53.459037 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4512492-3150-49ae-b8e2-d13ec845eee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:53.459314 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4512492-3150-49ae-b8e2-d13ec845eee9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:53.461809 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87cc1d0-89b9-40fe-8740-b1b84507db0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:53.463425 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87cc1d0-89b9-40fe-8740-b1b84507db0b None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:53.469546 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4512492-3150-49ae-b8e2-d13ec845eee9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:53.470983 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4512492-3150-49ae-b8e2-d13ec845eee9 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:53.480601 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-a87cc1d0-89b9-40fe-8740-b1b84507db0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:08:53.480601 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:08:53.480601 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:08:53.480601 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:08:53.480601 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:08:53.480601 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:08:53.480601 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:08:53.480601 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:08:53.480601 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:08:53.480601 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:08:53.480601 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:08:53.480601 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:08:53.480601 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:08:53.480601 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:08:53.480601 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:08:53.481636 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:08:53.481636 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:08:53.481636 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:08:53.481636 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:08:53.481636 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:08:53.481636 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:08:53.481636 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:08:53.481636 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:08:53.481636 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:08:53.481636 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:08:53.481636 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:08:53.481636 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:08:53.481636 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:08:53.481636 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:08:53.481636 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:08:53.481636 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:08:53.481636 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:08:53.482567 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:08:53.482567 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:08:53.482567 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:08:53.482567 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:08:53.482567 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 256/506] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:08:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:08:53.483281 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1f666-7275-4451-b19a-0879ae75fd95 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:53.483563 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1f666-7275-4451-b19a-0879ae75fd95 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:53.483839 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1f666-7275-4451-b19a-0879ae75fd95 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:53.489323 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 257/507] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:08:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:08:53.489323 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a1f666-7275-4451-b19a-0879ae75fd95 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:53.489512 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-f4512492-3150-49ae-b8e2-d13ec845eee9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:08:53.489512 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:08:53.489512 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:08:53.489512 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:08:53.489512 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:08:53.489512 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:08:53.489512 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:08:53.489512 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:08:53.489512 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:08:53.489512 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:08:53.489512 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:08:53.489512 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:08:53.489512 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:08:53.489512 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:08:53.489512 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:08:53.490371 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:08:53.490371 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:08:53.490371 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:08:53.490371 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:08:53.490371 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:08:53.490371 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:08:53.490371 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:08:53.490371 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:08:53.490371 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:08:53.490371 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:08:53.490371 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:08:53.490371 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:08:53.490371 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:08:53.490371 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:08:53.490371 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:08:53.490371 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:08:53.490371 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:08:53.491233 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:08:53.491233 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:08:53.491233 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:08:53.491233 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:08:53.491233 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 251/508] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:08:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:08:53.491233 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4512492-3150-49ae-b8e2-d13ec845eee9 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:53.538460 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:53.590582 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4512492-3150-49ae-b8e2-d13ec845eee9 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:53.591085 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a1f666-7275-4451-b19a-0879ae75fd95 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:53.624217 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87383901-b615-49ee-8e83-408d9181f497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:53.624770 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebd6776-e0c9-4b97-8c3a-e30c3b7b2862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:53.625006 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87383901-b615-49ee-8e83-408d9181f497 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:53.625299 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87383901-b615-49ee-8e83-408d9181f497 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:53.625551 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd6776-e0c9-4b97-8c3a-e30c3b7b2862 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:53.625639 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87383901-b615-49ee-8e83-408d9181f497 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:53.625835 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd6776-e0c9-4b97-8c3a-e30c3b7b2862 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:53.626111 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd6776-e0c9-4b97-8c3a-e30c3b7b2862 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:53.632660 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87383901-b615-49ee-8e83-408d9181f497 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:53.633504 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebd6776-e0c9-4b97-8c3a-e30c3b7b2862 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:53.634172 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87383901-b615-49ee-8e83-408d9181f497 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:53.635046 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebd6776-e0c9-4b97-8c3a-e30c3b7b2862 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:53.636794 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:53.649915 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-cebd6776-e0c9-4b97-8c3a-e30c3b7b2862 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 27 16:08:53.649915 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:08:53.649915 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:08:53.649915 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:08:53.649915 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:08:53.649915 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:08:53.649915 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:08:53.649915 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:08:53.649915 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:08:53.649915 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:08:53.649915 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:08:53.649915 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:08:53.649915 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 16:08:53.649915 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 16:08:53.649915 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 16:08:53.649915 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 16:08:53.651016 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:08:53.651016 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:08:53.651016 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 16:08:53.651016 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:08:53.651016 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 16:08:53.651016 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:08:53.651016 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:08:53.651016 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:08:53.651016 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:08:53.651016 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:08:53.651016 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:08:53.651016 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:08:53.651016 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:08:53.651016 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:08:53.651016 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:08:53.651016 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:08:53.651016 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:08:53.651016 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:08:53.652052 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:08:53.652052 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:08:53.652052 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 16:08:53.652052 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 16:08:53.652052 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 16:08:53.652052 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 16:08:53.652052 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 16:08:53.652052 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 16:08:53.652052 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 27 16:08:53.652052 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:08:53.652552 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-87383901-b615-49ee-8e83-408d9181f497 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 27 16:08:53.652552 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:08:53.652552 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:08:53.652552 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:08:53.652552 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:08:53.652552 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:08:53.652552 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:08:53.652552 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:08:53.652552 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:08:53.652552 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:08:53.652552 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:08:53.652552 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:08:53.652552 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 16:08:53.652552 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 16:08:53.652552 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 16:08:53.652552 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 16:08:53.653475 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:08:53.653475 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:08:53.653475 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 16:08:53.653475 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:08:53.653475 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 16:08:53.653475 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:08:53.653475 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:08:53.653475 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:08:53.653475 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:08:53.653475 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:08:53.653475 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:08:53.653475 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:08:53.653475 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:08:53.653475 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:08:53.653475 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:08:53.653475 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:08:53.653475 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:08:53.653475 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:08:53.654502 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:08:53.654502 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:08:53.654502 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 16:08:53.654502 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 16:08:53.654502 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 16:08:53.654502 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 16:08:53.654502 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 16:08:53.654502 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 16:08:53.654502 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 27 16:08:53.654502 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:08:53.655011 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 258/509] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 16:08:53 2022] GET /identity/v3/users/glance => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:08:53.655079 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 252/510] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 16:08:53 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:08:53.655079 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87383901-b615-49ee-8e83-408d9181f497 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:53.656548 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e11587-e37e-4eb5-ab16-326d1c041592 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:53.656842 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e11587-e37e-4eb5-ab16-326d1c041592 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:53.657121 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e11587-e37e-4eb5-ab16-326d1c041592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:53.675746 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-22e11587-e37e-4eb5-ab16-326d1c041592 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:08:53.677197 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-22e11587-e37e-4eb5-ab16-326d1c041592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:08:53.742744 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 259/511] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:08:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:08:53.743691 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e11587-e37e-4eb5-ab16-326d1c041592 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:53.752752 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87383901-b615-49ee-8e83-408d9181f497 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:53.761377 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:53.789001 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feadf36-f432-4cb0-933a-2169581ea7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:53.789655 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feadf36-f432-4cb0-933a-2169581ea7a4 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:53.789945 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feadf36-f432-4cb0-933a-2169581ea7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:53.790225 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feadf36-f432-4cb0-933a-2169581ea7a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:53.790998 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feadf36-f432-4cb0-933a-2169581ea7a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:53.791316 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feadf36-f432-4cb0-933a-2169581ea7a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:53.792688 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feadf36-f432-4cb0-933a-2169581ea7a4 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:53.804661 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 253/512] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 16:08:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:53.804661 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feadf36-f432-4cb0-933a-2169581ea7a4 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:53.849508 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e11587-e37e-4eb5-ab16-326d1c041592 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:53.875731 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:53.884119 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd329ce-228d-4797-9fd9-a19b548b8990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:53.884784 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd329ce-228d-4797-9fd9-a19b548b8990 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:53.885068 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd329ce-228d-4797-9fd9-a19b548b8990 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:53.885353 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd329ce-228d-4797-9fd9-a19b548b8990 None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:53.886149 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd329ce-228d-4797-9fd9-a19b548b8990 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:53.886487 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd329ce-228d-4797-9fd9-a19b548b8990 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:53.887874 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd329ce-228d-4797-9fd9-a19b548b8990 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:53.899080 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 260/513] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 16:08:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:53.899861 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd329ce-228d-4797-9fd9-a19b548b8990 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:53.913413 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feadf36-f432-4cb0-933a-2169581ea7a4 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:53.947421 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa516c-43d5-4f60-bafe-e7c26687709e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:53.948084 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa516c-43d5-4f60-bafe-e7c26687709e None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:53.948372 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa516c-43d5-4f60-bafe-e7c26687709e None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:53.948653 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa516c-43d5-4f60-bafe-e7c26687709e None admin] PATH_INFO: `/v3/users` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:53.949490 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fa516c-43d5-4f60-bafe-e7c26687709e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:53.949802 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fa516c-43d5-4f60-bafe-e7c26687709e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:53.951271 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fa516c-43d5-4f60-bafe-e7c26687709e None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:53.988236 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 254/514] 10.222.0.62 () {56 vars in 1137 bytes} [Fri May 27 16:08:53 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:53.989050 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa516c-43d5-4f60-bafe-e7c26687709e None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:54.002389 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd329ce-228d-4797-9fd9-a19b548b8990 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:54.014040 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:54.037061 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3664c04-47f2-4118-a3e9-82f661c9b21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:54.037722 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3664c04-47f2-4118-a3e9-82f661c9b21b None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:54.039832 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3664c04-47f2-4118-a3e9-82f661c9b21b None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:54.039832 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3664c04-47f2-4118-a3e9-82f661c9b21b None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:54.039832 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3664c04-47f2-4118-a3e9-82f661c9b21b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:54.040064 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3664c04-47f2-4118-a3e9-82f661c9b21b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:54.041406 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3664c04-47f2-4118-a3e9-82f661c9b21b None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:54.058564 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 261/515] 10.222.0.62 () {56 vars in 1137 bytes} [Fri May 27 16:08:53 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:54.059363 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3664c04-47f2-4118-a3e9-82f661c9b21b None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:54.092921 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa516c-43d5-4f60-bafe-e7c26687709e None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:54.106507 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:54.127682 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c6e043-cc3e-4c77-a4cc-fbf979508e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:54.128475 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c6e043-cc3e-4c77-a4cc-fbf979508e01 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:54.128760 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c6e043-cc3e-4c77-a4cc-fbf979508e01 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:54.129036 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c6e043-cc3e-4c77-a4cc-fbf979508e01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:54.139426 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c6e043-cc3e-4c77-a4cc-fbf979508e01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:54.140878 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c6e043-cc3e-4c77-a4cc-fbf979508e01 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:54.158964 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-40c6e043-cc3e-4c77-a4cc-fbf979508e01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:08:54.158964 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:08:54.158964 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:08:54.158964 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:08:54.158964 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:08:54.158964 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:08:54.158964 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:08:54.158964 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:08:54.158964 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:08:54.158964 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:08:54.158964 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:08:54.158964 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:08:54.158964 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:08:54.158964 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:08:54.158964 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:08:54.159994 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:08:54.159994 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:08:54.159994 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:08:54.159994 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:08:54.159994 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:08:54.159994 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:08:54.159994 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:08:54.159994 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:08:54.159994 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:08:54.159994 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:08:54.159994 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:08:54.159994 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:08:54.159994 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:08:54.159994 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:08:54.159994 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:08:54.159994 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:08:54.159994 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:08:54.160860 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:08:54.160860 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:08:54.160860 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:08:54.160860 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:08:54.161067 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3664c04-47f2-4118-a3e9-82f661c9b21b None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:54.161137 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 255/516] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:08:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:08:54.161137 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c6e043-cc3e-4c77-a4cc-fbf979508e01 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:54.197813 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a3fc5b-09a0-4e53-bf75-3697bd491dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:54.198673 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3fc5b-09a0-4e53-bf75-3697bd491dc3 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:54.198960 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3fc5b-09a0-4e53-bf75-3697bd491dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:54.199239 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3fc5b-09a0-4e53-bf75-3697bd491dc3 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:54.206171 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a3fc5b-09a0-4e53-bf75-3697bd491dc3 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:54.207644 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a3fc5b-09a0-4e53-bf75-3697bd491dc3 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:54.222796 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-e2a3fc5b-09a0-4e53-bf75-3697bd491dc3 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 27 16:08:54.222796 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:08:54.222796 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:08:54.222796 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:08:54.222796 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:08:54.222796 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:08:54.222796 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:08:54.222796 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:08:54.222796 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:08:54.222796 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:08:54.222796 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:08:54.222796 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:08:54.222796 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 16:08:54.222796 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 16:08:54.222796 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 16:08:54.222796 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 16:08:54.223676 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:08:54.223676 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:08:54.223676 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 16:08:54.223676 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:08:54.223676 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 16:08:54.223676 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:08:54.223676 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:08:54.223676 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:08:54.223676 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:08:54.223676 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:08:54.223676 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:08:54.223676 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:08:54.223676 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:08:54.223676 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:08:54.223676 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:08:54.223676 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:08:54.223676 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:08:54.223676 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:08:54.224543 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:08:54.224543 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:08:54.224543 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 16:08:54.224543 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 16:08:54.224543 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 16:08:54.224543 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 16:08:54.224543 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 16:08:54.224543 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 16:08:54.224543 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 27 16:08:54.224543 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:08:54.224543 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 262/517] 10.222.0.62 () {56 vars in 1102 bytes} [Fri May 27 16:08:54 2022] GET /identity/v3/users/neutron => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:08:54.225599 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a3fc5b-09a0-4e53-bf75-3697bd491dc3 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:54.240804 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:54.263010 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c6e043-cc3e-4c77-a4cc-fbf979508e01 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:54.298835 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d796cfe1-ba81-46f7-a3a0-4db50e6e88cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:54.299628 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d796cfe1-ba81-46f7-a3a0-4db50e6e88cb None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:54.300281 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d796cfe1-ba81-46f7-a3a0-4db50e6e88cb None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:54.300566 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d796cfe1-ba81-46f7-a3a0-4db50e6e88cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:54.307889 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d796cfe1-ba81-46f7-a3a0-4db50e6e88cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:54.309353 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d796cfe1-ba81-46f7-a3a0-4db50e6e88cb None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:54.324016 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a3fc5b-09a0-4e53-bf75-3697bd491dc3 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:54.324507 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-d796cfe1-ba81-46f7-a3a0-4db50e6e88cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:08:54.324507 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:08:54.324507 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:08:54.324507 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:08:54.324507 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:08:54.324507 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:08:54.324507 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:08:54.324507 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:08:54.324507 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:08:54.324507 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:08:54.324507 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:08:54.324507 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:08:54.324507 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 16:08:54.324507 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 16:08:54.324507 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 16:08:54.325498 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 16:08:54.325498 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:08:54.325498 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:08:54.325498 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:08:54.325498 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:08:54.325498 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:08:54.325498 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:08:54.325498 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:08:54.325498 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:08:54.325498 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:08:54.325498 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:08:54.325498 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:08:54.325498 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:08:54.325498 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:08:54.325498 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:08:54.325498 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:08:54.325498 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:08:54.326595 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 16:08:54.326595 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 16:08:54.326595 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 16:08:54.326595 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 16:08:54.326595 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 16:08:54.326595 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 16:08:54.326595 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:08:54.326595 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:08:54.326595 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 256/518] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 16:08:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:08:54.326595 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d796cfe1-ba81-46f7-a3a0-4db50e6e88cb None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:54.332351 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:54.359924 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9113962c-7d3d-4e72-9626-1e04bdbf441d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:54.360511 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113962c-7d3d-4e72-9626-1e04bdbf441d None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:54.360797 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113962c-7d3d-4e72-9626-1e04bdbf441d None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:54.361081 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113962c-7d3d-4e72-9626-1e04bdbf441d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:54.424526 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d796cfe1-ba81-46f7-a3a0-4db50e6e88cb None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:54.427106 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9113962c-7d3d-4e72-9626-1e04bdbf441d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:54.428651 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9113962c-7d3d-4e72-9626-1e04bdbf441d None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:54.459311 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5788e7da-0271-4712-bc74-2999c36f0437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:54.459948 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5788e7da-0271-4712-bc74-2999c36f0437 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:54.460233 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5788e7da-0271-4712-bc74-2999c36f0437 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:54.461052 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5788e7da-0271-4712-bc74-2999c36f0437 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:54.464438 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:54.525967 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 263/519] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 16:08:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 16:08:54.526834 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9113962c-7d3d-4e72-9626-1e04bdbf441d None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:54.528062 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5788e7da-0271-4712-bc74-2999c36f0437 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:54.529541 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5788e7da-0271-4712-bc74-2999c36f0437 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:54.535386 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:54.627004 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9113962c-7d3d-4e72-9626-1e04bdbf441d None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:54.630694 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 257/520] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 16:08:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 16:08:54.631539 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5788e7da-0271-4712-bc74-2999c36f0437 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:54.661320 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a5749f-2ea9-4d09-843a-df487ec35565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:54.661977 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5749f-2ea9-4d09-843a-df487ec35565 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:54.662275 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5749f-2ea9-4d09-843a-df487ec35565 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:54.662565 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5749f-2ea9-4d09-843a-df487ec35565 None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:54.663277 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a5749f-2ea9-4d09-843a-df487ec35565 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:54.663582 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a5749f-2ea9-4d09-843a-df487ec35565 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:54.665029 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a5749f-2ea9-4d09-843a-df487ec35565 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:54.666798 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:54.676626 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 264/521] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 16:08:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:54.677522 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a5749f-2ea9-4d09-843a-df487ec35565 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:54.733817 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5788e7da-0271-4712-bc74-2999c36f0437 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:54.743904 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:54.769204 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1bc75c-05ec-4c1a-a09a-36de73ca9044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:54.769876 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1bc75c-05ec-4c1a-a09a-36de73ca9044 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:54.770163 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1bc75c-05ec-4c1a-a09a-36de73ca9044 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:54.770468 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1bc75c-05ec-4c1a-a09a-36de73ca9044 None admin] PATH_INFO: `/v3/users` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:54.771316 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1bc75c-05ec-4c1a-a09a-36de73ca9044 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:54.771629 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1bc75c-05ec-4c1a-a09a-36de73ca9044 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:54.773130 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1bc75c-05ec-4c1a-a09a-36de73ca9044 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:54.778055 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a5749f-2ea9-4d09-843a-df487ec35565 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:54.790112 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 258/522] 10.222.0.62 () {56 vars in 1139 bytes} [Fri May 27 16:08:54 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:54.790957 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1bc75c-05ec-4c1a-a09a-36de73ca9044 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:54.813784 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a668514-b6e6-46aa-bed0-f1c333b0a863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:54.814467 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a668514-b6e6-46aa-bed0-f1c333b0a863 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:54.814756 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a668514-b6e6-46aa-bed0-f1c333b0a863 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:54.815032 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a668514-b6e6-46aa-bed0-f1c333b0a863 None admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:54.815805 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a668514-b6e6-46aa-bed0-f1c333b0a863 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:54.816112 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a668514-b6e6-46aa-bed0-f1c333b0a863 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:54.817534 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a668514-b6e6-46aa-bed0-f1c333b0a863 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:54.835329 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 265/523] 10.222.0.62 () {56 vars in 1148 bytes} [Fri May 27 16:08:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:54.836146 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a668514-b6e6-46aa-bed0-f1c333b0a863 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:54.903288 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:54.909447 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1bc75c-05ec-4c1a-a09a-36de73ca9044 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:54.941267 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a668514-b6e6-46aa-bed0-f1c333b0a863 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:54.943548 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c241da76-d599-4ed6-966a-9b541c9468dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:54.944337 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c241da76-d599-4ed6-966a-9b541c9468dd None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:54.944626 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c241da76-d599-4ed6-966a-9b541c9468dd None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:54.945477 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c241da76-d599-4ed6-966a-9b541c9468dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:54.955362 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c241da76-d599-4ed6-966a-9b541c9468dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:54.956816 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c241da76-d599-4ed6-966a-9b541c9468dd None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:54.966487 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:54.973802 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-c241da76-d599-4ed6-966a-9b541c9468dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:08:54.973802 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:08:54.973802 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:08:54.973802 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:08:54.973802 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:08:54.973802 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:08:54.973802 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:08:54.973802 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:08:54.973802 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:08:54.973802 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:08:54.973802 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:08:54.973802 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:08:54.973802 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:08:54.973802 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:08:54.973802 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:08:54.975851 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:08:54.975851 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:08:54.975851 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:08:54.975851 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:08:54.975851 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:08:54.975851 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:08:54.975851 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:08:54.975851 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:08:54.975851 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:08:54.975851 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:08:54.975851 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:08:54.975851 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:08:54.975851 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:08:54.975851 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:08:54.975851 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:08:54.975851 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:08:54.975851 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:08:54.976728 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:08:54.976728 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:08:54.976728 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:08:54.976728 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:08:54.976938 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5cc4f7-ec50-4bad-89fa-00d1e53ffee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:54.977022 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 259/524] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:08:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:08:54.977089 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5cc4f7-ec50-4bad-89fa-00d1e53ffee6 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:54.977089 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5cc4f7-ec50-4bad-89fa-00d1e53ffee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:54.977291 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c241da76-d599-4ed6-966a-9b541c9468dd None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:54.977358 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5cc4f7-ec50-4bad-89fa-00d1e53ffee6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:54.989874 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5cc4f7-ec50-4bad-89fa-00d1e53ffee6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:54.991384 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5cc4f7-ec50-4bad-89fa-00d1e53ffee6 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:55.010194 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-0c5cc4f7-ec50-4bad-89fa-00d1e53ffee6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:08:55.010194 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:08:55.010194 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:08:55.010194 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:08:55.010194 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:08:55.010194 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:08:55.010194 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:08:55.010194 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:08:55.010194 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:08:55.010194 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:08:55.010194 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:08:55.010194 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:08:55.010194 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:08:55.010194 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:08:55.010194 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:08:55.011575 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:08:55.011575 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:08:55.011575 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:08:55.011575 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:08:55.011575 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:08:55.011575 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:08:55.011575 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:08:55.011575 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:08:55.011575 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:08:55.011575 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:08:55.011575 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:08:55.011575 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:08:55.011575 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:08:55.011575 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:08:55.011575 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:08:55.011575 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:08:55.011575 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:08:55.012423 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:08:55.012423 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:08:55.012423 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:08:55.012423 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:08:55.014383 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 266/525] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:08:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:08:55.015369 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5cc4f7-ec50-4bad-89fa-00d1e53ffee6 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:55.077581 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c241da76-d599-4ed6-966a-9b541c9468dd None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:55.111385 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971e070e-4ed6-4a64-a68f-d66b2777344a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:55.112040 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e070e-4ed6-4a64-a68f-d66b2777344a None admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:55.112331 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e070e-4ed6-4a64-a68f-d66b2777344a None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:55.112604 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e070e-4ed6-4a64-a68f-d66b2777344a None admin] PATH_INFO: `/v3/users` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:55.113300 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971e070e-4ed6-4a64-a68f-d66b2777344a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:55.114746 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971e070e-4ed6-4a64-a68f-d66b2777344a None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:55.115842 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5cc4f7-ec50-4bad-89fa-00d1e53ffee6 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:55.150356 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea68c5f8-2767-44d1-9331-aa3c4980fc87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:55.150998 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68c5f8-2767-44d1-9331-aa3c4980fc87 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:55.151282 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68c5f8-2767-44d1-9331-aa3c4980fc87 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:55.151561 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68c5f8-2767-44d1-9331-aa3c4980fc87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:55.196212 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:55.216596 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea68c5f8-2767-44d1-9331-aa3c4980fc87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:55.216735 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 260/526] 10.222.0.62 () {60 vars in 1132 bytes} [Fri May 27 16:08:54 2022] POST /identity/v3/users => generated 247 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:08:55.217604 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971e070e-4ed6-4a64-a68f-d66b2777344a None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:55.218211 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea68c5f8-2767-44d1-9331-aa3c4980fc87 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:55.221199 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:55.332147 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 267/527] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 16:08:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 16:08:55.333186 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea68c5f8-2767-44d1-9331-aa3c4980fc87 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:55.333439 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971e070e-4ed6-4a64-a68f-d66b2777344a None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:55.375458 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b0a8bb-5230-4507-909d-c0b36a0c5ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:55.376131 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b0a8bb-5230-4507-909d-c0b36a0c5ed2 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:55.376424 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b0a8bb-5230-4507-909d-c0b36a0c5ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:55.376697 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b0a8bb-5230-4507-909d-c0b36a0c5ed2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:55.377559 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b0a8bb-5230-4507-909d-c0b36a0c5ed2 None admin] RBAC: Adding query filter params (role.id=1d9076bd231c43809cb971b6360e0c28, scope.project.id=d48d95a12587479ca5714f6ebd60dd9f, user.id=cb13ad6d8b1e46029262556bff398796) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:55.377875 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b0a8bb-5230-4507-909d-c0b36a0c5ed2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:55.379396 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b0a8bb-5230-4507-909d-c0b36a0c5ed2 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:55.393742 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 261/528] 10.222.0.62 () {56 vars in 1374 bytes} [Fri May 27 16:08:55 2022] GET /identity/v3/role_assignments?user.id=cb13ad6d8b1e46029262556bff398796&scope.project.id=d48d95a12587479ca5714f6ebd60dd9f&role.id=1d9076bd231c43809cb971b6360e0c28 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:55.393742 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b0a8bb-5230-4507-909d-c0b36a0c5ed2 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:55.439161 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:55.466045 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea68c5f8-2767-44d1-9331-aa3c4980fc87 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:55.487293 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:55.519136 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c656c-9247-4645-968e-1eb37fbebab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:55.519831 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c656c-9247-4645-968e-1eb37fbebab2 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:55.520124 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c656c-9247-4645-968e-1eb37fbebab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:55.520407 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c656c-9247-4645-968e-1eb37fbebab2 None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:55.521148 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90c656c-9247-4645-968e-1eb37fbebab2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:55.521466 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90c656c-9247-4645-968e-1eb37fbebab2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:55.523486 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90c656c-9247-4645-968e-1eb37fbebab2 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:55.535543 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b0a8bb-5230-4507-909d-c0b36a0c5ed2 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:55.538196 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 268/529] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 16:08:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:55.539428 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c656c-9247-4645-968e-1eb37fbebab2 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:55.584243 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0647029a-e885-46fd-a536-9912cd81c251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:55.586473 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0647029a-e885-46fd-a536-9912cd81c251 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:55.586950 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0647029a-e885-46fd-a536-9912cd81c251 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:55.587423 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0647029a-e885-46fd-a536-9912cd81c251 None admin] PATH_INFO: `/v3/domains` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:55.588802 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0647029a-e885-46fd-a536-9912cd81c251 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:55.589296 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0647029a-e885-46fd-a536-9912cd81c251 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:55.591388 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0647029a-e885-46fd-a536-9912cd81c251 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:55.609597 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 262/530] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 16:08:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:55.615026 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0647029a-e885-46fd-a536-9912cd81c251 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:55.668963 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c656c-9247-4645-968e-1eb37fbebab2 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:55.718025 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a986ef55-a6ca-4d12-8a11-10b194748944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:55.719149 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986ef55-a6ca-4d12-8a11-10b194748944 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:55.719444 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986ef55-a6ca-4d12-8a11-10b194748944 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:55.719725 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986ef55-a6ca-4d12-8a11-10b194748944 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:55.729486 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:55.736453 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a986ef55-a6ca-4d12-8a11-10b194748944 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:55.737508 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0647029a-e885-46fd-a536-9912cd81c251 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:55.738531 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a986ef55-a6ca-4d12-8a11-10b194748944 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:55.763065 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-a986ef55-a6ca-4d12-8a11-10b194748944 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:08:55.763065 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:08:55.763065 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:08:55.763065 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:08:55.763065 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:08:55.763065 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:08:55.763065 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:08:55.763065 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:08:55.763065 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:08:55.763065 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:08:55.763065 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:08:55.763065 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:08:55.763065 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:08:55.763065 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:08:55.763065 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:08:55.766820 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:08:55.766820 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:08:55.766820 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:08:55.766820 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:08:55.766820 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:08:55.766820 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:08:55.766820 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:08:55.766820 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:08:55.766820 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:08:55.766820 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:08:55.766820 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:08:55.766820 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:08:55.766820 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:08:55.766820 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:08:55.766820 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:08:55.766820 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:08:55.766820 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:08:55.767669 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:08:55.767669 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:08:55.767669 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:08:55.767669 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:08:55.767669 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 269/531] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:08:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:08:55.768416 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:55.769644 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a986ef55-a6ca-4d12-8a11-10b194748944 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:55.780471 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255541f8-a859-4661-a785-86cc1ec1d71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:55.781267 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255541f8-a859-4661-a785-86cc1ec1d71d None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:55.781554 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255541f8-a859-4661-a785-86cc1ec1d71d None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:55.781830 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255541f8-a859-4661-a785-86cc1ec1d71d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:55.789523 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255541f8-a859-4661-a785-86cc1ec1d71d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:55.791286 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255541f8-a859-4661-a785-86cc1ec1d71d None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:55.809566 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-255541f8-a859-4661-a785-86cc1ec1d71d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:08:55.809566 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:08:55.809566 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:08:55.809566 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:08:55.809566 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:08:55.809566 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:08:55.809566 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:08:55.809566 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:08:55.809566 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:08:55.809566 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:08:55.809566 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:08:55.809566 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:08:55.809566 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 16:08:55.809566 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 16:08:55.809566 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 16:08:55.810513 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 16:08:55.810513 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:08:55.810513 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:08:55.810513 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:08:55.810513 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:08:55.810513 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:08:55.810513 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:08:55.810513 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:08:55.810513 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:08:55.810513 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:08:55.810513 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:08:55.810513 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:08:55.810513 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:08:55.810513 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:08:55.810513 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:08:55.810513 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:08:55.810513 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:08:55.811346 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 16:08:55.811346 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 16:08:55.811346 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 16:08:55.811346 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 16:08:55.811346 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 16:08:55.811346 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 16:08:55.811346 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:08:55.811346 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:08:55.815664 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 263/532] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 16:08:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:08:55.816515 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255541f8-a859-4661-a785-86cc1ec1d71d None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:55.905514 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a986ef55-a6ca-4d12-8a11-10b194748944 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:55.943344 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c9b0e1-1687-4521-a3c8-6e15e39fe252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:55.944146 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9b0e1-1687-4521-a3c8-6e15e39fe252 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:55.944433 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9b0e1-1687-4521-a3c8-6e15e39fe252 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:55.944747 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9b0e1-1687-4521-a3c8-6e15e39fe252 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:55.952076 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c9b0e1-1687-4521-a3c8-6e15e39fe252 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:55.953562 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c9b0e1-1687-4521-a3c8-6e15e39fe252 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:55.965948 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255541f8-a859-4661-a785-86cc1ec1d71d None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:55.972308 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-e5c9b0e1-1687-4521-a3c8-6e15e39fe252 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:08:55.972308 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:08:55.972308 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:08:55.972308 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:08:55.972308 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:08:55.972308 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:08:55.972308 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:08:55.972308 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:08:55.972308 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:08:55.972308 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:08:55.972308 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:08:55.972308 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:08:55.972308 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 16:08:55.972308 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 16:08:55.972308 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 16:08:55.973140 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 16:08:55.973140 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:08:55.973140 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:08:55.973140 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:08:55.973140 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:08:55.973140 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:08:55.973140 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:08:55.973140 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:08:55.973140 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:08:55.973140 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:08:55.973140 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:08:55.973140 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:08:55.973140 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:08:55.973140 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:08:55.973140 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:08:55.973140 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:08:55.973140 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:08:55.974049 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 16:08:55.974049 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 16:08:55.974049 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 16:08:55.974049 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 16:08:55.974049 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 16:08:55.974049 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 16:08:55.974049 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:08:55.974049 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:08:55.974472 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 270/533] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 16:08:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:08:55.978291 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c9b0e1-1687-4521-a3c8-6e15e39fe252 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:56.012801 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ec604-e60b-447d-b44e-90183e0cb49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:56.013747 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ec604-e60b-447d-b44e-90183e0cb49d None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:56.014038 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ec604-e60b-447d-b44e-90183e0cb49d None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:56.014602 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ec604-e60b-447d-b44e-90183e0cb49d None admin] PATH_INFO: `/v3/domains` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:56.015756 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1ec604-e60b-447d-b44e-90183e0cb49d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:56.016338 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1ec604-e60b-447d-b44e-90183e0cb49d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:56.018455 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1ec604-e60b-447d-b44e-90183e0cb49d None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:56.033930 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 264/534] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 16:08:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:56.034954 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ec604-e60b-447d-b44e-90183e0cb49d None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:56.048603 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:56.097760 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:56.120304 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c9b0e1-1687-4521-a3c8-6e15e39fe252 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:56.159167 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ec604-e60b-447d-b44e-90183e0cb49d None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:56.168577 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7626e9-a09f-4fd6-83ba-0d22fc5199ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:56.169264 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7626e9-a09f-4fd6-83ba-0d22fc5199ed None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:56.169559 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7626e9-a09f-4fd6-83ba-0d22fc5199ed None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:56.169841 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7626e9-a09f-4fd6-83ba-0d22fc5199ed None admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:56.171234 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7626e9-a09f-4fd6-83ba-0d22fc5199ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:56.171556 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7626e9-a09f-4fd6-83ba-0d22fc5199ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:56.173772 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7626e9-a09f-4fd6-83ba-0d22fc5199ed None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:56.194347 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 271/535] 10.222.0.62 () {56 vars in 1148 bytes} [Fri May 27 16:08:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:56.195868 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7626e9-a09f-4fd6-83ba-0d22fc5199ed None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:56.214267 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d409fafd-f4d7-416d-a786-58bb33d3385f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:56.214962 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d409fafd-f4d7-416d-a786-58bb33d3385f None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:56.220111 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d409fafd-f4d7-416d-a786-58bb33d3385f None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:56.220111 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d409fafd-f4d7-416d-a786-58bb33d3385f None admin] PATH_INFO: `/v3/projects` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:56.220111 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d409fafd-f4d7-416d-a786-58bb33d3385f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:56.220111 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d409fafd-f4d7-416d-a786-58bb33d3385f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:56.220111 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d409fafd-f4d7-416d-a786-58bb33d3385f None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:56.249114 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 265/536] 10.222.0.62 () {56 vars in 1148 bytes} [Fri May 27 16:08:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:56.250343 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d409fafd-f4d7-416d-a786-58bb33d3385f None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:56.313168 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7626e9-a09f-4fd6-83ba-0d22fc5199ed None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:56.325066 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:56.349654 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b03cd2-6dca-4cbd-b233-3399c32352c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:56.350879 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b03cd2-6dca-4cbd-b233-3399c32352c6 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:56.351394 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b03cd2-6dca-4cbd-b233-3399c32352c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:56.351924 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b03cd2-6dca-4cbd-b233-3399c32352c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:56.360032 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b03cd2-6dca-4cbd-b233-3399c32352c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:56.361701 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b03cd2-6dca-4cbd-b233-3399c32352c6 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:56.376233 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d409fafd-f4d7-416d-a786-58bb33d3385f None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:56.382209 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-71b03cd2-6dca-4cbd-b233-3399c32352c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:08:56.382209 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:08:56.382209 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:08:56.382209 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:08:56.382209 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:08:56.382209 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:08:56.382209 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:08:56.382209 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:08:56.382209 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:08:56.382209 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:08:56.382209 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:08:56.382209 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:08:56.382209 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 16:08:56.382209 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 16:08:56.382209 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 16:08:56.383069 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 16:08:56.383069 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:08:56.383069 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:08:56.383069 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:08:56.383069 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:08:56.383069 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:08:56.383069 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:08:56.383069 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:08:56.383069 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:08:56.383069 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:08:56.383069 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:08:56.383069 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:08:56.383069 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:08:56.383069 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:08:56.383069 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:08:56.383069 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:08:56.383069 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:08:56.383907 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 16:08:56.383907 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 16:08:56.383907 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 16:08:56.383907 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 16:08:56.383907 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 16:08:56.383907 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 16:08:56.383907 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:08:56.383907 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:08:56.388610 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 272/537] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 16:08:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:08:56.389295 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:56.390181 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b03cd2-6dca-4cbd-b233-3399c32352c6 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:56.420889 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b2d2a0-8664-4a08-8a95-43e190aa85cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:56.421928 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b2d2a0-8664-4a08-8a95-43e190aa85cb None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:56.422534 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b2d2a0-8664-4a08-8a95-43e190aa85cb None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:56.423110 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b2d2a0-8664-4a08-8a95-43e190aa85cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:56.424232 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b2d2a0-8664-4a08-8a95-43e190aa85cb None admin] RBAC: Adding query filter params (role.id=1d9076bd231c43809cb971b6360e0c28, scope.project.id=d48d95a12587479ca5714f6ebd60dd9f, user.id=2b072079733049e8ac204ebe5cc635ec) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:56.424755 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b2d2a0-8664-4a08-8a95-43e190aa85cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:56.426630 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b2d2a0-8664-4a08-8a95-43e190aa85cb None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:56.434514 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 266/538] 10.222.0.62 () {56 vars in 1374 bytes} [Fri May 27 16:08:56 2022] GET /identity/v3/role_assignments?user.id=2b072079733049e8ac204ebe5cc635ec&scope.project.id=d48d95a12587479ca5714f6ebd60dd9f&role.id=1d9076bd231c43809cb971b6360e0c28 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:56.435667 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b2d2a0-8664-4a08-8a95-43e190aa85cb None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:56.590344 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b03cd2-6dca-4cbd-b233-3399c32352c6 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:56.634201 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b2d2a0-8664-4a08-8a95-43e190aa85cb None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:56.654975 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd560c-5004-4f5e-afeb-f60385096fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:56.656189 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd560c-5004-4f5e-afeb-f60385096fcb None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:56.656679 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd560c-5004-4f5e-afeb-f60385096fcb None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:56.657157 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd560c-5004-4f5e-afeb-f60385096fcb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:56.658196 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bd560c-5004-4f5e-afeb-f60385096fcb None admin] RBAC: Adding query filter params (role.id=1d9076bd231c43809cb971b6360e0c28, scope.project.id=d48d95a12587479ca5714f6ebd60dd9f, user.id=d8693a1e72f14fdfb383f11e96330726) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:56.658737 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bd560c-5004-4f5e-afeb-f60385096fcb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:56.660632 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bd560c-5004-4f5e-afeb-f60385096fcb None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:56.672758 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79154608-ef24-41d5-a1fe-e79de20c1d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:56.673297 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79154608-ef24-41d5-a1fe-e79de20c1d7f None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:56.673580 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79154608-ef24-41d5-a1fe-e79de20c1d7f None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:56.673832 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79154608-ef24-41d5-a1fe-e79de20c1d7f None admin] PATH_INFO: `/v3/projects` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:56.674666 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79154608-ef24-41d5-a1fe-e79de20c1d7f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:56.674980 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79154608-ef24-41d5-a1fe-e79de20c1d7f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:56.676296 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 273/539] 10.222.0.62 () {56 vars in 1374 bytes} [Fri May 27 16:08:56 2022] GET /identity/v3/role_assignments?user.id=d8693a1e72f14fdfb383f11e96330726&scope.project.id=d48d95a12587479ca5714f6ebd60dd9f&role.id=1d9076bd231c43809cb971b6360e0c28 => generated 259 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:56.676488 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79154608-ef24-41d5-a1fe-e79de20c1d7f None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:56.695820 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 267/540] 10.222.0.62 () {56 vars in 1148 bytes} [Fri May 27 16:08:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:56.697290 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd560c-5004-4f5e-afeb-f60385096fcb None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:56.742967 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:56.815522 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd560c-5004-4f5e-afeb-f60385096fcb None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:56.873149 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b41361-c7ee-4d20-9f1d-6751d1917c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:56.873820 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b41361-c7ee-4d20-9f1d-6751d1917c23 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:56.874107 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b41361-c7ee-4d20-9f1d-6751d1917c23 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:56.874413 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b41361-c7ee-4d20-9f1d-6751d1917c23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:56.875259 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b41361-c7ee-4d20-9f1d-6751d1917c23 None admin] RBAC: Adding query filter params (role.id=1d9076bd231c43809cb971b6360e0c28, scope.project.id=d48d95a12587479ca5714f6ebd60dd9f, user.id=b367ccea28d540a0b24ec4e42ebfef65) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:56.875573 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b41361-c7ee-4d20-9f1d-6751d1917c23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:56.879368 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b41361-c7ee-4d20-9f1d-6751d1917c23 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:56.886648 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 274/541] 10.222.0.62 () {56 vars in 1374 bytes} [Fri May 27 16:08:56 2022] GET /identity/v3/role_assignments?user.id=b367ccea28d540a0b24ec4e42ebfef65&scope.project.id=d48d95a12587479ca5714f6ebd60dd9f&role.id=1d9076bd231c43809cb971b6360e0c28 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:57.657141 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608946fd-43b5-474e-83f7-adfbe94c83de None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:57.657672 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608946fd-43b5-474e-83f7-adfbe94c83de None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:57.657672 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608946fd-43b5-474e-83f7-adfbe94c83de None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:57.659555 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 268/542] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:08:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:08:57.665609 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbb6e9-8314-4a6d-8817-77a9d9a9bae7 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:57.666033 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbb6e9-8314-4a6d-8817-77a9d9a9bae7 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:57.666216 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbb6e9-8314-4a6d-8817-77a9d9a9bae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:57.687991 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-c1fbb6e9-8314-4a6d-8817-77a9d9a9bae7 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:08:57.689167 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-c1fbb6e9-8314-4a6d-8817-77a9d9a9bae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:08:57.740332 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8814f9-5106-4ce3-9647-986dce33224e None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:57.740721 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8814f9-5106-4ce3-9647-986dce33224e None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:57.740892 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8814f9-5106-4ce3-9647-986dce33224e None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:57.744299 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 269/543] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:08:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:08:57.750440 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ba5ed-5f2f-4a91-97fd-78ab951b3d8d None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:57.750440 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ba5ed-5f2f-4a91-97fd-78ab951b3d8d None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:57.750440 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ba5ed-5f2f-4a91-97fd-78ab951b3d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:57.779237 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-5a7ba5ed-5f2f-4a91-97fd-78ab951b3d8d None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:08:57.780856 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-5a7ba5ed-5f2f-4a91-97fd-78ab951b3d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:08:57.782365 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 275/544] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:08:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 16:08:57.801639 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fbb6e9-8314-4a6d-8817-77a9d9a9bae7 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:57.833532 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:57.835687 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:57.933528 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fbb6e9-8314-4a6d-8817-77a9d9a9bae7 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:57.948933 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 270/545] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:08:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:08:57.978697 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7ba5ed-5f2f-4a91-97fd-78ab951b3d8d None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:57.979436 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6015a26f-355a-432d-b742-e52b9e50029f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:57.980300 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6015a26f-355a-432d-b742-e52b9e50029f None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:57.980590 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6015a26f-355a-432d-b742-e52b9e50029f None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:57.981079 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6015a26f-355a-432d-b742-e52b9e50029f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:58.005217 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6015a26f-355a-432d-b742-e52b9e50029f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:08:58.022502 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-6015a26f-355a-432d-b742-e52b9e50029f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 16:08:58.022502 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:08:58.022502 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:08:58.022502 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:08:58.022502 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:08:58.022502 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:08:58.022502 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:08:58.022502 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:08:58.022502 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:08:58.022502 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:08:58.022502 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:08:58.022502 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:08:58.022502 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:08:58.022502 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:08:58.022502 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:08:58.022502 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:08:58.023685 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:08:58.023685 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:08:58.023685 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:08:58.023685 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:08:58.023685 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:08:58.023685 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:08:58.023685 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:08:58.023685 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:08:58.023685 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:08:58.023685 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:08:58.023685 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:08:58.023685 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:08:58.023685 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:08:58.023685 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:08:58.023685 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:08:58.023685 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:08:58.024475 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:08:58.024475 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:08:58.024475 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:08:58.024475 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:08:58.024475 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:08:58.024475 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:08:58.024475 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:08:58.024475 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:08:58.024475 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:08:58.024475 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:08:58.024475 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 16:08:58.024475 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:08:58.027559 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 276/546] 10.222.0.62 () {56 vars in 1102 bytes} [Fri May 27 16:08:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:08:58.029545 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6015a26f-355a-432d-b742-e52b9e50029f None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:58.174666 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:58.186161 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6015a26f-355a-432d-b742-e52b9e50029f None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:58.186621 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7ba5ed-5f2f-4a91-97fd-78ab951b3d8d None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:58.221253 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a797607-addc-4e62-9362-64c4868a9467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:58.222454 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a797607-addc-4e62-9362-64c4868a9467 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:58.222979 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a797607-addc-4e62-9362-64c4868a9467 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:58.223442 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a797607-addc-4e62-9362-64c4868a9467 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:58.236114 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a797607-addc-4e62-9362-64c4868a9467 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:08:58.246092 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-8a797607-addc-4e62-9362-64c4868a9467 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 16:08:58.246092 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:08:58.246092 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:08:58.246092 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:08:58.246092 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:08:58.246092 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:08:58.246092 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:08:58.246092 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:08:58.246092 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:08:58.246092 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:08:58.246092 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:08:58.246092 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:08:58.246092 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:08:58.246092 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:08:58.246092 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:08:58.246092 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:08:58.247003 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:08:58.247003 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:08:58.247003 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:08:58.247003 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:08:58.247003 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:08:58.247003 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:08:58.247003 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:08:58.247003 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:08:58.247003 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:08:58.247003 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:08:58.247003 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:08:58.247003 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:08:58.247003 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:08:58.247003 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:08:58.247003 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:08:58.247003 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:08:58.247782 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:08:58.247782 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:08:58.247782 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:08:58.247782 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:08:58.247782 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:08:58.247782 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:08:58.247782 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:08:58.247782 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:08:58.247782 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:08:58.247782 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:08:58.247782 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 16:08:58.247782 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:08:58.257984 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b4551-0744-4a93-9003-604a68a6fe46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:58.258934 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b4551-0744-4a93-9003-604a68a6fe46 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:58.259416 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b4551-0744-4a93-9003-604a68a6fe46 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:58.259889 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b4551-0744-4a93-9003-604a68a6fe46 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:58.260843 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619b4551-0744-4a93-9003-604a68a6fe46 None admin] RBAC: Adding query filter params (name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:58.261354 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619b4551-0744-4a93-9003-604a68a6fe46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:58.262964 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619b4551-0744-4a93-9003-604a68a6fe46 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:58.263877 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 271/547] 10.222.0.62 () {56 vars in 1102 bytes} [Fri May 27 16:08:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:08:58.275306 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a797607-addc-4e62-9362-64c4868a9467 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:58.275483 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 277/548] 10.222.0.62 () {56 vars in 1103 bytes} [Fri May 27 16:08:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:58.281344 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b4551-0744-4a93-9003-604a68a6fe46 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:58.306594 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:58.380046 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a797607-addc-4e62-9362-64c4868a9467 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:58.416999 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cee58c-7ee2-4505-94af-241e7726a68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:58.418108 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cee58c-7ee2-4505-94af-241e7726a68c None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:58.418624 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cee58c-7ee2-4505-94af-241e7726a68c None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:58.419095 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cee58c-7ee2-4505-94af-241e7726a68c None admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:58.420052 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cee58c-7ee2-4505-94af-241e7726a68c None admin] RBAC: Adding query filter params (name=service) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:58.420555 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cee58c-7ee2-4505-94af-241e7726a68c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:58.422151 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cee58c-7ee2-4505-94af-241e7726a68c None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:58.432806 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 272/549] 10.222.0.62 () {56 vars in 1103 bytes} [Fri May 27 16:08:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:58.440545 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cee58c-7ee2-4505-94af-241e7726a68c None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:58.549598 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cee58c-7ee2-4505-94af-241e7726a68c None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:58.553631 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:58.584195 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b4551-0744-4a93-9003-604a68a6fe46 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:58.588130 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cef9a5a-6f23-4271-aa33-e28d1ddde848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:58.589149 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef9a5a-6f23-4271-aa33-e28d1ddde848 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:58.589628 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef9a5a-6f23-4271-aa33-e28d1ddde848 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:58.590100 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef9a5a-6f23-4271-aa33-e28d1ddde848 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:58.602591 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cef9a5a-6f23-4271-aa33-e28d1ddde848 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:58.604926 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cef9a5a-6f23-4271-aa33-e28d1ddde848 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:58.624186 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-9cef9a5a-6f23-4271-aa33-e28d1ddde848 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:08:58.624186 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:08:58.624186 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:08:58.624186 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:08:58.624186 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:08:58.624186 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:08:58.624186 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:08:58.624186 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:08:58.624186 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:08:58.624186 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:08:58.624186 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:08:58.624186 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:08:58.624186 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:08:58.624186 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:08:58.624186 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:08:58.625056 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:08:58.625056 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:08:58.625056 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:08:58.625056 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:08:58.625056 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:08:58.625056 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:08:58.625056 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:08:58.625056 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:08:58.625056 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:08:58.625056 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:08:58.625056 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:08:58.625056 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:08:58.625056 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:08:58.625056 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:08:58.625056 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:08:58.625056 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:08:58.625056 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:08:58.625924 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:08:58.625924 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:08:58.625924 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:08:58.625924 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:08:58.628520 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 273/550] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:08:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:08:58.633604 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cef9a5a-6f23-4271-aa33-e28d1ddde848 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:58.687469 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbaaac8-92dc-4f4f-ab21-44ef76a50ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:58.688192 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbaaac8-92dc-4f4f-ab21-44ef76a50ff8 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:58.688482 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbaaac8-92dc-4f4f-ab21-44ef76a50ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:58.688759 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbaaac8-92dc-4f4f-ab21-44ef76a50ff8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:58.708533 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbaaac8-92dc-4f4f-ab21-44ef76a50ff8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:58.709936 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbaaac8-92dc-4f4f-ab21-44ef76a50ff8 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:58.748937 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cef9a5a-6f23-4271-aa33-e28d1ddde848 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:58.754226 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-8bbaaac8-92dc-4f4f-ab21-44ef76a50ff8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:08:58.754226 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:08:58.754226 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:08:58.754226 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:08:58.754226 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:08:58.754226 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:08:58.754226 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:08:58.754226 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:08:58.754226 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:08:58.754226 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:08:58.754226 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:08:58.754226 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:08:58.754226 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:08:58.754226 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:08:58.754226 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:08:58.755110 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:08:58.755110 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:08:58.755110 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:08:58.755110 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:08:58.755110 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:08:58.755110 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:08:58.755110 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:08:58.755110 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:08:58.755110 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:08:58.755110 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:08:58.755110 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:08:58.755110 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:08:58.755110 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:08:58.755110 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:08:58.755110 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:08:58.755110 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:08:58.755110 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:08:58.755969 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:08:58.755969 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:08:58.755969 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:08:58.755969 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:08:58.755969 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 278/551] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:08:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 475 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:08:58.761391 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbaaac8-92dc-4f4f-ab21-44ef76a50ff8 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:58.768802 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:58.791140 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34e1c08-0ea8-4bf1-ad59-7eb621967e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:58.792183 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e1c08-0ea8-4bf1-ad59-7eb621967e7d None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:58.792666 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e1c08-0ea8-4bf1-ad59-7eb621967e7d None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:58.793177 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e1c08-0ea8-4bf1-ad59-7eb621967e7d None admin] PATH_INFO: `/v3/domains` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:58.794143 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34e1c08-0ea8-4bf1-ad59-7eb621967e7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:58.794688 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34e1c08-0ea8-4bf1-ad59-7eb621967e7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:58.796263 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34e1c08-0ea8-4bf1-ad59-7eb621967e7d None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:58.809797 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 274/552] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 16:08:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:58.810090 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:58.820236 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34e1c08-0ea8-4bf1-ad59-7eb621967e7d None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:58.972271 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbaaac8-92dc-4f4f-ab21-44ef76a50ff8 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:58.978010 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34e1c08-0ea8-4bf1-ad59-7eb621967e7d None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:59.024527 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1011f98f-95be-48c4-9f1f-8e8a91b9b4be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:59.025338 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1011f98f-95be-48c4-9f1f-8e8a91b9b4be None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:59.025623 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1011f98f-95be-48c4-9f1f-8e8a91b9b4be None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:59.025908 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1011f98f-95be-48c4-9f1f-8e8a91b9b4be None admin] PATH_INFO: `/v3/users/nova` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:59.043688 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1011f98f-95be-48c4-9f1f-8e8a91b9b4be None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:59.045548 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1011f98f-95be-48c4-9f1f-8e8a91b9b4be None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:59.057474 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41afe56-16e1-4bea-88df-8cb859191c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:59.058170 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41afe56-16e1-4bea-88df-8cb859191c55 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:59.058485 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41afe56-16e1-4bea-88df-8cb859191c55 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:59.058773 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41afe56-16e1-4bea-88df-8cb859191c55 None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:59.059530 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41afe56-16e1-4bea-88df-8cb859191c55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:59.059845 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41afe56-16e1-4bea-88df-8cb859191c55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:59.061291 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41afe56-16e1-4bea-88df-8cb859191c55 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:59.086975 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-1011f98f-95be-48c4-9f1f-8e8a91b9b4be None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 16:08:59.086975 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:08:59.086975 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:08:59.086975 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:08:59.086975 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:08:59.086975 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:08:59.086975 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:08:59.086975 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:08:59.086975 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:08:59.086975 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:08:59.086975 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:08:59.086975 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:08:59.086975 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 16:08:59.086975 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 16:08:59.086975 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 16:08:59.086975 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 16:08:59.088001 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:08:59.088001 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:08:59.088001 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 16:08:59.088001 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:08:59.088001 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 16:08:59.088001 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:08:59.088001 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:08:59.088001 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:08:59.088001 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:08:59.088001 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:08:59.088001 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:08:59.088001 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:08:59.088001 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:08:59.088001 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:08:59.088001 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:08:59.088001 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:08:59.088001 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:08:59.088001 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:08:59.088917 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:08:59.088917 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:08:59.088917 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 16:08:59.088917 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 16:08:59.088917 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 16:08:59.088917 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 16:08:59.088917 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 16:08:59.088917 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 16:08:59.088917 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 16:08:59.088917 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:08:59.088917 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 275/553] 10.222.0.62 () {56 vars in 1093 bytes} [Fri May 27 16:08:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:08:59.089982 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 279/554] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 16:08:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:08:59.094413 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1011f98f-95be-48c4-9f1f-8e8a91b9b4be None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:59.094820 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41afe56-16e1-4bea-88df-8cb859191c55 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:59.203955 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:59.232658 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1011f98f-95be-48c4-9f1f-8e8a91b9b4be None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:59.267055 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d674ab97-e838-49da-90be-005c0788c42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:59.268008 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674ab97-e838-49da-90be-005c0788c42b None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:59.268296 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674ab97-e838-49da-90be-005c0788c42b None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:59.268681 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674ab97-e838-49da-90be-005c0788c42b None admin] PATH_INFO: `/v3/users` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:59.270073 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d674ab97-e838-49da-90be-005c0788c42b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:59.270486 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d674ab97-e838-49da-90be-005c0788c42b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:59.271942 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d674ab97-e838-49da-90be-005c0788c42b None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:59.299180 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 276/555] 10.222.0.62 () {56 vars in 1133 bytes} [Fri May 27 16:08:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:59.302968 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3bbce5-3d78-4159-9d55-4ce17ac24045 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:59.303392 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3bbce5-3d78-4159-9d55-4ce17ac24045 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:59.303727 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:59.303868 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3bbce5-3d78-4159-9d55-4ce17ac24045 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:59.307720 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 277/556] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:08:59 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:08:59.309093 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3bbce5-3d78-4159-9d55-4ce17ac24045 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:59.333191 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41afe56-16e1-4bea-88df-8cb859191c55 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:59.373226 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c30e98-69e3-4a5d-8ba2-4e240e5da433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:59.374501 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c30e98-69e3-4a5d-8ba2-4e240e5da433 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:59.375305 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c30e98-69e3-4a5d-8ba2-4e240e5da433 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:59.375685 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c30e98-69e3-4a5d-8ba2-4e240e5da433 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:59.385497 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c30e98-69e3-4a5d-8ba2-4e240e5da433 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:59.387844 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c30e98-69e3-4a5d-8ba2-4e240e5da433 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:59.408907 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-d9c30e98-69e3-4a5d-8ba2-4e240e5da433 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 27 16:08:59.408907 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:08:59.408907 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:08:59.408907 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:08:59.408907 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:08:59.408907 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:08:59.408907 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:08:59.408907 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:08:59.408907 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:08:59.408907 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:08:59.408907 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:08:59.408907 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:08:59.408907 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 16:08:59.408907 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 16:08:59.408907 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 16:08:59.408907 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 16:08:59.410109 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:08:59.410109 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:08:59.410109 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 16:08:59.410109 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:08:59.410109 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 16:08:59.410109 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:08:59.410109 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:08:59.410109 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:08:59.410109 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:08:59.410109 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:08:59.410109 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:08:59.410109 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:08:59.410109 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:08:59.410109 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:08:59.410109 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:08:59.410109 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:08:59.410109 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:08:59.410109 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:08:59.412127 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:08:59.412127 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:08:59.412127 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 16:08:59.412127 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 16:08:59.412127 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 16:08:59.412127 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 16:08:59.412127 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 16:08:59.412127 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 16:08:59.412127 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 27 16:08:59.412127 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:08:59.412127 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 280/557] 10.222.0.62 () {56 vars in 1096 bytes} [Fri May 27 16:08:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:08:59.418988 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc2a7ef-c77e-4665-938a-24e9d21a967f None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:59.419341 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc2a7ef-c77e-4665-938a-24e9d21a967f None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:59.419702 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc2a7ef-c77e-4665-938a-24e9d21a967f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:59.441326 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-2fc2a7ef-c77e-4665-938a-24e9d21a967f None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:08:59.443114 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-2fc2a7ef-c77e-4665-938a-24e9d21a967f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:08:59.458596 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3bbce5-3d78-4159-9d55-4ce17ac24045 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:59.474276 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:59.496480 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac261d94-8d49-43c9-8a92-4873ee14d455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:59.497524 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac261d94-8d49-43c9-8a92-4873ee14d455 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:59.498001 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac261d94-8d49-43c9-8a92-4873ee14d455 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:59.498472 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac261d94-8d49-43c9-8a92-4873ee14d455 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:59.510767 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac261d94-8d49-43c9-8a92-4873ee14d455 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:59.512245 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac261d94-8d49-43c9-8a92-4873ee14d455 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:59.533435 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 281/558] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:08:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:08:59.533606 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-ac261d94-8d49-43c9-8a92-4873ee14d455 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:08:59.533606 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:08:59.533606 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:08:59.533606 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:08:59.533606 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:08:59.533606 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:08:59.533606 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:08:59.533606 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:08:59.533606 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:08:59.533606 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:08:59.533606 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:08:59.533606 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:08:59.533606 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:08:59.533606 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:08:59.533606 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:08:59.534631 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:08:59.534631 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:08:59.534631 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:08:59.534631 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:08:59.534631 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:08:59.534631 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:08:59.534631 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:08:59.534631 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:08:59.534631 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:08:59.534631 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:08:59.534631 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:08:59.534631 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:08:59.534631 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:08:59.534631 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:08:59.534631 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:08:59.534631 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:08:59.534631 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:08:59.535805 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:08:59.535805 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:08:59.535805 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:08:59.535805 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:08:59.536053 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc2a7ef-c77e-4665-938a-24e9d21a967f None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:59.538291 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 278/559] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:08:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:08:59.538291 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0434fd24-a36e-4616-aae3-0b7a0d6c5803 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:59.538291 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0434fd24-a36e-4616-aae3-0b7a0d6c5803 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:59.538534 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0434fd24-a36e-4616-aae3-0b7a0d6c5803 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:59.539896 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 279/560] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:08:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:08:59.540464 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0434fd24-a36e-4616-aae3-0b7a0d6c5803 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:59.598713 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:59.646652 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0434fd24-a36e-4616-aae3-0b7a0d6c5803 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:59.646845 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc2a7ef-c77e-4665-938a-24e9d21a967f None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:59.680367 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06813402-d5bf-45a4-a3fa-5bd42cfb5537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:59.680599 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2683d81-ac96-4b08-b524-fc7cf0546f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:59.681021 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06813402-d5bf-45a4-a3fa-5bd42cfb5537 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:59.681202 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2683d81-ac96-4b08-b524-fc7cf0546f2d None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:59.681300 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06813402-d5bf-45a4-a3fa-5bd42cfb5537 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:59.681487 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2683d81-ac96-4b08-b524-fc7cf0546f2d None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:59.681591 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06813402-d5bf-45a4-a3fa-5bd42cfb5537 None admin] PATH_INFO: `/v3/domains` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:59.681764 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2683d81-ac96-4b08-b524-fc7cf0546f2d None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:59.682281 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06813402-d5bf-45a4-a3fa-5bd42cfb5537 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:59.682585 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06813402-d5bf-45a4-a3fa-5bd42cfb5537 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:59.682675 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2683d81-ac96-4b08-b524-fc7cf0546f2d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:08:59.682927 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2683d81-ac96-4b08-b524-fc7cf0546f2d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:59.683957 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06813402-d5bf-45a4-a3fa-5bd42cfb5537 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:59.684363 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2683d81-ac96-4b08-b524-fc7cf0546f2d None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:59.695425 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 280/561] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 16:08:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:59.696764 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8247e48-658f-4387-a20b-3bbbc21cb1eb None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:59.697056 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8247e48-658f-4387-a20b-3bbbc21cb1eb None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:59.697326 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8247e48-658f-4387-a20b-3bbbc21cb1eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:59.703509 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 282/562] 10.222.0.62 () {56 vars in 1135 bytes} [Fri May 27 16:08:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:08:59.704320 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2683d81-ac96-4b08-b524-fc7cf0546f2d None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:59.714367 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-b8247e48-658f-4387-a20b-3bbbc21cb1eb None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:08:59.715548 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-b8247e48-658f-4387-a20b-3bbbc21cb1eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:08:59.733147 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:59.789179 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 281/563] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:08:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:08:59.790447 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb7906-db63-403c-8426-00ae7e0323ee None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:59.790738 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb7906-db63-403c-8426-00ae7e0323ee None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:59.791082 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb7906-db63-403c-8426-00ae7e0323ee None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:59.792390 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 282/564] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:08:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:08:59.793099 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffb7906-db63-403c-8426-00ae7e0323ee None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:59.821538 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2683d81-ac96-4b08-b524-fc7cf0546f2d None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:59.833397 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:08:59.858306 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de25ddf-a0e3-4116-84e4-6d0d631907ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:59.859102 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de25ddf-a0e3-4116-84e4-6d0d631907ba None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:59.859389 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de25ddf-a0e3-4116-84e4-6d0d631907ba None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:59.859666 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de25ddf-a0e3-4116-84e4-6d0d631907ba None admin] PATH_INFO: `/v3/roles/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:59.871088 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de25ddf-a0e3-4116-84e4-6d0d631907ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:08:59.877584 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-7de25ddf-a0e3-4116-84e4-6d0d631907ba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 16:08:59.877584 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:08:59.877584 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:08:59.877584 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:08:59.877584 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:08:59.877584 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:08:59.877584 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:08:59.877584 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:08:59.877584 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:08:59.877584 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:08:59.877584 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:08:59.877584 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:08:59.877584 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:08:59.877584 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:08:59.877584 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:08:59.877584 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:08:59.878765 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:08:59.878765 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:08:59.878765 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:08:59.878765 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:08:59.878765 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:08:59.878765 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:08:59.878765 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:08:59.878765 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:08:59.878765 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:08:59.878765 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:08:59.878765 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:08:59.878765 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:08:59.878765 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:08:59.878765 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:08:59.878765 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:08:59.878765 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:08:59.879676 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:08:59.879676 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:08:59.879676 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:08:59.879676 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:08:59.879676 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:08:59.879676 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:08:59.879676 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:08:59.879676 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:08:59.879676 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:08:59.879676 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:08:59.879676 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 16:08:59.879676 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:08:59.879676 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 283/565] 10.222.0.62 () {56 vars in 1102 bytes} [Fri May 27 16:08:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:08:59.879676 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de25ddf-a0e3-4116-84e4-6d0d631907ba None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:08:59.907339 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffb7906-db63-403c-8426-00ae7e0323ee None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:59.940659 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bd0704-5949-441e-af99-34795f6e5e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:08:59.941450 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd0704-5949-441e-af99-34795f6e5e9c None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:59.941739 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd0704-5949-441e-af99-34795f6e5e9c None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:59.942020 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd0704-5949-441e-af99-34795f6e5e9c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:59.949180 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bd0704-5949-441e-af99-34795f6e5e9c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:08:59.950666 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bd0704-5949-441e-af99-34795f6e5e9c None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:08:59.964849 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-93bd0704-5949-441e-af99-34795f6e5e9c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:08:59.964849 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:08:59.964849 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:08:59.964849 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:08:59.964849 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:08:59.964849 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:08:59.964849 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:08:59.964849 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:08:59.964849 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:08:59.964849 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:08:59.964849 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:08:59.964849 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:08:59.964849 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 16:08:59.964849 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 16:08:59.964849 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 16:08:59.965907 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 16:08:59.965907 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:08:59.965907 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:08:59.965907 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:08:59.965907 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:08:59.965907 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:08:59.965907 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:08:59.965907 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:08:59.965907 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:08:59.965907 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:08:59.965907 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:08:59.965907 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:08:59.965907 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:08:59.965907 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:08:59.965907 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:08:59.965907 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:08:59.965907 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:08:59.967088 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 16:08:59.967088 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 16:08:59.967088 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 16:08:59.967088 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 16:08:59.967088 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 16:08:59.967088 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 16:08:59.967088 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:08:59.967088 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:08:59.967088 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 283/566] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 16:08:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:08:59.967650 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0680a-5a37-4a20-bc3d-66e3016c7ddf None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:08:59.967650 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0680a-5a37-4a20-bc3d-66e3016c7ddf None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:08:59.967787 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0680a-5a37-4a20-bc3d-66e3016c7ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:08:59.983630 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-dde0680a-5a37-4a20-bc3d-66e3016c7ddf None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:08:59.984816 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-dde0680a-5a37-4a20-bc3d-66e3016c7ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:08:59.985020 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de25ddf-a0e3-4116-84e4-6d0d631907ba None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:08:59.994444 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:00.018001 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1068a427-9dc5-484b-be16-5bc6ab79dc1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:00.018676 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1068a427-9dc5-484b-be16-5bc6ab79dc1d None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:00.018967 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1068a427-9dc5-484b-be16-5bc6ab79dc1d None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:00.019245 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1068a427-9dc5-484b-be16-5bc6ab79dc1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:00.049428 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 284/567] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:08:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:09:00.050180 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde0680a-5a37-4a20-bc3d-66e3016c7ddf None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:00.092574 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1068a427-9dc5-484b-be16-5bc6ab79dc1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:00.094020 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1068a427-9dc5-484b-be16-5bc6ab79dc1d None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:00.127994 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:00.151478 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde0680a-5a37-4a20-bc3d-66e3016c7ddf None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:00.186985 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8217f8a1-0875-4fcb-8649-6a8e5402510e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:00.187873 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217f8a1-0875-4fcb-8649-6a8e5402510e None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:00.188164 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217f8a1-0875-4fcb-8649-6a8e5402510e None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:00.188441 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217f8a1-0875-4fcb-8649-6a8e5402510e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:00.200450 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8217f8a1-0875-4fcb-8649-6a8e5402510e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:09:00.206708 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 284/568] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 16:08:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 16:09:00.206708 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1068a427-9dc5-484b-be16-5bc6ab79dc1d None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:00.208349 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-8217f8a1-0875-4fcb-8649-6a8e5402510e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 16:09:00.208349 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:00.208349 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:00.208349 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:00.208349 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:00.208349 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:00.208349 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:00.208349 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:00.208349 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:00.208349 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:00.208349 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:00.208349 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:00.208349 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:09:00.208349 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:09:00.208349 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:09:00.208349 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:09:00.209399 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:09:00.209399 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:09:00.209399 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:09:00.209399 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:09:00.209399 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:00.209399 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:00.209399 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:00.209399 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:00.209399 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:00.209399 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:00.209399 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:00.209399 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:09:00.209399 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:00.209399 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:00.209399 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:00.209399 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:00.210895 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:00.210895 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:00.210895 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:00.210895 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:00.210895 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:09:00.210895 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:09:00.210895 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:09:00.210895 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:09:00.210895 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:09:00.210895 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:09:00.210895 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 16:09:00.210895 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:00.210895 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 285/569] 10.222.0.62 () {56 vars in 1102 bytes} [Fri May 27 16:09:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:00.210895 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8217f8a1-0875-4fcb-8649-6a8e5402510e None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:00.213805 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:00.285761 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:00.316024 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1068a427-9dc5-484b-be16-5bc6ab79dc1d None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:00.318726 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8217f8a1-0875-4fcb-8649-6a8e5402510e None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:00.350102 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bec528-fd16-4792-8916-e5c2f2466169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:00.351416 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bec528-fd16-4792-8916-e5c2f2466169 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:00.351700 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bec528-fd16-4792-8916-e5c2f2466169 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:00.351943 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00677ef2-08f0-415d-bcb9-b7b64028dbcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:00.352070 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bec528-fd16-4792-8916-e5c2f2466169 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:00.352600 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00677ef2-08f0-415d-bcb9-b7b64028dbcf None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:00.352701 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bec528-fd16-4792-8916-e5c2f2466169 None admin] RBAC: Adding query filter params (name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:00.352966 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00677ef2-08f0-415d-bcb9-b7b64028dbcf None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:00.353075 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bec528-fd16-4792-8916-e5c2f2466169 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:00.353255 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00677ef2-08f0-415d-bcb9-b7b64028dbcf None admin] PATH_INFO: `/v3/projects` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:00.354041 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00677ef2-08f0-415d-bcb9-b7b64028dbcf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:00.354356 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bec528-fd16-4792-8916-e5c2f2466169 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:00.354451 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00677ef2-08f0-415d-bcb9-b7b64028dbcf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:00.355803 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00677ef2-08f0-415d-bcb9-b7b64028dbcf None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:00.362066 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 285/570] 10.222.0.62 () {56 vars in 1103 bytes} [Fri May 27 16:09:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:00.362871 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bec528-fd16-4792-8916-e5c2f2466169 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:00.370051 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 286/571] 10.222.0.62 () {56 vars in 1148 bytes} [Fri May 27 16:09:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:00.370051 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00677ef2-08f0-415d-bcb9-b7b64028dbcf None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:00.431019 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:00.463903 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bec528-fd16-4792-8916-e5c2f2466169 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:00.467552 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00677ef2-08f0-415d-bcb9-b7b64028dbcf None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:00.492117 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:00.497354 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881e04ee-3044-4cb4-b85d-9f156c48028c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:00.501732 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881e04ee-3044-4cb4-b85d-9f156c48028c None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:00.501732 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881e04ee-3044-4cb4-b85d-9f156c48028c None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:00.501732 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881e04ee-3044-4cb4-b85d-9f156c48028c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:00.502005 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea94bb3c-b912-477d-8bf1-26582405dd8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:00.502005 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea94bb3c-b912-477d-8bf1-26582405dd8a None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:00.502321 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea94bb3c-b912-477d-8bf1-26582405dd8a None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:00.502611 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea94bb3c-b912-477d-8bf1-26582405dd8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:00.508930 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881e04ee-3044-4cb4-b85d-9f156c48028c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:09:00.512751 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea94bb3c-b912-477d-8bf1-26582405dd8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:00.514278 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea94bb3c-b912-477d-8bf1-26582405dd8a None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:00.516508 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-881e04ee-3044-4cb4-b85d-9f156c48028c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 16:09:00.516508 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:00.516508 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:00.516508 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:00.516508 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:00.516508 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:00.516508 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:00.516508 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:00.516508 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:00.516508 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:00.516508 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:00.516508 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:00.516508 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:09:00.516508 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:09:00.516508 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:09:00.516508 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:09:00.517576 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:09:00.517576 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:09:00.517576 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:09:00.517576 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:09:00.517576 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:00.517576 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:00.517576 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:00.517576 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:00.517576 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:00.517576 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:00.517576 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:00.517576 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:09:00.517576 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:00.517576 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:00.517576 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:00.517576 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:00.518747 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:00.518747 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:00.518747 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:00.518747 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:00.518747 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:09:00.518747 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:09:00.518747 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:09:00.518747 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:09:00.518747 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:09:00.518747 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:09:00.518747 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 16:09:00.518747 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:00.518747 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 286/572] 10.222.0.62 () {56 vars in 1102 bytes} [Fri May 27 16:09:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:00.518747 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881e04ee-3044-4cb4-b85d-9f156c48028c None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:00.535958 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-ea94bb3c-b912-477d-8bf1-26582405dd8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:00.535958 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:00.535958 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:00.535958 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:00.535958 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:00.535958 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:00.535958 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:00.535958 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:00.535958 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:00.535958 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:00.535958 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:00.535958 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:00.535958 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:09:00.535958 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:09:00.535958 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:09:00.537044 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:09:00.537044 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:00.537044 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:00.537044 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:00.537044 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:00.537044 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:00.537044 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:00.537044 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:00.537044 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:09:00.537044 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:00.537044 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:00.537044 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:00.537044 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:00.537044 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:00.537044 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:00.537044 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:00.537044 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:00.538106 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:09:00.538106 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:09:00.538106 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:00.538106 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:00.538106 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 287/573] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:09:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:00.538983 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea94bb3c-b912-477d-8bf1-26582405dd8a None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:00.620989 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881e04ee-3044-4cb4-b85d-9f156c48028c None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:00.636001 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea94bb3c-b912-477d-8bf1-26582405dd8a None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:00.651965 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:00.653836 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46144608-99e0-47c7-885c-abb6723f72d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:00.654522 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46144608-99e0-47c7-885c-abb6723f72d9 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:00.654806 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46144608-99e0-47c7-885c-abb6723f72d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:00.655083 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46144608-99e0-47c7-885c-abb6723f72d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:00.655824 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46144608-99e0-47c7-885c-abb6723f72d9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:00.656133 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46144608-99e0-47c7-885c-abb6723f72d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:00.657551 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46144608-99e0-47c7-885c-abb6723f72d9 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:00.665853 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 287/574] 10.222.0.62 () {56 vars in 1103 bytes} [Fri May 27 16:09:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:00.666637 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46144608-99e0-47c7-885c-abb6723f72d9 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:00.673444 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f666ac78-283c-4ea8-87a0-0a34a5e477d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:00.674288 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f666ac78-283c-4ea8-87a0-0a34a5e477d6 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:00.674577 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f666ac78-283c-4ea8-87a0-0a34a5e477d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:00.674851 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f666ac78-283c-4ea8-87a0-0a34a5e477d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:00.687260 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f666ac78-283c-4ea8-87a0-0a34a5e477d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:00.688874 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f666ac78-283c-4ea8-87a0-0a34a5e477d6 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:00.706171 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-f666ac78-283c-4ea8-87a0-0a34a5e477d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:00.706171 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:00.706171 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:00.706171 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:00.706171 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:00.706171 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:00.706171 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:00.706171 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:00.706171 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:00.706171 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:00.706171 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:00.706171 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:00.706171 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:09:00.706171 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:09:00.706171 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:09:00.707255 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:09:00.707255 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:00.707255 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:00.707255 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:00.707255 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:00.707255 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:00.707255 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:00.707255 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:00.707255 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:09:00.707255 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:00.707255 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:00.707255 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:00.707255 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:00.707255 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:00.707255 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:00.707255 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:00.707255 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:00.708291 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:09:00.708291 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:09:00.708291 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:00.708291 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:00.710397 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 288/575] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:09:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:00.711699 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f666ac78-283c-4ea8-87a0-0a34a5e477d6 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:00.724398 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:00.768171 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46144608-99e0-47c7-885c-abb6723f72d9 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:00.801458 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f58fe2-2b20-44b3-88c3-303b3ae1a1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:00.802623 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f58fe2-2b20-44b3-88c3-303b3ae1a1ae None admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:00.802913 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f58fe2-2b20-44b3-88c3-303b3ae1a1ae None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:00.803190 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f58fe2-2b20-44b3-88c3-303b3ae1a1ae None admin] PATH_INFO: `/v3/projects/d48d95a12587479ca5714f6ebd60dd9f/users/cb13ad6d8b1e46029262556bff398796/roles/1d9076bd231c43809cb971b6360e0c28` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:00.808924 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f666ac78-283c-4ea8-87a0-0a34a5e477d6 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:00.817921 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f58fe2-2b20-44b3-88c3-303b3ae1a1ae None admin] RBAC: Authorizing `identity:create_grant(project_id=d48d95a12587479ca5714f6ebd60dd9f, user_id=cb13ad6d8b1e46029262556bff398796, role_id=1d9076bd231c43809cb971b6360e0c28)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:00.819424 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f58fe2-2b20-44b3-88c3-303b3ae1a1ae None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:00.842263 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cffc21-c41e-4974-b7fa-78a19efb1eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:00.842939 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cffc21-c41e-4974-b7fa-78a19efb1eaf None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:00.843225 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cffc21-c41e-4974-b7fa-78a19efb1eaf None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:00.843504 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cffc21-c41e-4974-b7fa-78a19efb1eaf None admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:00.844251 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cffc21-c41e-4974-b7fa-78a19efb1eaf None admin] RBAC: Adding query filter params (name=service) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:00.844562 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cffc21-c41e-4974-b7fa-78a19efb1eaf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:00.845918 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cffc21-c41e-4974-b7fa-78a19efb1eaf None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:00.853953 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 289/576] 10.222.0.62 () {56 vars in 1103 bytes} [Fri May 27 16:09:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:00.854795 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cffc21-c41e-4974-b7fa-78a19efb1eaf None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:00.879853 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 288/577] 10.222.0.62 () {58 vars in 1439 bytes} [Fri May 27 16:09:00 2022] PUT /identity/v3/projects/d48d95a12587479ca5714f6ebd60dd9f/users/cb13ad6d8b1e46029262556bff398796/roles/1d9076bd231c43809cb971b6360e0c28 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:09:00.880688 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f58fe2-2b20-44b3-88c3-303b3ae1a1ae None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:00.894735 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:00.981387 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cffc21-c41e-4974-b7fa-78a19efb1eaf None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:01.004955 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f58fe2-2b20-44b3-88c3-303b3ae1a1ae None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:01.009407 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:01.021765 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22ca5f9-aa5c-4027-a822-8e88604908bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:01.023185 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ca5f9-aa5c-4027-a822-8e88604908bc None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:01.023575 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ca5f9-aa5c-4027-a822-8e88604908bc None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:01.023924 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ca5f9-aa5c-4027-a822-8e88604908bc None admin] PATH_INFO: `/v3/domains` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:01.024748 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22ca5f9-aa5c-4027-a822-8e88604908bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:01.025131 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22ca5f9-aa5c-4027-a822-8e88604908bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:01.026662 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22ca5f9-aa5c-4027-a822-8e88604908bc None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:01.039711 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 290/578] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 16:09:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:01.040568 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22ca5f9-aa5c-4027-a822-8e88604908bc None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:01.051274 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea58fa-fdce-4639-bd28-273189a7e826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:01.052612 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea58fa-fdce-4639-bd28-273189a7e826 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:01.058182 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea58fa-fdce-4639-bd28-273189a7e826 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:01.058182 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea58fa-fdce-4639-bd28-273189a7e826 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:01.065820 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ea58fa-fdce-4639-bd28-273189a7e826 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:01.067366 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ea58fa-fdce-4639-bd28-273189a7e826 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:01.089242 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-c8ea58fa-fdce-4639-bd28-273189a7e826 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:01.089242 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:01.089242 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:01.089242 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:01.089242 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:01.089242 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:01.089242 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:01.089242 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:01.089242 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:01.089242 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:01.089242 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:01.089242 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:01.089242 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:09:01.089242 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:09:01.089242 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:09:01.090368 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:09:01.090368 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:01.090368 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:01.090368 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:01.090368 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:01.090368 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:01.090368 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:01.090368 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:01.090368 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:09:01.090368 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:01.090368 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:01.090368 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:01.090368 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:01.090368 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:01.090368 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:01.090368 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:01.090368 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:01.091463 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:09:01.091463 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:09:01.091463 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:01.091463 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:01.091463 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 289/579] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:09:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:01.091790 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea58fa-fdce-4639-bd28-273189a7e826 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:01.156653 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:01.166822 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22ca5f9-aa5c-4027-a822-8e88604908bc None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:01.196228 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea58fa-fdce-4639-bd28-273189a7e826 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:01.207674 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c2e9c1-54e6-469a-9127-4a8a4bfd8d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:01.208410 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c2e9c1-54e6-469a-9127-4a8a4bfd8d17 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:01.208759 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c2e9c1-54e6-469a-9127-4a8a4bfd8d17 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:01.209101 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c2e9c1-54e6-469a-9127-4a8a4bfd8d17 None admin] PATH_INFO: `/v3/domains` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:01.209885 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c2e9c1-54e6-469a-9127-4a8a4bfd8d17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:01.210453 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c2e9c1-54e6-469a-9127-4a8a4bfd8d17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:01.211814 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c2e9c1-54e6-469a-9127-4a8a4bfd8d17 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:01.223013 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 291/580] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 16:09:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:01.223819 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c2e9c1-54e6-469a-9127-4a8a4bfd8d17 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:01.255887 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862d20c0-bc6a-43ae-980b-1199049a98a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:01.256672 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d20c0-bc6a-43ae-980b-1199049a98a0 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:01.257000 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d20c0-bc6a-43ae-980b-1199049a98a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:01.257278 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d20c0-bc6a-43ae-980b-1199049a98a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:01.267684 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862d20c0-bc6a-43ae-980b-1199049a98a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:01.269287 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862d20c0-bc6a-43ae-980b-1199049a98a0 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:01.287569 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-862d20c0-bc6a-43ae-980b-1199049a98a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:01.287569 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:01.287569 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:01.287569 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:01.287569 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:01.287569 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:01.287569 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:01.287569 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:01.287569 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:01.287569 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:01.287569 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:01.287569 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:01.287569 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:09:01.287569 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:09:01.287569 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:09:01.289201 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:09:01.289201 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:01.289201 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:01.289201 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:01.289201 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:01.289201 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:01.289201 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:01.289201 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:01.289201 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:09:01.289201 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:01.289201 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:01.289201 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:01.289201 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:01.289201 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:01.289201 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:01.289201 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:01.289201 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:01.290431 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:09:01.290431 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:09:01.290431 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:01.290431 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:01.295669 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 290/581] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:09:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:01.295669 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862d20c0-bc6a-43ae-980b-1199049a98a0 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:01.302861 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:01.345033 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c2e9c1-54e6-469a-9127-4a8a4bfd8d17 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:01.383685 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8da8b89-6ccd-445f-9af2-bbbdc4499a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:01.384490 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da8b89-6ccd-445f-9af2-bbbdc4499a77 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:01.384783 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da8b89-6ccd-445f-9af2-bbbdc4499a77 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:01.385064 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da8b89-6ccd-445f-9af2-bbbdc4499a77 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:01.395628 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8da8b89-6ccd-445f-9af2-bbbdc4499a77 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:01.396338 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862d20c0-bc6a-43ae-980b-1199049a98a0 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:01.397116 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8da8b89-6ccd-445f-9af2-bbbdc4499a77 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:01.412502 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-e8da8b89-6ccd-445f-9af2-bbbdc4499a77 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:09:01.412502 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:01.412502 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:01.412502 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:01.412502 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:01.412502 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:01.412502 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:01.412502 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:01.412502 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:01.412502 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:01.412502 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:01.412502 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:01.412502 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 16:09:01.412502 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 16:09:01.412502 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 16:09:01.413564 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 16:09:01.413564 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:01.413564 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:01.413564 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:01.413564 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:01.413564 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:01.413564 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:01.413564 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:01.413564 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:09:01.413564 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:01.413564 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:01.413564 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:01.413564 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:01.413564 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:01.413564 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:01.413564 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:01.413564 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:01.414474 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 16:09:01.414474 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 16:09:01.414474 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 16:09:01.414474 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 16:09:01.414474 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 16:09:01.414474 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 16:09:01.414474 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:09:01.414474 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:01.414474 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 292/582] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 16:09:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:01.414474 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8da8b89-6ccd-445f-9af2-bbbdc4499a77 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:01.427998 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:01.440219 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4de0ef7-469a-47f3-96e9-c12e387b194d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:01.441460 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4de0ef7-469a-47f3-96e9-c12e387b194d None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:01.441460 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4de0ef7-469a-47f3-96e9-c12e387b194d None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:01.441828 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4de0ef7-469a-47f3-96e9-c12e387b194d None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:01.442660 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4de0ef7-469a-47f3-96e9-c12e387b194d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:01.443037 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4de0ef7-469a-47f3-96e9-c12e387b194d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:01.445166 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4de0ef7-469a-47f3-96e9-c12e387b194d None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:01.461714 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 291/583] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 16:09:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:01.461714 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4de0ef7-469a-47f3-96e9-c12e387b194d None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:01.520754 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8da8b89-6ccd-445f-9af2-bbbdc4499a77 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:01.530821 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:01.556563 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f455dedf-a2f7-4676-bba6-a8bc767a1240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:01.557474 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455dedf-a2f7-4676-bba6-a8bc767a1240 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:01.557835 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455dedf-a2f7-4676-bba6-a8bc767a1240 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:01.558117 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455dedf-a2f7-4676-bba6-a8bc767a1240 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:01.565593 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f455dedf-a2f7-4676-bba6-a8bc767a1240 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:01.567113 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f455dedf-a2f7-4676-bba6-a8bc767a1240 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:01.567927 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4de0ef7-469a-47f3-96e9-c12e387b194d None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:01.581808 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-f455dedf-a2f7-4676-bba6-a8bc767a1240 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 27 16:09:01.581808 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:01.581808 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:01.581808 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:01.581808 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:01.581808 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:01.581808 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:01.581808 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:01.581808 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:01.581808 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:01.581808 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:01.581808 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:01.581808 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 16:09:01.581808 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 16:09:01.581808 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 16:09:01.581808 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 16:09:01.583025 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:01.583025 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:01.583025 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 16:09:01.583025 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:09:01.583025 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 16:09:01.583025 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:09:01.583025 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:01.583025 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:01.583025 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:01.583025 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:01.583025 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:01.583025 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:09:01.583025 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:01.583025 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:01.583025 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:01.583025 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:01.583025 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:01.583025 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:01.584012 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:01.584012 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:01.584012 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 16:09:01.584012 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 16:09:01.584012 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 16:09:01.584012 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 16:09:01.584012 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 16:09:01.584012 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 16:09:01.584012 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 27 16:09:01.584012 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:01.584012 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 293/584] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 16:09:01 2022] GET /identity/v3/users/glance => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:01.584012 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f455dedf-a2f7-4676-bba6-a8bc767a1240 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:01.609347 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8bc8f2-e671-4a2f-9ce9-003af6e8a61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:01.610017 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8bc8f2-e671-4a2f-9ce9-003af6e8a61d None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:01.610362 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8bc8f2-e671-4a2f-9ce9-003af6e8a61d None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:01.610642 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8bc8f2-e671-4a2f-9ce9-003af6e8a61d None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:01.611473 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8bc8f2-e671-4a2f-9ce9-003af6e8a61d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:01.611777 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8bc8f2-e671-4a2f-9ce9-003af6e8a61d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:01.613265 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8bc8f2-e671-4a2f-9ce9-003af6e8a61d None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:01.630703 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 292/585] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 16:09:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:01.630703 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8bc8f2-e671-4a2f-9ce9-003af6e8a61d None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:01.659515 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:01.690492 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f455dedf-a2f7-4676-bba6-a8bc767a1240 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:01.728427 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2490fd-2a30-438c-a0a5-0cf929ef2c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:01.729087 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2490fd-2a30-438c-a0a5-0cf929ef2c0a None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:01.729370 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2490fd-2a30-438c-a0a5-0cf929ef2c0a None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:01.729645 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2490fd-2a30-438c-a0a5-0cf929ef2c0a None admin] PATH_INFO: `/v3/projects` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:01.730446 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2490fd-2a30-438c-a0a5-0cf929ef2c0a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:01.730759 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2490fd-2a30-438c-a0a5-0cf929ef2c0a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:01.732229 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2490fd-2a30-438c-a0a5-0cf929ef2c0a None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:01.735830 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8bc8f2-e671-4a2f-9ce9-003af6e8a61d None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:01.744858 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 294/586] 10.222.0.62 () {56 vars in 1148 bytes} [Fri May 27 16:09:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:01.745655 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2490fd-2a30-438c-a0a5-0cf929ef2c0a None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:01.771872 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:01.780768 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b7a7f6-e8a8-4637-8cc7-9380c2094174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:01.781606 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b7a7f6-e8a8-4637-8cc7-9380c2094174 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:01.781970 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b7a7f6-e8a8-4637-8cc7-9380c2094174 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:01.782269 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b7a7f6-e8a8-4637-8cc7-9380c2094174 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:01.789730 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b7a7f6-e8a8-4637-8cc7-9380c2094174 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:01.791342 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b7a7f6-e8a8-4637-8cc7-9380c2094174 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:01.807653 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-f3b7a7f6-e8a8-4637-8cc7-9380c2094174 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 27 16:09:01.807653 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:01.807653 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:01.807653 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:01.807653 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:01.807653 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:01.807653 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:01.807653 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:01.807653 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:01.807653 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:01.807653 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:01.807653 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:01.807653 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 16:09:01.807653 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 16:09:01.807653 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 16:09:01.807653 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 16:09:01.808808 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:01.808808 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:01.808808 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 16:09:01.808808 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:09:01.808808 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 16:09:01.808808 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:09:01.808808 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:01.808808 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:01.808808 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:01.808808 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:01.808808 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:01.808808 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:09:01.808808 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:01.808808 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:01.808808 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:01.808808 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:01.808808 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:01.808808 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:01.809912 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:01.809912 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:01.809912 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 16:09:01.809912 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 16:09:01.809912 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 16:09:01.809912 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 16:09:01.809912 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 16:09:01.809912 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 16:09:01.809912 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 27 16:09:01.809912 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:01.816613 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 293/587] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 16:09:01 2022] GET /identity/v3/users/cinder => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:01.817447 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b7a7f6-e8a8-4637-8cc7-9380c2094174 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:01.854666 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2490fd-2a30-438c-a0a5-0cf929ef2c0a None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:01.884520 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:01.890692 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285eca36-d607-44a0-9384-9793ee7994d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:01.891352 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285eca36-d607-44a0-9384-9793ee7994d5 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:01.891634 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285eca36-d607-44a0-9384-9793ee7994d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:01.891907 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285eca36-d607-44a0-9384-9793ee7994d5 None admin] PATH_INFO: `/v3/users` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:01.892741 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285eca36-d607-44a0-9384-9793ee7994d5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:01.893044 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285eca36-d607-44a0-9384-9793ee7994d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:01.894512 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285eca36-d607-44a0-9384-9793ee7994d5 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:01.912225 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 295/588] 10.222.0.62 () {56 vars in 1137 bytes} [Fri May 27 16:09:01 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:01.913847 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285eca36-d607-44a0-9384-9793ee7994d5 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:01.931675 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b7a7f6-e8a8-4637-8cc7-9380c2094174 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:01.967922 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e22481e-81f3-44ba-be5c-8eadf1ac6cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:01.968646 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22481e-81f3-44ba-be5c-8eadf1ac6cb2 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:01.968929 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22481e-81f3-44ba-be5c-8eadf1ac6cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:01.969208 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22481e-81f3-44ba-be5c-8eadf1ac6cb2 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:01.976518 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e22481e-81f3-44ba-be5c-8eadf1ac6cb2 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:01.977997 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e22481e-81f3-44ba-be5c-8eadf1ac6cb2 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:01.992836 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-4e22481e-81f3-44ba-be5c-8eadf1ac6cb2 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 27 16:09:01.992836 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:01.992836 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:01.992836 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:01.992836 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:01.992836 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:01.992836 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:01.992836 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:01.992836 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:01.992836 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:01.992836 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:01.992836 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:01.992836 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 16:09:01.992836 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 16:09:01.992836 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 16:09:01.992836 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 16:09:01.993851 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:01.993851 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:01.993851 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 16:09:01.993851 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:09:01.993851 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 16:09:01.993851 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:09:01.993851 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:01.993851 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:01.993851 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:01.993851 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:01.993851 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:01.993851 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:09:01.993851 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:01.993851 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:01.993851 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:01.993851 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:01.993851 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:01.993851 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:01.994908 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:01.994908 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:01.994908 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 16:09:01.994908 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 16:09:01.994908 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 16:09:01.994908 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 16:09:01.994908 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 16:09:01.994908 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 16:09:01.994908 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 27 16:09:01.994908 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:01.994908 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 294/589] 10.222.0.62 () {56 vars in 1102 bytes} [Fri May 27 16:09:01 2022] GET /identity/v3/users/neutron => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:01.996216 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e22481e-81f3-44ba-be5c-8eadf1ac6cb2 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:02.026790 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285eca36-d607-44a0-9384-9793ee7994d5 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:02.052091 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:02.062681 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757aa908-69c0-43a4-bd79-d4bf62af1d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:02.063347 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757aa908-69c0-43a4-bd79-d4bf62af1d78 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:02.067601 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757aa908-69c0-43a4-bd79-d4bf62af1d78 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:02.067601 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757aa908-69c0-43a4-bd79-d4bf62af1d78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:02.067601 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757aa908-69c0-43a4-bd79-d4bf62af1d78 None admin] RBAC: Adding query filter params (role.id=1d9076bd231c43809cb971b6360e0c28, scope.project.id=d48d95a12587479ca5714f6ebd60dd9f, user.id=e8e6ec55445045fcac5623b9b6ffa9ab) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:02.067601 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757aa908-69c0-43a4-bd79-d4bf62af1d78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:02.067601 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757aa908-69c0-43a4-bd79-d4bf62af1d78 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:02.072999 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 296/590] 10.222.0.62 () {56 vars in 1374 bytes} [Fri May 27 16:09:01 2022] GET /identity/v3/role_assignments?user.id=e8e6ec55445045fcac5623b9b6ffa9ab&scope.project.id=d48d95a12587479ca5714f6ebd60dd9f&role.id=1d9076bd231c43809cb971b6360e0c28 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:02.073816 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757aa908-69c0-43a4-bd79-d4bf62af1d78 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:02.114782 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e22481e-81f3-44ba-be5c-8eadf1ac6cb2 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:02.149733 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:02.165637 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b7397-ddc0-4231-a755-99d475b8a284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:02.166803 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b7397-ddc0-4231-a755-99d475b8a284 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:02.167235 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b7397-ddc0-4231-a755-99d475b8a284 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:02.167681 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b7397-ddc0-4231-a755-99d475b8a284 None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:02.169221 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729b7397-ddc0-4231-a755-99d475b8a284 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:02.169956 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729b7397-ddc0-4231-a755-99d475b8a284 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:02.172725 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729b7397-ddc0-4231-a755-99d475b8a284 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:02.206031 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 295/591] 10.222.0.62 () {56 vars in 1137 bytes} [Fri May 27 16:09:01 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:02.206031 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b7397-ddc0-4231-a755-99d475b8a284 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:02.224694 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757aa908-69c0-43a4-bd79-d4bf62af1d78 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:02.264392 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955b3354-eadc-44fc-90f7-0f7cb91f5541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:02.265380 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b3354-eadc-44fc-90f7-0f7cb91f5541 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:02.265919 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b3354-eadc-44fc-90f7-0f7cb91f5541 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:02.266137 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b3354-eadc-44fc-90f7-0f7cb91f5541 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:02.278545 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955b3354-eadc-44fc-90f7-0f7cb91f5541 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:02.280131 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955b3354-eadc-44fc-90f7-0f7cb91f5541 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:02.298841 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-955b3354-eadc-44fc-90f7-0f7cb91f5541 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:02.298841 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:02.298841 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:02.298841 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:02.298841 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:02.298841 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:02.298841 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:02.298841 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:02.298841 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:02.298841 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:02.298841 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:02.298841 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:02.298841 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:09:02.298841 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:09:02.298841 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:09:02.299770 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:09:02.299770 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:02.299770 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:02.299770 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:02.299770 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:02.299770 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:02.299770 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:02.299770 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:02.299770 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:09:02.299770 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:02.299770 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:02.299770 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:02.299770 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:02.299770 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:02.299770 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:02.299770 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:02.299770 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:02.300636 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:09:02.300636 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:09:02.300636 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:02.300636 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:02.301000 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 297/592] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:09:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:02.302320 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955b3354-eadc-44fc-90f7-0f7cb91f5541 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:02.338630 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b7397-ddc0-4231-a755-99d475b8a284 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:02.347515 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:02.382662 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9c6410-ec15-4848-bc54-3e8b8eaec2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:02.383373 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c6410-ec15-4848-bc54-3e8b8eaec2ce None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:02.383663 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c6410-ec15-4848-bc54-3e8b8eaec2ce None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:02.383942 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c6410-ec15-4848-bc54-3e8b8eaec2ce None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:02.384786 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9c6410-ec15-4848-bc54-3e8b8eaec2ce None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:02.385101 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9c6410-ec15-4848-bc54-3e8b8eaec2ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:02.387117 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9c6410-ec15-4848-bc54-3e8b8eaec2ce None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:02.416790 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 296/593] 10.222.0.62 () {56 vars in 1139 bytes} [Fri May 27 16:09:02 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:02.416790 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9c6410-ec15-4848-bc54-3e8b8eaec2ce None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:02.421157 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955b3354-eadc-44fc-90f7-0f7cb91f5541 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:02.424135 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:02.459756 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f244be4-9982-4fa2-b10e-cd222eabf801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:02.462307 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f244be4-9982-4fa2-b10e-cd222eabf801 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:02.463034 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f244be4-9982-4fa2-b10e-cd222eabf801 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:02.463725 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f244be4-9982-4fa2-b10e-cd222eabf801 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:02.477764 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f244be4-9982-4fa2-b10e-cd222eabf801 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:02.479641 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f244be4-9982-4fa2-b10e-cd222eabf801 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:02.499582 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-5f244be4-9982-4fa2-b10e-cd222eabf801 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:02.499582 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:02.499582 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:02.499582 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:02.499582 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:02.499582 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:02.499582 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:02.499582 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:02.499582 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:02.499582 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:02.499582 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:02.499582 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:02.499582 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:09:02.499582 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:09:02.499582 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:09:02.500596 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:09:02.500596 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:02.500596 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:02.500596 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:02.500596 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:02.500596 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:02.500596 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:02.500596 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:02.500596 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:09:02.500596 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:02.500596 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:02.500596 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:02.500596 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:02.500596 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:02.500596 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:02.500596 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:02.500596 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:02.501503 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:09:02.501503 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:09:02.501503 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:02.501503 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:02.503832 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 298/594] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:09:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:02.504879 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f244be4-9982-4fa2-b10e-cd222eabf801 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:02.532052 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9c6410-ec15-4848-bc54-3e8b8eaec2ce None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:02.576164 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a8fc8-b016-43a6-bd9c-a7ed9db92bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:02.577419 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a8fc8-b016-43a6-bd9c-a7ed9db92bc6 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:02.577929 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a8fc8-b016-43a6-bd9c-a7ed9db92bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:02.578446 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a8fc8-b016-43a6-bd9c-a7ed9db92bc6 None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:02.579382 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521a8fc8-b016-43a6-bd9c-a7ed9db92bc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:02.579897 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521a8fc8-b016-43a6-bd9c-a7ed9db92bc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:02.581646 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521a8fc8-b016-43a6-bd9c-a7ed9db92bc6 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:02.595983 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 297/595] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 16:09:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:02.597321 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a8fc8-b016-43a6-bd9c-a7ed9db92bc6 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:02.622167 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f244be4-9982-4fa2-b10e-cd222eabf801 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:02.634659 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:02.664637 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ed2599-c77f-475b-8ee1-c745de521deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:02.665812 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed2599-c77f-475b-8ee1-c745de521deb None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:02.666430 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed2599-c77f-475b-8ee1-c745de521deb None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:02.666917 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed2599-c77f-475b-8ee1-c745de521deb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:02.681578 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ed2599-c77f-475b-8ee1-c745de521deb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:02.683524 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ed2599-c77f-475b-8ee1-c745de521deb None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:02.705474 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-28ed2599-c77f-475b-8ee1-c745de521deb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:02.705474 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:02.705474 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:02.705474 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:02.705474 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:02.705474 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:02.705474 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:02.705474 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:02.705474 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:02.705474 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:02.705474 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:02.705474 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:02.705474 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:09:02.705474 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:09:02.705474 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:09:02.706445 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:09:02.706445 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:02.706445 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:02.706445 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:02.706445 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:02.706445 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:02.706445 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:02.706445 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:02.706445 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:09:02.706445 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:02.706445 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:02.706445 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:02.706445 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:02.706445 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:02.706445 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:02.706445 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:02.706445 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:02.707350 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:09:02.707350 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:09:02.707350 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:02.707350 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:02.709276 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 299/596] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:09:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:02.710389 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ed2599-c77f-475b-8ee1-c745de521deb None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:02.716859 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a8fc8-b016-43a6-bd9c-a7ed9db92bc6 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:02.727554 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:02.753969 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673d3593-67ac-4098-a514-5ecc58a7ed77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:02.755342 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d3593-67ac-4098-a514-5ecc58a7ed77 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:02.755839 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d3593-67ac-4098-a514-5ecc58a7ed77 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:02.756341 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d3593-67ac-4098-a514-5ecc58a7ed77 None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:02.757831 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673d3593-67ac-4098-a514-5ecc58a7ed77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:02.758391 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673d3593-67ac-4098-a514-5ecc58a7ed77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:02.761486 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673d3593-67ac-4098-a514-5ecc58a7ed77 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:02.776055 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 298/597] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 16:09:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:02.777183 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673d3593-67ac-4098-a514-5ecc58a7ed77 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:02.829556 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ed2599-c77f-475b-8ee1-c745de521deb None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:02.874060 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:02.875690 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc71add3-d670-4f36-922f-71773327d91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:02.876728 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc71add3-d670-4f36-922f-71773327d91b None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:02.877106 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc71add3-d670-4f36-922f-71773327d91b None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:02.877479 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc71add3-d670-4f36-922f-71773327d91b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:02.886944 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc71add3-d670-4f36-922f-71773327d91b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:02.888984 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc71add3-d670-4f36-922f-71773327d91b None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:02.892444 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673d3593-67ac-4098-a514-5ecc58a7ed77 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:02.908045 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-dc71add3-d670-4f36-922f-71773327d91b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:09:02.908045 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:02.908045 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:02.908045 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:02.908045 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:02.908045 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:02.908045 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:02.908045 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:02.908045 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:02.908045 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:02.908045 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:02.908045 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:02.908045 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 16:09:02.908045 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 16:09:02.908045 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 16:09:02.909301 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 16:09:02.909301 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:02.909301 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:02.909301 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:02.909301 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:02.909301 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:02.909301 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:02.909301 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:02.909301 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:09:02.909301 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:02.909301 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:02.909301 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:02.909301 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:02.909301 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:02.909301 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:02.909301 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:02.909301 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:02.910357 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 16:09:02.910357 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 16:09:02.910357 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 16:09:02.910357 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 16:09:02.910357 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 16:09:02.910357 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 16:09:02.910357 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:09:02.910357 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:02.914414 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 300/598] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 16:09:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:02.915621 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc71add3-d670-4f36-922f-71773327d91b None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:02.941186 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853e882c-8a6e-4b17-ad95-af711f3d4d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:02.942295 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e882c-8a6e-4b17-ad95-af711f3d4d45 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:02.942792 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e882c-8a6e-4b17-ad95-af711f3d4d45 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:02.943385 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e882c-8a6e-4b17-ad95-af711f3d4d45 None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:02.945028 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853e882c-8a6e-4b17-ad95-af711f3d4d45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:02.946121 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853e882c-8a6e-4b17-ad95-af711f3d4d45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:02.947812 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853e882c-8a6e-4b17-ad95-af711f3d4d45 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:02.966034 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 299/599] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 16:09:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:02.967460 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853e882c-8a6e-4b17-ad95-af711f3d4d45 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:03.013091 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:03.046786 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc71add3-d670-4f36-922f-71773327d91b None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:03.082484 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b6c3c-a7de-4c64-bd32-9a1b2b7cdb15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:03.083428 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b6c3c-a7de-4c64-bd32-9a1b2b7cdb15 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:03.083815 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b6c3c-a7de-4c64-bd32-9a1b2b7cdb15 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:03.084212 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b6c3c-a7de-4c64-bd32-9a1b2b7cdb15 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:03.085642 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853e882c-8a6e-4b17-ad95-af711f3d4d45 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:03.091547 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230b6c3c-a7de-4c64-bd32-9a1b2b7cdb15 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:03.093121 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230b6c3c-a7de-4c64-bd32-9a1b2b7cdb15 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:03.108097 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-230b6c3c-a7de-4c64-bd32-9a1b2b7cdb15 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:09:03.108097 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:03.108097 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:03.108097 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:03.108097 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:03.108097 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:03.108097 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:03.108097 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:03.108097 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:03.108097 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:03.108097 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:03.108097 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:03.108097 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 16:09:03.108097 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 16:09:03.108097 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 16:09:03.109213 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 16:09:03.109213 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:03.109213 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:03.109213 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:03.109213 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:03.109213 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:03.109213 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:03.109213 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:03.109213 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:09:03.109213 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:03.109213 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:03.109213 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:03.109213 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:03.109213 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:03.109213 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:03.109213 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:03.109213 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:03.110340 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 16:09:03.110340 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 16:09:03.110340 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 16:09:03.110340 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 16:09:03.110340 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 16:09:03.110340 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 16:09:03.110340 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:09:03.110340 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:03.116076 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 301/600] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 16:09:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:03.117535 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b6c3c-a7de-4c64-bd32-9a1b2b7cdb15 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:03.126597 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32e7c90-da84-45d8-922b-a533f523c89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:03.127264 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32e7c90-da84-45d8-922b-a533f523c89e None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:03.127552 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32e7c90-da84-45d8-922b-a533f523c89e None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:03.127833 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32e7c90-da84-45d8-922b-a533f523c89e None admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:03.128627 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32e7c90-da84-45d8-922b-a533f523c89e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:03.128944 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32e7c90-da84-45d8-922b-a533f523c89e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:03.130440 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32e7c90-da84-45d8-922b-a533f523c89e None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:03.143059 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 300/601] 10.222.0.62 () {56 vars in 1148 bytes} [Fri May 27 16:09:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:03.148585 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32e7c90-da84-45d8-922b-a533f523c89e None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:03.153434 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:03.221423 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b6c3c-a7de-4c64-bd32-9a1b2b7cdb15 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:03.250598 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:03.256970 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32e7c90-da84-45d8-922b-a533f523c89e None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:03.258658 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fe8e5a-51c5-4756-ae55-6bce6d1b7d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:03.259458 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe8e5a-51c5-4756-ae55-6bce6d1b7d80 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:03.259742 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe8e5a-51c5-4756-ae55-6bce6d1b7d80 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:03.260024 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe8e5a-51c5-4756-ae55-6bce6d1b7d80 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:03.266888 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fe8e5a-51c5-4756-ae55-6bce6d1b7d80 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:03.268271 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fe8e5a-51c5-4756-ae55-6bce6d1b7d80 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:03.282806 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-62fe8e5a-51c5-4756-ae55-6bce6d1b7d80 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:09:03.282806 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:03.282806 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:03.282806 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:03.282806 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:03.282806 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:03.282806 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:03.282806 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:03.282806 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:03.282806 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:03.282806 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:03.282806 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:03.282806 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 16:09:03.282806 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 16:09:03.282806 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 16:09:03.283720 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 16:09:03.283720 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:03.283720 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:03.283720 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:03.283720 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:03.283720 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:03.283720 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:03.283720 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:03.283720 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:09:03.283720 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:03.283720 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:03.283720 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:03.283720 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:03.283720 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:03.283720 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:03.283720 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:03.283720 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:03.284607 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 16:09:03.284607 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 16:09:03.284607 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 16:09:03.284607 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 16:09:03.284607 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 16:09:03.284607 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 16:09:03.284607 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:09:03.284607 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:03.284607 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 302/602] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 16:09:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:03.285904 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297b7962-e3e9-4932-b494-1bbd1f878bc3 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:03.286198 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297b7962-e3e9-4932-b494-1bbd1f878bc3 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:03.286504 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297b7962-e3e9-4932-b494-1bbd1f878bc3 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:03.290694 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 303/603] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:09:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:09:03.290694 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297b7962-e3e9-4932-b494-1bbd1f878bc3 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:03.296532 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b1944-ccab-4e6b-8265-fb44f687567f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:03.297198 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b1944-ccab-4e6b-8265-fb44f687567f None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:03.297487 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b1944-ccab-4e6b-8265-fb44f687567f None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:03.297768 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b1944-ccab-4e6b-8265-fb44f687567f None admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:03.298591 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79b1944-ccab-4e6b-8265-fb44f687567f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:03.298906 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79b1944-ccab-4e6b-8265-fb44f687567f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:03.300355 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79b1944-ccab-4e6b-8265-fb44f687567f None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:03.313596 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 301/604] 10.222.0.62 () {56 vars in 1148 bytes} [Fri May 27 16:09:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:03.314461 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b1944-ccab-4e6b-8265-fb44f687567f None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:03.379778 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:03.402165 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297b7962-e3e9-4932-b494-1bbd1f878bc3 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:03.421806 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b1944-ccab-4e6b-8265-fb44f687567f None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:03.438192 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec91489-91f8-427b-9b72-d1613ae2bbc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:03.439103 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec91489-91f8-427b-9b72-d1613ae2bbc0 None admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:03.439381 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec91489-91f8-427b-9b72-d1613ae2bbc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:03.439714 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec91489-91f8-427b-9b72-d1613ae2bbc0 None admin] PATH_INFO: `/v3/projects/d48d95a12587479ca5714f6ebd60dd9f/users/2b072079733049e8ac204ebe5cc635ec/roles/1d9076bd231c43809cb971b6360e0c28` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:03.454591 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec91489-91f8-427b-9b72-d1613ae2bbc0 None admin] RBAC: Authorizing `identity:create_grant(project_id=d48d95a12587479ca5714f6ebd60dd9f, user_id=2b072079733049e8ac204ebe5cc635ec, role_id=1d9076bd231c43809cb971b6360e0c28)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:03.456020 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec91489-91f8-427b-9b72-d1613ae2bbc0 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:03.457200 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7629e4e6-dcc3-4573-8c7d-e63727463b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:03.458048 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629e4e6-dcc3-4573-8c7d-e63727463b25 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:03.458368 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629e4e6-dcc3-4573-8c7d-e63727463b25 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:03.458652 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629e4e6-dcc3-4573-8c7d-e63727463b25 None admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:03.459437 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7629e4e6-dcc3-4573-8c7d-e63727463b25 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:03.459745 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7629e4e6-dcc3-4573-8c7d-e63727463b25 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:03.461744 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7629e4e6-dcc3-4573-8c7d-e63727463b25 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:03.473628 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 302/605] 10.222.0.62 () {56 vars in 1148 bytes} [Fri May 27 16:09:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:03.475112 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ac13d-3d99-4a64-bbb3-33aff579920e None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:03.475412 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ac13d-3d99-4a64-bbb3-33aff579920e None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:03.475730 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ac13d-3d99-4a64-bbb3-33aff579920e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:03.492363 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-dd0ac13d-3d99-4a64-bbb3-33aff579920e None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:09:03.493550 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-dd0ac13d-3d99-4a64-bbb3-33aff579920e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:09:03.534363 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 304/606] 10.222.0.62 () {58 vars in 1439 bytes} [Fri May 27 16:09:03 2022] PUT /identity/v3/projects/d48d95a12587479ca5714f6ebd60dd9f/users/2b072079733049e8ac204ebe5cc635ec/roles/1d9076bd231c43809cb971b6360e0c28 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:09:03.534363 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec91489-91f8-427b-9b72-d1613ae2bbc0 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:03.570676 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 303/607] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:09:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:09:03.571581 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0ac13d-3d99-4a64-bbb3-33aff579920e None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:03.591138 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:03.636041 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:03.673137 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec91489-91f8-427b-9b72-d1613ae2bbc0 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:03.685737 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0ac13d-3d99-4a64-bbb3-33aff579920e None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:03.726228 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988e1624-78ad-41eb-a97f-c3b3ef44b068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:03.727329 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e1624-78ad-41eb-a97f-c3b3ef44b068 None admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:03.727810 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e1624-78ad-41eb-a97f-c3b3ef44b068 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:03.728195 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e1624-78ad-41eb-a97f-c3b3ef44b068 None admin] PATH_INFO: `/v3/projects/d48d95a12587479ca5714f6ebd60dd9f/users/b367ccea28d540a0b24ec4e42ebfef65/roles/1d9076bd231c43809cb971b6360e0c28` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:03.728665 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f8417-3a4a-4e63-bd20-38c03f21f853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:03.729729 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f8417-3a4a-4e63-bd20-38c03f21f853 None admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:03.730159 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f8417-3a4a-4e63-bd20-38c03f21f853 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:03.730642 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f8417-3a4a-4e63-bd20-38c03f21f853 None admin] PATH_INFO: `/v3/projects/d48d95a12587479ca5714f6ebd60dd9f/users/d8693a1e72f14fdfb383f11e96330726/roles/1d9076bd231c43809cb971b6360e0c28` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:03.746127 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988e1624-78ad-41eb-a97f-c3b3ef44b068 None admin] RBAC: Authorizing `identity:create_grant(project_id=d48d95a12587479ca5714f6ebd60dd9f, user_id=b367ccea28d540a0b24ec4e42ebfef65, role_id=1d9076bd231c43809cb971b6360e0c28)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:03.747813 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988e1624-78ad-41eb-a97f-c3b3ef44b068 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:03.753375 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4f8417-3a4a-4e63-bd20-38c03f21f853 None admin] RBAC: Authorizing `identity:create_grant(project_id=d48d95a12587479ca5714f6ebd60dd9f, user_id=d8693a1e72f14fdfb383f11e96330726, role_id=1d9076bd231c43809cb971b6360e0c28)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:03.755314 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4f8417-3a4a-4e63-bd20-38c03f21f853 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:03.840865 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 304/608] 10.222.0.62 () {58 vars in 1439 bytes} [Fri May 27 16:09:03 2022] PUT /identity/v3/projects/d48d95a12587479ca5714f6ebd60dd9f/users/b367ccea28d540a0b24ec4e42ebfef65/roles/1d9076bd231c43809cb971b6360e0c28 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:09:03.842353 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988e1624-78ad-41eb-a97f-c3b3ef44b068 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:03.872990 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 305/609] 10.222.0.62 () {58 vars in 1439 bytes} [Fri May 27 16:09:03 2022] PUT /identity/v3/projects/d48d95a12587479ca5714f6ebd60dd9f/users/d8693a1e72f14fdfb383f11e96330726/roles/1d9076bd231c43809cb971b6360e0c28 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:09:03.971749 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988e1624-78ad-41eb-a97f-c3b3ef44b068 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:03.974629 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:04.013698 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf67dfde-b53a-4c97-98a2-5c0d12e09ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:04.014574 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf67dfde-b53a-4c97-98a2-5c0d12e09ad2 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:04.014858 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf67dfde-b53a-4c97-98a2-5c0d12e09ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:04.015135 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf67dfde-b53a-4c97-98a2-5c0d12e09ad2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:04.028083 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf67dfde-b53a-4c97-98a2-5c0d12e09ad2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:09:04.036116 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-bf67dfde-b53a-4c97-98a2-5c0d12e09ad2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 16:09:04.036116 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:04.036116 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:04.036116 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:04.036116 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:04.036116 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:04.036116 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:04.036116 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:04.036116 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:04.036116 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:04.036116 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:04.036116 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:04.036116 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:09:04.036116 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:09:04.036116 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:09:04.036116 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:09:04.037109 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:09:04.037109 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:09:04.037109 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:09:04.037109 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:09:04.037109 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:04.037109 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:04.037109 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:04.037109 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:04.037109 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:04.037109 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:04.037109 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:04.037109 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:09:04.037109 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:04.037109 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:04.037109 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:04.037109 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:04.038269 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:04.038269 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:04.038269 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:04.038269 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:04.038269 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:09:04.038269 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:09:04.038269 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:09:04.038269 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:09:04.038269 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:09:04.038269 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:09:04.038269 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 16:09:04.038269 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:04.038269 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 305/610] 10.222.0.62 () {56 vars in 1102 bytes} [Fri May 27 16:09:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:04.051837 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f8417-3a4a-4e63-bd20-38c03f21f853 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:04.179221 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:04.193431 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f8417-3a4a-4e63-bd20-38c03f21f853 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:04.235007 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d68a06a-1b02-4305-b60b-fac756d8c52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:04.235741 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68a06a-1b02-4305-b60b-fac756d8c52a None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:04.236027 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68a06a-1b02-4305-b60b-fac756d8c52a None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:04.236353 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68a06a-1b02-4305-b60b-fac756d8c52a None admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:04.237114 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d68a06a-1b02-4305-b60b-fac756d8c52a None admin] RBAC: Adding query filter params (name=service) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:04.237424 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d68a06a-1b02-4305-b60b-fac756d8c52a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:04.238822 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d68a06a-1b02-4305-b60b-fac756d8c52a None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:04.247936 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 306/611] 10.222.0.62 () {56 vars in 1103 bytes} [Fri May 27 16:09:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:04.254970 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf67dfde-b53a-4c97-98a2-5c0d12e09ad2 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:04.362952 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf67dfde-b53a-4c97-98a2-5c0d12e09ad2 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:04.396286 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848142f3-5436-4e9d-a4bb-b25cea60944b None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:04.396935 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848142f3-5436-4e9d-a4bb-b25cea60944b None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:04.397482 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848142f3-5436-4e9d-a4bb-b25cea60944b None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:04.403045 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc57377f-4d82-4f27-be43-f52e53705a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:04.403045 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57377f-4d82-4f27-be43-f52e53705a14 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:04.403045 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57377f-4d82-4f27-be43-f52e53705a14 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:04.403045 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57377f-4d82-4f27-be43-f52e53705a14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:04.403601 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 307/612] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:09:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:09:04.405351 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc46f39-e574-4198-9570-642d9663fab5 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:04.405836 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc46f39-e574-4198-9570-642d9663fab5 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:04.406346 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc46f39-e574-4198-9570-642d9663fab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:04.412762 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc57377f-4d82-4f27-be43-f52e53705a14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:04.418439 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc57377f-4d82-4f27-be43-f52e53705a14 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:04.443305 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-fc57377f-4d82-4f27-be43-f52e53705a14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:04.443305 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:04.443305 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:04.443305 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:04.443305 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:04.443305 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:04.443305 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:04.443305 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:04.443305 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:04.443305 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:04.443305 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:04.443305 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:04.443305 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:09:04.443305 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:09:04.443305 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:09:04.444943 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:09:04.444943 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:04.444943 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:04.444943 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:04.444943 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:04.444943 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:04.444943 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:04.444943 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:04.444943 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:09:04.444943 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:04.444943 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:04.444943 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:04.444943 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:04.444943 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:04.444943 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:04.444943 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:04.444943 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:04.445871 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:09:04.445871 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:09:04.445871 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:04.445871 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:04.447267 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-7dc46f39-e574-4198-9570-642d9663fab5 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:09:04.447946 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 306/613] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:09:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:04.448471 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-7dc46f39-e574-4198-9570-642d9663fab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:09:04.463932 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc57377f-4d82-4f27-be43-f52e53705a14 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:04.496660 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:04.523984 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 308/614] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:09:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 16:09:04.546145 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc46f39-e574-4198-9570-642d9663fab5 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:04.640906 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc57377f-4d82-4f27-be43-f52e53705a14 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:04.649931 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:04.685290 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc46f39-e574-4198-9570-642d9663fab5 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:04.704550 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c6dad1-efc3-45f2-9f1b-44f2fcfcefa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:04.705131 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6dad1-efc3-45f2-9f1b-44f2fcfcefa2 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:04.705418 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6dad1-efc3-45f2-9f1b-44f2fcfcefa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:04.705713 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6dad1-efc3-45f2-9f1b-44f2fcfcefa2 None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:04.710321 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c6dad1-efc3-45f2-9f1b-44f2fcfcefa2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:04.710321 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c6dad1-efc3-45f2-9f1b-44f2fcfcefa2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:04.710321 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c6dad1-efc3-45f2-9f1b-44f2fcfcefa2 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:04.733521 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 307/615] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 16:09:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:09:04.742713 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c6dad1-efc3-45f2-9f1b-44f2fcfcefa2 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:04.761047 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87408a11-32ff-4337-acee-ed624fe186bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:04.762852 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87408a11-32ff-4337-acee-ed624fe186bf None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:04.763444 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87408a11-32ff-4337-acee-ed624fe186bf None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:04.765147 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87408a11-32ff-4337-acee-ed624fe186bf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:04.788193 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87408a11-32ff-4337-acee-ed624fe186bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:09:04.797339 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-87408a11-32ff-4337-acee-ed624fe186bf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 16:09:04.797339 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:04.797339 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:04.797339 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:04.797339 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:04.797339 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:04.797339 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:04.797339 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:04.797339 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:04.797339 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:04.797339 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:04.797339 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:04.797339 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:09:04.797339 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:09:04.797339 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:09:04.797339 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:09:04.798315 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:09:04.798315 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:09:04.798315 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:09:04.798315 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:09:04.798315 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:04.798315 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:04.798315 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:04.798315 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:04.798315 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:04.798315 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:04.798315 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:04.798315 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:09:04.798315 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:04.798315 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:04.798315 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:04.798315 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:04.799153 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:04.799153 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:04.799153 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:04.799153 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:04.799153 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:09:04.799153 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:09:04.799153 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:09:04.799153 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:09:04.799153 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:09:04.799153 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:09:04.799153 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 16:09:04.799153 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:04.800409 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 309/616] 10.222.0.62 () {56 vars in 1102 bytes} [Fri May 27 16:09:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:09:04.807588 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87408a11-32ff-4337-acee-ed624fe186bf None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:04.915247 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:04.964707 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87408a11-32ff-4337-acee-ed624fe186bf None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:05.001265 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c6dad1-efc3-45f2-9f1b-44f2fcfcefa2 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:05.002716 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0e9bc2-edce-4a6e-b190-d540d705f2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:05.003704 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e9bc2-edce-4a6e-b190-d540d705f2ae None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:05.003986 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e9bc2-edce-4a6e-b190-d540d705f2ae None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:05.004311 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e9bc2-edce-4a6e-b190-d540d705f2ae None admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:05.005080 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0e9bc2-edce-4a6e-b190-d540d705f2ae None admin] RBAC: Adding query filter params (name=service) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:05.005386 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0e9bc2-edce-4a6e-b190-d540d705f2ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:05.006923 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0e9bc2-edce-4a6e-b190-d540d705f2ae None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:05.021857 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 310/617] 10.222.0.62 () {56 vars in 1103 bytes} [Fri May 27 16:09:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:09:05.023131 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0e9bc2-edce-4a6e-b190-d540d705f2ae None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:05.025798 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:05.079984 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d21bc66-8899-4782-8951-aa3745a61a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:05.080788 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d21bc66-8899-4782-8951-aa3745a61a9c None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:05.081053 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d21bc66-8899-4782-8951-aa3745a61a9c None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:05.081322 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d21bc66-8899-4782-8951-aa3745a61a9c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:05.099012 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d21bc66-8899-4782-8951-aa3745a61a9c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:05.101825 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d21bc66-8899-4782-8951-aa3745a61a9c None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:05.129913 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-3d21bc66-8899-4782-8951-aa3745a61a9c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 16:09:05.129913 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:05.129913 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:05.129913 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:05.129913 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:05.129913 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:05.129913 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:05.129913 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:05.129913 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:05.129913 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:05.129913 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:05.129913 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:05.129913 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 16:09:05.129913 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 16:09:05.129913 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 16:09:05.129913 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 16:09:05.130937 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:05.130937 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:05.130937 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 16:09:05.130937 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:09:05.130937 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 16:09:05.130937 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:09:05.130937 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:05.130937 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:05.130937 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:05.130937 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:05.130937 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:05.130937 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:09:05.130937 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:05.130937 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:05.130937 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:05.130937 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:05.130937 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:05.130937 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:05.132488 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:05.132488 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:05.132488 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 16:09:05.132488 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 16:09:05.132488 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 16:09:05.132488 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 16:09:05.132488 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 16:09:05.132488 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 16:09:05.132488 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 16:09:05.132488 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:05.136519 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 308/618] 10.222.0.62 () {56 vars in 1093 bytes} [Fri May 27 16:09:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 394 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:05.143961 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d21bc66-8899-4782-8951-aa3745a61a9c None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:05.193953 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0e9bc2-edce-4a6e-b190-d540d705f2ae None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:05.259978 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8da6ee-f9c0-45c5-82eb-39d62624e678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:05.261143 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8da6ee-f9c0-45c5-82eb-39d62624e678 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:05.261628 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8da6ee-f9c0-45c5-82eb-39d62624e678 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:05.262122 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8da6ee-f9c0-45c5-82eb-39d62624e678 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:05.270275 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d21bc66-8899-4782-8951-aa3745a61a9c None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:05.286907 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8da6ee-f9c0-45c5-82eb-39d62624e678 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:05.288863 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8da6ee-f9c0-45c5-82eb-39d62624e678 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:05.304462 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b606677-85ba-4403-a297-45f55802aacb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:05.305143 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b606677-85ba-4403-a297-45f55802aacb None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:05.305427 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b606677-85ba-4403-a297-45f55802aacb None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:05.305703 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b606677-85ba-4403-a297-45f55802aacb None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:05.306573 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b606677-85ba-4403-a297-45f55802aacb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:05.306884 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b606677-85ba-4403-a297-45f55802aacb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:05.308453 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b606677-85ba-4403-a297-45f55802aacb None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:05.311367 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:05.317382 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-fb8da6ee-f9c0-45c5-82eb-39d62624e678 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:05.317382 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:05.317382 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:05.317382 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:05.317382 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:05.317382 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:05.317382 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:05.317382 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:05.317382 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:05.317382 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:05.317382 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:05.317382 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:05.317382 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:09:05.317382 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:09:05.317382 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:09:05.318286 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:09:05.318286 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:05.318286 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:05.318286 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:05.318286 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:05.318286 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:05.318286 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:05.318286 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:05.318286 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:09:05.318286 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:05.318286 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:05.318286 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:05.318286 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:05.318286 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:05.318286 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:05.318286 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:05.318286 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:05.319241 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:09:05.319241 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:09:05.319241 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:05.319241 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:05.321499 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 311/619] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:09:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:09:05.331255 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8da6ee-f9c0-45c5-82eb-39d62624e678 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:05.332457 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 309/620] 10.222.0.62 () {56 vars in 1133 bytes} [Fri May 27 16:09:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:05.342595 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b606677-85ba-4403-a297-45f55802aacb None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:05.423184 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:05.504109 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8da6ee-f9c0-45c5-82eb-39d62624e678 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:05.527878 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b606677-85ba-4403-a297-45f55802aacb None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:05.568410 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4093273-38ab-4346-88c4-900f3c4663ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:05.569113 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4093273-38ab-4346-88c4-900f3c4663ea None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:05.569413 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4093273-38ab-4346-88c4-900f3c4663ea None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:05.569687 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4093273-38ab-4346-88c4-900f3c4663ea None admin] PATH_INFO: `/v3/domains` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:05.570446 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4093273-38ab-4346-88c4-900f3c4663ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:05.570759 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4093273-38ab-4346-88c4-900f3c4663ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:05.572286 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4093273-38ab-4346-88c4-900f3c4663ea None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:05.585821 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 312/621] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 16:09:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:05.593051 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4093273-38ab-4346-88c4-900f3c4663ea None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:05.602834 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af0188f-620f-4926-b879-0ea835baf012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:05.603502 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0188f-620f-4926-b879-0ea835baf012 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:05.603787 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0188f-620f-4926-b879-0ea835baf012 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:05.604063 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0188f-620f-4926-b879-0ea835baf012 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:05.722384 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:05.730914 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af0188f-620f-4926-b879-0ea835baf012 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:05.732728 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af0188f-620f-4926-b879-0ea835baf012 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:05.789463 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4093273-38ab-4346-88c4-900f3c4663ea None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:05.817183 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:05.867268 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0977e4e-5dd3-4882-8797-b0a888e1af6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:05.868126 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0977e4e-5dd3-4882-8797-b0a888e1af6e None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:05.868344 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0977e4e-5dd3-4882-8797-b0a888e1af6e None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:05.868618 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0977e4e-5dd3-4882-8797-b0a888e1af6e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:05.881474 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0977e4e-5dd3-4882-8797-b0a888e1af6e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:05.883499 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0977e4e-5dd3-4882-8797-b0a888e1af6e None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:05.889374 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 310/622] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 16:09:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 16:09:05.899718 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af0188f-620f-4926-b879-0ea835baf012 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:05.919403 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-b0977e4e-5dd3-4882-8797-b0a888e1af6e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 27 16:09:05.919403 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:05.919403 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:05.919403 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:05.919403 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:05.919403 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:05.919403 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:05.919403 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:05.919403 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:05.919403 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:05.919403 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:05.919403 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:05.919403 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 16:09:05.919403 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 16:09:05.919403 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 16:09:05.919403 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 16:09:05.920380 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:05.920380 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:05.920380 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 16:09:05.920380 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:09:05.920380 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 16:09:05.920380 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:09:05.920380 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:05.920380 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:05.920380 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:05.920380 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:05.920380 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:05.920380 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:09:05.920380 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:05.920380 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:05.920380 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:05.920380 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:05.920380 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:05.920380 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:05.921306 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:05.921306 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:05.921306 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 16:09:05.921306 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 16:09:05.921306 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 16:09:05.921306 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 16:09:05.921306 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 16:09:05.921306 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 16:09:05.921306 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 27 16:09:05.921306 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:05.922379 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 313/623] 10.222.0.62 () {56 vars in 1096 bytes} [Fri May 27 16:09:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:09:05.929880 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0977e4e-5dd3-4882-8797-b0a888e1af6e None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:06.048719 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:06.056235 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af0188f-620f-4926-b879-0ea835baf012 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:06.070412 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0977e4e-5dd3-4882-8797-b0a888e1af6e None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:06.093539 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15df47e3-9f0d-442e-84f2-b1a87347ab99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:06.094375 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df47e3-9f0d-442e-84f2-b1a87347ab99 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:06.094989 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df47e3-9f0d-442e-84f2-b1a87347ab99 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:06.095389 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df47e3-9f0d-442e-84f2-b1a87347ab99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:06.108290 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15df47e3-9f0d-442e-84f2-b1a87347ab99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:06.109621 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459b73ca-0336-42ab-abba-d16f47e35df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:06.109839 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15df47e3-9f0d-442e-84f2-b1a87347ab99 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:06.110931 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b73ca-0336-42ab-abba-d16f47e35df5 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:06.111427 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b73ca-0336-42ab-abba-d16f47e35df5 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:06.111909 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b73ca-0336-42ab-abba-d16f47e35df5 None admin] PATH_INFO: `/v3/users` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:06.112948 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459b73ca-0336-42ab-abba-d16f47e35df5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:06.113450 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459b73ca-0336-42ab-abba-d16f47e35df5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:06.115081 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459b73ca-0336-42ab-abba-d16f47e35df5 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:06.128187 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-15df47e3-9f0d-442e-84f2-b1a87347ab99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:06.128187 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:06.128187 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:06.128187 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:06.128187 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:06.128187 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:06.128187 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:06.128187 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:06.128187 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:06.128187 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:06.128187 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:06.128187 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:06.128187 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:09:06.128187 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:09:06.128187 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:09:06.129119 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:09:06.129119 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:06.129119 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:06.129119 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:06.129119 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:06.129119 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:06.129119 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:06.129119 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:06.129119 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:09:06.129119 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:06.129119 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:06.129119 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:06.129119 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:06.129119 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:06.129119 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:06.129119 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:06.129119 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:06.130643 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:09:06.130643 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:09:06.130643 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:06.130643 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:06.130643 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 311/624] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:09:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:09:06.131137 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b58cc30-b6bf-4b94-9f53-680a858ff6e1 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:06.131429 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b58cc30-b6bf-4b94-9f53-680a858ff6e1 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:06.131748 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b58cc30-b6bf-4b94-9f53-680a858ff6e1 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:06.137153 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 312/625] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:09:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:09:06.141950 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b58cc30-b6bf-4b94-9f53-680a858ff6e1 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:06.142223 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 314/626] 10.222.0.62 () {56 vars in 1135 bytes} [Fri May 27 16:09:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:06.145328 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c2b62b-b594-4a0c-85fd-082347bc573e None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:06.145890 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c2b62b-b594-4a0c-85fd-082347bc573e None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:06.146411 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c2b62b-b594-4a0c-85fd-082347bc573e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:06.164446 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-96c2b62b-b594-4a0c-85fd-082347bc573e None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:09:06.165937 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-96c2b62b-b594-4a0c-85fd-082347bc573e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:09:06.193993 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:06.240862 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 315/627] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:09:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:09:06.242717 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c2b62b-b594-4a0c-85fd-082347bc573e None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:06.259903 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b58cc30-b6bf-4b94-9f53-680a858ff6e1 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:06.310958 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c419eee-b786-4ade-98ef-abeeed84e4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:06.311549 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c419eee-b786-4ade-98ef-abeeed84e4ac None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:06.311837 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c419eee-b786-4ade-98ef-abeeed84e4ac None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:06.312115 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c419eee-b786-4ade-98ef-abeeed84e4ac None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:06.312845 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c419eee-b786-4ade-98ef-abeeed84e4ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:06.313157 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c419eee-b786-4ade-98ef-abeeed84e4ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:06.314693 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c419eee-b786-4ade-98ef-abeeed84e4ac None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:06.327016 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 313/628] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 16:09:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:06.327864 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c419eee-b786-4ade-98ef-abeeed84e4ac None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:06.337343 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:06.351895 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c2b62b-b594-4a0c-85fd-082347bc573e None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:06.391457 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cac8bbb-c499-423d-bca4-58805a98acbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:06.392643 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac8bbb-c499-423d-bca4-58805a98acbb None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:06.393128 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac8bbb-c499-423d-bca4-58805a98acbb None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:06.393634 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac8bbb-c499-423d-bca4-58805a98acbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:06.406582 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cac8bbb-c499-423d-bca4-58805a98acbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:06.408366 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cac8bbb-c499-423d-bca4-58805a98acbb None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:06.427336 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-1cac8bbb-c499-423d-bca4-58805a98acbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:06.427336 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:06.427336 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:06.427336 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:06.427336 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:06.427336 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:06.427336 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:06.427336 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:06.427336 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:06.427336 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:06.427336 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:06.427336 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:06.427336 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:09:06.427336 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:09:06.427336 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:09:06.428347 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:09:06.428347 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:06.428347 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:06.428347 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:06.428347 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:06.428347 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:06.428347 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:06.428347 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:06.428347 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:09:06.428347 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:06.428347 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:06.428347 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:06.428347 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:06.428347 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:06.428347 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:06.428347 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:06.428347 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:06.429382 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:09:06.429382 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:09:06.429382 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:06.429382 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:06.435796 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 316/629] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:09:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:06.436848 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cac8bbb-c499-423d-bca4-58805a98acbb None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:06.438562 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c419eee-b786-4ade-98ef-abeeed84e4ac None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:06.453787 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:06.476255 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ab4bc5-43b2-4729-a589-f0981eb2eb8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:06.477095 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab4bc5-43b2-4729-a589-f0981eb2eb8e None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:06.477387 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab4bc5-43b2-4729-a589-f0981eb2eb8e None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:06.477674 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab4bc5-43b2-4729-a589-f0981eb2eb8e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:06.493474 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ab4bc5-43b2-4729-a589-f0981eb2eb8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:09:06.503147 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-50ab4bc5-43b2-4729-a589-f0981eb2eb8e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 16:09:06.503147 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:06.503147 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:06.503147 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:06.503147 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:06.503147 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:06.503147 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:06.503147 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:06.503147 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:06.503147 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:06.503147 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:06.503147 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:06.503147 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:09:06.503147 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:09:06.503147 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:09:06.503147 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:09:06.504166 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:09:06.504166 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:09:06.504166 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:09:06.504166 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:09:06.504166 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:06.504166 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:06.504166 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:06.504166 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:06.504166 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:06.504166 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:06.504166 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:06.504166 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:09:06.504166 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:06.504166 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:06.504166 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:06.504166 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:06.505020 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:06.505020 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:06.505020 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:06.505020 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:06.505020 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:09:06.505020 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:09:06.505020 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:09:06.505020 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:09:06.505020 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:09:06.505020 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:09:06.505020 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 16:09:06.505020 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:06.505020 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 314/630] 10.222.0.62 () {56 vars in 1102 bytes} [Fri May 27 16:09:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:06.511089 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ab4bc5-43b2-4729-a589-f0981eb2eb8e None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:06.571988 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cac8bbb-c499-423d-bca4-58805a98acbb None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:06.581149 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:06.608292 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f30623c-fe7e-4ecd-a6b6-fe57555e6813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:06.610099 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f30623c-fe7e-4ecd-a6b6-fe57555e6813 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:06.610601 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f30623c-fe7e-4ecd-a6b6-fe57555e6813 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:06.610878 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f30623c-fe7e-4ecd-a6b6-fe57555e6813 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:06.618178 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f30623c-fe7e-4ecd-a6b6-fe57555e6813 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:06.618353 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ab4bc5-43b2-4729-a589-f0981eb2eb8e None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:06.619644 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f30623c-fe7e-4ecd-a6b6-fe57555e6813 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:06.633973 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-5f30623c-fe7e-4ecd-a6b6-fe57555e6813 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:09:06.633973 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:06.633973 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:06.633973 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:06.633973 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:06.633973 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:06.633973 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:06.633973 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:06.633973 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:06.633973 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:06.633973 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:06.633973 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:06.633973 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 16:09:06.633973 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 16:09:06.633973 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 16:09:06.635095 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 16:09:06.635095 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:06.635095 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:06.635095 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:06.635095 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:06.635095 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:06.635095 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:06.635095 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:06.635095 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:09:06.635095 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:06.635095 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:06.635095 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:06.635095 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:06.635095 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:06.635095 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:06.635095 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:06.635095 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:06.635981 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 16:09:06.635981 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 16:09:06.635981 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 16:09:06.635981 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 16:09:06.635981 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 16:09:06.635981 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 16:09:06.635981 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:09:06.635981 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:06.635981 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 317/631] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 16:09:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:06.635981 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f30623c-fe7e-4ecd-a6b6-fe57555e6813 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:06.661568 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4f063c-a562-40de-ba46-593997702ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:06.662390 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f063c-a562-40de-ba46-593997702ed9 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:06.662684 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f063c-a562-40de-ba46-593997702ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:06.662983 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f063c-a562-40de-ba46-593997702ed9 None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:06.664281 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4f063c-a562-40de-ba46-593997702ed9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:06.664590 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4f063c-a562-40de-ba46-593997702ed9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:06.666553 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4f063c-a562-40de-ba46-593997702ed9 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:06.681008 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 315/632] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 16:09:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:06.682284 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c113d-1284-42a3-ba82-49f60f1ed2f9 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:06.682585 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c113d-1284-42a3-ba82-49f60f1ed2f9 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:06.682860 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c113d-1284-42a3-ba82-49f60f1ed2f9 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:06.685350 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 316/633] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:09:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:09:06.685350 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401c113d-1284-42a3-ba82-49f60f1ed2f9 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:06.716220 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:06.740862 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f30623c-fe7e-4ecd-a6b6-fe57555e6813 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:06.775008 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3121e457-53d8-42d5-9291-77d4ff681bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:06.775674 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3121e457-53d8-42d5-9291-77d4ff681bc1 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:06.775961 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3121e457-53d8-42d5-9291-77d4ff681bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:06.776239 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3121e457-53d8-42d5-9291-77d4ff681bc1 None admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:06.776981 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3121e457-53d8-42d5-9291-77d4ff681bc1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:06.777290 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3121e457-53d8-42d5-9291-77d4ff681bc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:06.778677 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3121e457-53d8-42d5-9291-77d4ff681bc1 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:06.785436 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401c113d-1284-42a3-ba82-49f60f1ed2f9 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:06.786559 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 318/634] 10.222.0.62 () {56 vars in 1103 bytes} [Fri May 27 16:09:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:06.787729 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b685f7-2c97-4255-ae6e-dd77cc76733e None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:06.788067 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b685f7-2c97-4255-ae6e-dd77cc76733e None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:06.788400 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b685f7-2c97-4255-ae6e-dd77cc76733e None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:06.789625 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 319/635] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:09:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:09:06.790340 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b685f7-2c97-4255-ae6e-dd77cc76733e None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:06.814613 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:06.823638 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745f1630-87c9-44f9-9c95-1e7cb37b171e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:06.824011 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f1630-87c9-44f9-9c95-1e7cb37b171e None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:06.824299 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f1630-87c9-44f9-9c95-1e7cb37b171e None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:06.824582 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f1630-87c9-44f9-9c95-1e7cb37b171e None admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:06.825370 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745f1630-87c9-44f9-9c95-1e7cb37b171e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:06.825682 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745f1630-87c9-44f9-9c95-1e7cb37b171e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:06.827169 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745f1630-87c9-44f9-9c95-1e7cb37b171e None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:06.841508 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 317/636] 10.222.0.62 () {56 vars in 1148 bytes} [Fri May 27 16:09:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:06.841508 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dbf28c-1993-42a3-88eb-919571856f50 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:06.841508 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dbf28c-1993-42a3-88eb-919571856f50 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:06.841508 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dbf28c-1993-42a3-88eb-919571856f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:06.858118 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-e7dbf28c-1993-42a3-88eb-919571856f50 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:09:06.859342 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-e7dbf28c-1993-42a3-88eb-919571856f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:09:06.896564 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b685f7-2c97-4255-ae6e-dd77cc76733e None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:06.927065 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 318/637] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:09:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:09:06.927892 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dbf28c-1993-42a3-88eb-919571856f50 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:06.939848 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd821c40-302e-4331-9be7-393e1a019b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:06.940782 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd821c40-302e-4331-9be7-393e1a019b4f None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:06.941068 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd821c40-302e-4331-9be7-393e1a019b4f None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:06.941598 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd821c40-302e-4331-9be7-393e1a019b4f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:06.945404 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:06.950954 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd821c40-302e-4331-9be7-393e1a019b4f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:06.955351 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd821c40-302e-4331-9be7-393e1a019b4f None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:06.967422 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-dd821c40-302e-4331-9be7-393e1a019b4f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:09:06.967422 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:06.967422 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:06.967422 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:06.967422 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:06.967422 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:06.967422 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:06.967422 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:06.967422 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:06.967422 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:06.967422 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:06.967422 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:06.967422 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 16:09:06.967422 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 16:09:06.967422 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 16:09:06.968387 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 16:09:06.968387 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:06.968387 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:06.968387 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:06.968387 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:06.968387 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:06.968387 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:06.968387 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:06.968387 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:09:06.968387 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:06.968387 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:06.968387 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:06.968387 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:06.968387 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:06.968387 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:06.968387 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:06.968387 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:06.969259 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 16:09:06.969259 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 16:09:06.969259 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 16:09:06.969259 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 16:09:06.969259 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 16:09:06.969259 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 16:09:06.969259 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:09:06.969259 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:06.969259 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 320/638] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 16:09:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:06.970075 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e285c0-0355-4c98-81ea-48c212bb7af6 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:06.970320 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e285c0-0355-4c98-81ea-48c212bb7af6 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:06.970923 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e285c0-0355-4c98-81ea-48c212bb7af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:06.987404 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-15e285c0-0355-4c98-81ea-48c212bb7af6 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:09:06.988591 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-15e285c0-0355-4c98-81ea-48c212bb7af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:09:07.037227 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dbf28c-1993-42a3-88eb-919571856f50 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:07.054490 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:07.058993 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 321/639] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:09:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:09:07.059825 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e285c0-0355-4c98-81ea-48c212bb7af6 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:07.071817 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef9acd-a057-4fe5-8760-7a295fe2549d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:07.072764 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef9acd-a057-4fe5-8760-7a295fe2549d None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:07.073004 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef9acd-a057-4fe5-8760-7a295fe2549d None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:07.073280 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef9acd-a057-4fe5-8760-7a295fe2549d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:07.084232 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ef9acd-a057-4fe5-8760-7a295fe2549d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:07.086193 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ef9acd-a057-4fe5-8760-7a295fe2549d None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:07.104154 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-93ef9acd-a057-4fe5-8760-7a295fe2549d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:07.104154 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:07.104154 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:07.104154 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:07.104154 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:07.104154 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:07.104154 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:07.104154 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:07.104154 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:07.104154 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:07.104154 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:07.104154 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:07.104154 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:09:07.104154 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:09:07.104154 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:09:07.105204 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:09:07.105204 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:07.105204 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:07.105204 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:07.105204 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:07.105204 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:07.105204 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:07.105204 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:07.105204 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:09:07.105204 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:07.105204 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:07.105204 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:07.105204 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:07.105204 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:07.105204 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:07.105204 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:07.105204 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:07.106181 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:09:07.106181 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:09:07.106181 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:07.106181 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:07.106181 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 319/640] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:09:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:07.106485 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef9acd-a057-4fe5-8760-7a295fe2549d None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:07.163342 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e285c0-0355-4c98-81ea-48c212bb7af6 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:07.189268 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:07.197728 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29dc549-eb68-47b2-86e5-cd5b5d76b525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:07.198420 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29dc549-eb68-47b2-86e5-cd5b5d76b525 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:07.198697 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29dc549-eb68-47b2-86e5-cd5b5d76b525 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:07.198982 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29dc549-eb68-47b2-86e5-cd5b5d76b525 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:07.199843 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29dc549-eb68-47b2-86e5-cd5b5d76b525 None admin] RBAC: Adding query filter params (role.id=1d9076bd231c43809cb971b6360e0c28, scope.project.id=d48d95a12587479ca5714f6ebd60dd9f, user.id=cb13ad6d8b1e46029262556bff398796) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:07.200160 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29dc549-eb68-47b2-86e5-cd5b5d76b525 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:07.201729 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29dc549-eb68-47b2-86e5-cd5b5d76b525 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:07.202828 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef9acd-a057-4fe5-8760-7a295fe2549d None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:07.207829 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 322/641] 10.222.0.62 () {56 vars in 1374 bytes} [Fri May 27 16:09:07 2022] GET /identity/v3/role_assignments?user.id=cb13ad6d8b1e46029262556bff398796&scope.project.id=d48d95a12587479ca5714f6ebd60dd9f&role.id=1d9076bd231c43809cb971b6360e0c28 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:07.208615 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29dc549-eb68-47b2-86e5-cd5b5d76b525 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:07.250617 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd325826-046f-4442-bc84-cd0398e33eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:07.251439 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd325826-046f-4442-bc84-cd0398e33eb8 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:07.251729 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd325826-046f-4442-bc84-cd0398e33eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:07.252012 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd325826-046f-4442-bc84-cd0398e33eb8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:07.264105 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd325826-046f-4442-bc84-cd0398e33eb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:09:07.272239 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-cd325826-046f-4442-bc84-cd0398e33eb8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 16:09:07.272239 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:07.272239 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:07.272239 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:07.272239 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:07.272239 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:07.272239 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:07.272239 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:07.272239 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:07.272239 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:07.272239 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:07.272239 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:07.272239 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:09:07.272239 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:09:07.272239 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:09:07.272239 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:09:07.273869 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:09:07.273869 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:09:07.273869 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:09:07.273869 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:09:07.273869 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:07.273869 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:07.273869 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:07.273869 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:07.273869 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:07.273869 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:07.273869 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:07.273869 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:09:07.273869 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:07.273869 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:07.273869 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:07.273869 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:07.274777 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:07.274777 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:07.274777 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:07.274777 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:07.274777 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:09:07.274777 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:09:07.274777 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:09:07.274777 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:09:07.274777 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:09:07.274777 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:09:07.274777 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 16:09:07.274777 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:07.274777 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 320/642] 10.222.0.62 () {56 vars in 1102 bytes} [Fri May 27 16:09:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:07.275509 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd325826-046f-4442-bc84-cd0398e33eb8 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:07.309572 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:07.327105 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29dc549-eb68-47b2-86e5-cd5b5d76b525 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:07.365369 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7460a9-826b-4ce5-bb87-75ecc1a4857c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:07.366003 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7460a9-826b-4ce5-bb87-75ecc1a4857c None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:07.366323 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7460a9-826b-4ce5-bb87-75ecc1a4857c None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:07.366612 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7460a9-826b-4ce5-bb87-75ecc1a4857c None admin] PATH_INFO: `/v3/projects` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:07.367420 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7460a9-826b-4ce5-bb87-75ecc1a4857c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:07.367737 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7460a9-826b-4ce5-bb87-75ecc1a4857c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:07.369203 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7460a9-826b-4ce5-bb87-75ecc1a4857c None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:07.382731 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 323/643] 10.222.0.62 () {56 vars in 1148 bytes} [Fri May 27 16:09:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:07.383684 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7460a9-826b-4ce5-bb87-75ecc1a4857c None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:07.402716 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd325826-046f-4442-bc84-cd0398e33eb8 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:07.441791 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:07.443934 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458b4790-3e16-4d0f-8baa-311b0e67e51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:07.447048 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b4790-3e16-4d0f-8baa-311b0e67e51f None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:07.447048 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b4790-3e16-4d0f-8baa-311b0e67e51f None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:07.447048 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b4790-3e16-4d0f-8baa-311b0e67e51f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:07.463080 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458b4790-3e16-4d0f-8baa-311b0e67e51f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:09:07.470879 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-458b4790-3e16-4d0f-8baa-311b0e67e51f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 16:09:07.470879 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:07.470879 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:07.470879 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:07.470879 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:07.470879 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:07.470879 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:07.470879 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:07.470879 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:07.470879 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:07.470879 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:07.470879 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:07.470879 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:09:07.470879 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:09:07.470879 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:09:07.470879 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:09:07.471999 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:09:07.471999 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:09:07.471999 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:09:07.471999 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:09:07.471999 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:07.471999 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:07.471999 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:07.471999 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:07.471999 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:07.471999 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:07.471999 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:07.471999 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:09:07.471999 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:07.471999 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:07.471999 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:07.471999 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:07.473096 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:07.473096 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:07.473096 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:07.473096 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:07.473096 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:09:07.473096 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:09:07.473096 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:09:07.473096 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:09:07.473096 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:09:07.473096 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:09:07.473096 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 16:09:07.473096 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:07.473096 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 321/644] 10.222.0.62 () {56 vars in 1102 bytes} [Fri May 27 16:09:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:07.473096 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458b4790-3e16-4d0f-8baa-311b0e67e51f None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:07.503711 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7460a9-826b-4ce5-bb87-75ecc1a4857c None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:07.541311 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0cfb34-5a7f-4bdc-8b70-66299c8d6bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:07.542326 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0cfb34-5a7f-4bdc-8b70-66299c8d6bba None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:07.542789 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0cfb34-5a7f-4bdc-8b70-66299c8d6bba None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:07.543347 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0cfb34-5a7f-4bdc-8b70-66299c8d6bba None admin] PATH_INFO: `/v3/domains` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:07.544364 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0cfb34-5a7f-4bdc-8b70-66299c8d6bba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:07.544674 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0cfb34-5a7f-4bdc-8b70-66299c8d6bba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:07.546142 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0cfb34-5a7f-4bdc-8b70-66299c8d6bba None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:07.559943 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 324/645] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 16:09:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:07.560755 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0cfb34-5a7f-4bdc-8b70-66299c8d6bba None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:07.568494 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:07.581658 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458b4790-3e16-4d0f-8baa-311b0e67e51f None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:07.617044 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ba2e51-b5b4-4617-8594-75a24c0cbad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:07.617646 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ba2e51-b5b4-4617-8594-75a24c0cbad1 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:07.617936 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ba2e51-b5b4-4617-8594-75a24c0cbad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:07.618219 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ba2e51-b5b4-4617-8594-75a24c0cbad1 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:07.619006 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ba2e51-b5b4-4617-8594-75a24c0cbad1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:07.619320 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ba2e51-b5b4-4617-8594-75a24c0cbad1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:07.620695 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ba2e51-b5b4-4617-8594-75a24c0cbad1 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:07.628765 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 322/646] 10.222.0.62 () {56 vars in 1103 bytes} [Fri May 27 16:09:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:07.629561 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ba2e51-b5b4-4617-8594-75a24c0cbad1 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:07.677218 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0cfb34-5a7f-4bdc-8b70-66299c8d6bba None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:07.688988 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:07.715570 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a11a52-d2e1-4790-9d2a-66de8baac14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:07.716467 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a11a52-d2e1-4790-9d2a-66de8baac14f None admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:07.716756 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a11a52-d2e1-4790-9d2a-66de8baac14f None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:07.717036 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a11a52-d2e1-4790-9d2a-66de8baac14f None admin] PATH_INFO: `/v3/projects/d48d95a12587479ca5714f6ebd60dd9f/users/e8e6ec55445045fcac5623b9b6ffa9ab/roles/1d9076bd231c43809cb971b6360e0c28` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:07.732047 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a11a52-d2e1-4790-9d2a-66de8baac14f None admin] RBAC: Authorizing `identity:create_grant(project_id=d48d95a12587479ca5714f6ebd60dd9f, user_id=e8e6ec55445045fcac5623b9b6ffa9ab, role_id=1d9076bd231c43809cb971b6360e0c28)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:07.733488 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a11a52-d2e1-4790-9d2a-66de8baac14f None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:07.734119 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ba2e51-b5b4-4617-8594-75a24c0cbad1 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:07.768421 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad55d9d-73a4-4bb3-bd3c-d35c8d784594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:07.769086 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad55d9d-73a4-4bb3-bd3c-d35c8d784594 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:07.769366 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad55d9d-73a4-4bb3-bd3c-d35c8d784594 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:07.769640 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad55d9d-73a4-4bb3-bd3c-d35c8d784594 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:07.770402 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad55d9d-73a4-4bb3-bd3c-d35c8d784594 None admin] RBAC: Adding query filter params (name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:07.770707 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad55d9d-73a4-4bb3-bd3c-d35c8d784594 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:07.773028 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad55d9d-73a4-4bb3-bd3c-d35c8d784594 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:07.780565 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 323/647] 10.222.0.62 () {56 vars in 1103 bytes} [Fri May 27 16:09:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:07.781336 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad55d9d-73a4-4bb3-bd3c-d35c8d784594 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:07.794764 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 325/648] 10.222.0.62 () {58 vars in 1439 bytes} [Fri May 27 16:09:07 2022] PUT /identity/v3/projects/d48d95a12587479ca5714f6ebd60dd9f/users/e8e6ec55445045fcac5623b9b6ffa9ab/roles/1d9076bd231c43809cb971b6360e0c28 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:09:07.795895 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a11a52-d2e1-4790-9d2a-66de8baac14f None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:07.806590 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:07.926160 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a11a52-d2e1-4790-9d2a-66de8baac14f None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:07.938691 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad55d9d-73a4-4bb3-bd3c-d35c8d784594 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:07.968981 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39997f1b-2169-499a-ad0c-c17be68fd520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:07.969791 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39997f1b-2169-499a-ad0c-c17be68fd520 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:07.970074 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39997f1b-2169-499a-ad0c-c17be68fd520 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:07.970395 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39997f1b-2169-499a-ad0c-c17be68fd520 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:07.983516 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39997f1b-2169-499a-ad0c-c17be68fd520 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:07.984996 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39997f1b-2169-499a-ad0c-c17be68fd520 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:07.996824 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7db87e-4104-45df-ad63-c7543e76bbba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:07.997393 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7db87e-4104-45df-ad63-c7543e76bbba None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:07.997682 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7db87e-4104-45df-ad63-c7543e76bbba None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:07.997974 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7db87e-4104-45df-ad63-c7543e76bbba None admin] PATH_INFO: `/v3/users/glance` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:08.007503 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-39997f1b-2169-499a-ad0c-c17be68fd520 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:08.007503 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:08.007503 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:08.007503 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:08.007503 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:08.007503 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:08.007503 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:08.007503 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:08.007503 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:08.007503 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:08.007503 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:08.007503 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:08.007503 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:09:08.007503 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:09:08.007503 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:09:08.008689 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:09:08.008689 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:08.008689 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:08.008689 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:08.008689 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:08.008689 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:08.008689 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:08.008689 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:08.008689 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:09:08.008689 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:08.008689 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:08.008689 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:08.008689 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:08.008689 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:08.008689 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:08.008689 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:08.008689 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:08.009656 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:09:08.009656 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:09:08.009656 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:08.009656 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:08.009932 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7db87e-4104-45df-ad63-c7543e76bbba None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:08.009932 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7db87e-4104-45df-ad63-c7543e76bbba None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:08.011700 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 326/649] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:09:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:08.012645 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39997f1b-2169-499a-ad0c-c17be68fd520 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:08.024989 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-ad7db87e-4104-45df-ad63-c7543e76bbba None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 27 16:09:08.024989 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:08.024989 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:08.024989 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:08.024989 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:08.024989 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:08.024989 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:08.024989 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:08.024989 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:08.024989 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:08.024989 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:08.024989 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:08.024989 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 16:09:08.024989 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 16:09:08.024989 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 16:09:08.024989 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 16:09:08.025984 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:08.025984 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:08.025984 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 16:09:08.025984 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:09:08.025984 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 16:09:08.025984 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:09:08.025984 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:08.025984 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:08.025984 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:08.025984 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:08.025984 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:08.025984 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:09:08.025984 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:08.025984 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:08.025984 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:08.025984 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:08.025984 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:08.025984 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:08.027004 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:08.027004 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:08.027004 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 16:09:08.027004 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 16:09:08.027004 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 16:09:08.027004 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 16:09:08.027004 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 16:09:08.027004 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 16:09:08.027004 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 27 16:09:08.027004 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:08.027004 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 324/650] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 16:09:07 2022] GET /identity/v3/users/glance => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:08.027703 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7db87e-4104-45df-ad63-c7543e76bbba None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:08.035080 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:08.101497 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:08.140007 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39997f1b-2169-499a-ad0c-c17be68fd520 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:08.149005 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7db87e-4104-45df-ad63-c7543e76bbba None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:08.186442 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7ffc4f-1a59-416a-8323-579abe2d61cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:08.187548 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7ffc4f-1a59-416a-8323-579abe2d61cf None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:08.188008 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7ffc4f-1a59-416a-8323-579abe2d61cf None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:08.188475 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7ffc4f-1a59-416a-8323-579abe2d61cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:08.195907 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a418b5-3c5c-4dca-a1cc-909b576159fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:08.197135 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a418b5-3c5c-4dca-a1cc-909b576159fd None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:08.197430 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a418b5-3c5c-4dca-a1cc-909b576159fd None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:08.197718 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a418b5-3c5c-4dca-a1cc-909b576159fd None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:08.198737 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a418b5-3c5c-4dca-a1cc-909b576159fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:08.199306 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a418b5-3c5c-4dca-a1cc-909b576159fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:08.201823 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7ffc4f-1a59-416a-8323-579abe2d61cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:08.202532 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a418b5-3c5c-4dca-a1cc-909b576159fd None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:08.204068 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7ffc4f-1a59-416a-8323-579abe2d61cf None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:08.222468 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-1e7ffc4f-1a59-416a-8323-579abe2d61cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:08.222468 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:08.222468 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:08.222468 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:08.222468 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:08.222468 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:08.222468 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:08.222468 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:08.222468 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:08.222468 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:08.222468 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:08.222468 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:08.222468 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:09:08.222468 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:09:08.222468 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:09:08.223853 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:09:08.223853 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:08.223853 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:08.223853 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:08.223853 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:08.223853 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:08.223853 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:08.223853 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:08.223853 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:09:08.223853 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:08.223853 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:08.223853 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:08.223853 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:08.223853 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:08.223853 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:08.223853 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:08.223853 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:08.224950 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:09:08.224950 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:09:08.224950 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:08.224950 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:08.225172 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 325/651] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 16:09:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:08.225172 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a418b5-3c5c-4dca-a1cc-909b576159fd None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:08.229708 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 327/652] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:09:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:08.230656 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7ffc4f-1a59-416a-8323-579abe2d61cf None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:08.297519 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:08.339450 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7ffc4f-1a59-416a-8323-579abe2d61cf None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:08.366495 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a418b5-3c5c-4dca-a1cc-909b576159fd None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:08.376798 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbff058c-1d71-4f98-865f-92d8debb3834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:08.377707 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbff058c-1d71-4f98-865f-92d8debb3834 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:08.378051 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbff058c-1d71-4f98-865f-92d8debb3834 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:08.378431 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbff058c-1d71-4f98-865f-92d8debb3834 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:08.386606 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbff058c-1d71-4f98-865f-92d8debb3834 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:08.388201 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbff058c-1d71-4f98-865f-92d8debb3834 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:08.404272 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:08.405464 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-bbff058c-1d71-4f98-865f-92d8debb3834 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 27 16:09:08.405464 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:08.405464 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:08.405464 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:08.405464 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:08.405464 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:08.405464 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:08.405464 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:08.405464 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:08.405464 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:08.405464 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:08.405464 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:08.405464 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 16:09:08.405464 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 16:09:08.405464 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 16:09:08.405464 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 16:09:08.406608 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:08.406608 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:08.406608 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 16:09:08.406608 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:09:08.406608 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 16:09:08.406608 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:09:08.406608 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:08.406608 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:08.406608 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:08.406608 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:08.406608 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:08.406608 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:09:08.406608 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:08.406608 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:08.406608 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:08.406608 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:08.406608 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:08.406608 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:08.407808 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:08.407808 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:08.407808 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 16:09:08.407808 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 16:09:08.407808 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 16:09:08.407808 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 16:09:08.407808 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 16:09:08.407808 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 16:09:08.407808 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 27 16:09:08.407808 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:08.408734 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 328/653] 10.222.0.62 () {56 vars in 1102 bytes} [Fri May 27 16:09:08 2022] GET /identity/v3/users/neutron => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:08.409588 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbff058c-1d71-4f98-865f-92d8debb3834 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:08.414614 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc4cb83-c228-44da-ba33-76195d5f518b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:08.415549 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc4cb83-c228-44da-ba33-76195d5f518b None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:08.417830 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc4cb83-c228-44da-ba33-76195d5f518b None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:08.417830 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc4cb83-c228-44da-ba33-76195d5f518b None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:08.417830 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc4cb83-c228-44da-ba33-76195d5f518b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:08.417830 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc4cb83-c228-44da-ba33-76195d5f518b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:08.420013 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc4cb83-c228-44da-ba33-76195d5f518b None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:08.446345 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 326/654] 10.222.0.62 () {56 vars in 1137 bytes} [Fri May 27 16:09:08 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:08.448558 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc4cb83-c228-44da-ba33-76195d5f518b None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:08.525066 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbff058c-1d71-4f98-865f-92d8debb3834 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:08.551991 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:08.560202 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc4cb83-c228-44da-ba33-76195d5f518b None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:08.566587 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab8763-0f66-4eff-8c24-86f7a78e3a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:08.567559 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab8763-0f66-4eff-8c24-86f7a78e3a7d None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:08.568015 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab8763-0f66-4eff-8c24-86f7a78e3a7d None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:08.575559 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab8763-0f66-4eff-8c24-86f7a78e3a7d None admin] PATH_INFO: `/v3/domains` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:08.575559 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ab8763-0f66-4eff-8c24-86f7a78e3a7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:08.575559 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ab8763-0f66-4eff-8c24-86f7a78e3a7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:08.575559 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ab8763-0f66-4eff-8c24-86f7a78e3a7d None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:08.585089 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 329/655] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 16:09:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:08.586151 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab8763-0f66-4eff-8c24-86f7a78e3a7d None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:08.602144 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aae1b0a-9b9c-4377-bbc0-7cae584e3e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:08.603316 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae1b0a-9b9c-4377-bbc0-7cae584e3e43 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:08.603816 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae1b0a-9b9c-4377-bbc0-7cae584e3e43 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:08.604335 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae1b0a-9b9c-4377-bbc0-7cae584e3e43 None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:08.605275 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aae1b0a-9b9c-4377-bbc0-7cae584e3e43 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:08.605872 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aae1b0a-9b9c-4377-bbc0-7cae584e3e43 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:08.607172 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aae1b0a-9b9c-4377-bbc0-7cae584e3e43 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:08.630501 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 327/656] 10.222.0.62 () {56 vars in 1139 bytes} [Fri May 27 16:09:08 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:08.631435 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aae1b0a-9b9c-4377-bbc0-7cae584e3e43 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:08.684657 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:08.702804 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab8763-0f66-4eff-8c24-86f7a78e3a7d None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:08.736721 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aae1b0a-9b9c-4377-bbc0-7cae584e3e43 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:08.741861 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3323e342-7e63-45a1-be9f-d5b4b3e8b4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:08.742814 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323e342-7e63-45a1-be9f-d5b4b3e8b4dc None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:08.743307 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323e342-7e63-45a1-be9f-d5b4b3e8b4dc None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:08.743814 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323e342-7e63-45a1-be9f-d5b4b3e8b4dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:08.772728 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d993e5dd-552e-46a9-a86f-d1e61fa03f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:08.773527 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d993e5dd-552e-46a9-a86f-d1e61fa03f05 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:08.773813 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d993e5dd-552e-46a9-a86f-d1e61fa03f05 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:08.774099 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d993e5dd-552e-46a9-a86f-d1e61fa03f05 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:08.781280 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d993e5dd-552e-46a9-a86f-d1e61fa03f05 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:08.782765 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d993e5dd-552e-46a9-a86f-d1e61fa03f05 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:08.797763 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-d993e5dd-552e-46a9-a86f-d1e61fa03f05 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 27 16:09:08.797763 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:08.797763 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:08.797763 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:08.797763 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:08.797763 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:08.797763 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:08.797763 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:08.797763 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:08.797763 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:08.797763 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:08.797763 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:08.797763 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 16:09:08.797763 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 16:09:08.797763 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 16:09:08.797763 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 16:09:08.798767 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:08.798767 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:08.798767 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 16:09:08.798767 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:09:08.798767 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 16:09:08.798767 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:09:08.798767 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:08.798767 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:08.798767 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:08.798767 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:08.798767 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:08.798767 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:09:08.798767 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:08.798767 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:08.798767 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:08.798767 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:08.798767 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:08.798767 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:08.799751 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:08.799751 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:08.799751 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 16:09:08.799751 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 16:09:08.799751 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 16:09:08.799751 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 16:09:08.799751 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 16:09:08.799751 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 16:09:08.799751 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 27 16:09:08.799751 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:08.799751 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 328/657] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 16:09:08 2022] GET /identity/v3/users/cinder => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:08.800362 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d993e5dd-552e-46a9-a86f-d1e61fa03f05 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:08.806745 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:08.825232 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3323e342-7e63-45a1-be9f-d5b4b3e8b4dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:08.827239 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3323e342-7e63-45a1-be9f-d5b4b3e8b4dc None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:08.904310 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d993e5dd-552e-46a9-a86f-d1e61fa03f05 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:08.913948 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:08.941936 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008c9b1e-ced1-4cf3-bda1-9d63b7a9c50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:08.943167 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c9b1e-ced1-4cf3-bda1-9d63b7a9c50b None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:08.943832 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c9b1e-ced1-4cf3-bda1-9d63b7a9c50b None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:08.944980 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c9b1e-ced1-4cf3-bda1-9d63b7a9c50b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:08.946752 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 330/658] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 16:09:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 16:09:08.947843 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3323e342-7e63-45a1-be9f-d5b4b3e8b4dc None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:09.032959 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008c9b1e-ced1-4cf3-bda1-9d63b7a9c50b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:09.033420 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008c9b1e-ced1-4cf3-bda1-9d63b7a9c50b None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:09.058329 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:09.076881 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3323e342-7e63-45a1-be9f-d5b4b3e8b4dc None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:09.115388 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3803bc3f-c98b-45c4-abb5-6a432286cf99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:09.117031 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803bc3f-c98b-45c4-abb5-6a432286cf99 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:09.117525 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803bc3f-c98b-45c4-abb5-6a432286cf99 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:09.118003 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803bc3f-c98b-45c4-abb5-6a432286cf99 None admin] PATH_INFO: `/v3/users` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:09.119143 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3803bc3f-c98b-45c4-abb5-6a432286cf99 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:09.119696 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3803bc3f-c98b-45c4-abb5-6a432286cf99 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:09.121417 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3803bc3f-c98b-45c4-abb5-6a432286cf99 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:09.142223 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 331/659] 10.222.0.62 () {56 vars in 1137 bytes} [Fri May 27 16:09:08 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:09.143459 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3803bc3f-c98b-45c4-abb5-6a432286cf99 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:09.147501 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 329/660] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 16:09:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 16:09:09.149288 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008c9b1e-ced1-4cf3-bda1-9d63b7a9c50b None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:09.163735 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:09.263132 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008c9b1e-ced1-4cf3-bda1-9d63b7a9c50b None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:09.285775 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3803bc3f-c98b-45c4-abb5-6a432286cf99 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:09.299009 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2bbe56-3de4-4d33-a8ea-46eff446fd55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:09.299806 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2bbe56-3de4-4d33-a8ea-46eff446fd55 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:09.300016 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2bbe56-3de4-4d33-a8ea-46eff446fd55 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:09.300252 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2bbe56-3de4-4d33-a8ea-46eff446fd55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:09.336053 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599cdc8b-cc9b-43b5-998d-84b4170cc950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:09.336882 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599cdc8b-cc9b-43b5-998d-84b4170cc950 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:09.337172 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599cdc8b-cc9b-43b5-998d-84b4170cc950 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:09.337454 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599cdc8b-cc9b-43b5-998d-84b4170cc950 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:09.355870 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599cdc8b-cc9b-43b5-998d-84b4170cc950 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:09.358778 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599cdc8b-cc9b-43b5-998d-84b4170cc950 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:09.361816 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:09.380869 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-599cdc8b-cc9b-43b5-998d-84b4170cc950 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:09.380869 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:09.380869 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:09.380869 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:09.380869 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:09.380869 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:09.380869 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:09.380869 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:09.380869 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:09.380869 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:09.380869 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:09.380869 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:09.380869 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:09:09.380869 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:09:09.380869 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:09:09.381880 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:09:09.381880 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:09.381880 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:09.381880 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:09.381880 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:09.381880 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:09.381880 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:09.381880 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:09.381880 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:09:09.381880 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:09.381880 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:09.381880 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:09.381880 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:09.381880 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:09.381880 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:09.381880 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:09.381880 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:09.383046 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:09:09.383046 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:09:09.383046 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:09.383046 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:09.387317 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 332/661] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:09:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:09.388285 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599cdc8b-cc9b-43b5-998d-84b4170cc950 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:09.390033 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2bbe56-3de4-4d33-a8ea-46eff446fd55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:09.391987 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2bbe56-3de4-4d33-a8ea-46eff446fd55 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:09.405891 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:09.495244 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599cdc8b-cc9b-43b5-998d-84b4170cc950 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:09.525339 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 330/662] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 16:09:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 16:09:09.526428 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2bbe56-3de4-4d33-a8ea-46eff446fd55 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:09.531435 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cf6630-0e9d-49dd-bd0b-66052f2e4348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:09.532238 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf6630-0e9d-49dd-bd0b-66052f2e4348 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:09.532526 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf6630-0e9d-49dd-bd0b-66052f2e4348 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:09.532804 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf6630-0e9d-49dd-bd0b-66052f2e4348 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:09.544097 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cf6630-0e9d-49dd-bd0b-66052f2e4348 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:09.545554 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cf6630-0e9d-49dd-bd0b-66052f2e4348 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:09.564647 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-86cf6630-0e9d-49dd-bd0b-66052f2e4348 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:09.564647 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:09.564647 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:09.564647 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:09.564647 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:09.564647 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:09.564647 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:09.564647 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:09.564647 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:09.564647 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:09.564647 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:09.564647 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:09.564647 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:09:09.564647 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:09:09.564647 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:09:09.565585 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:09:09.565585 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:09.565585 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:09.565585 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:09.565585 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:09.565585 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:09.565585 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:09.565585 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:09.565585 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:09:09.565585 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:09.565585 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:09.565585 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:09.565585 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:09.565585 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:09.565585 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:09.565585 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:09.565585 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:09.571524 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:09:09.571524 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:09:09.571524 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:09.571524 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:09.571524 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 333/663] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:09:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:09.571524 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7744ec-d68d-4bcd-9613-ea850c03ff8b None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:09.571524 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7744ec-d68d-4bcd-9613-ea850c03ff8b None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:09.571524 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7744ec-d68d-4bcd-9613-ea850c03ff8b None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:09.571524 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 334/664] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:09:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:09:09.572066 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7744ec-d68d-4bcd-9613-ea850c03ff8b None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:09.620095 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:09.636888 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2bbe56-3de4-4d33-a8ea-46eff446fd55 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:09.646653 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:09.671592 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f202ff-b18b-4f96-bf8d-7942542d52ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:09.672348 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f202ff-b18b-4f96-bf8d-7942542d52ea None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:09.672536 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f202ff-b18b-4f96-bf8d-7942542d52ea None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:09.672803 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f202ff-b18b-4f96-bf8d-7942542d52ea None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:09.673519 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f202ff-b18b-4f96-bf8d-7942542d52ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:09.673822 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f202ff-b18b-4f96-bf8d-7942542d52ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:09.675225 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f202ff-b18b-4f96-bf8d-7942542d52ea None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:09.680980 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7744ec-d68d-4bcd-9613-ea850c03ff8b None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:09.689055 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 331/665] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 16:09:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:09.690085 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f202ff-b18b-4f96-bf8d-7942542d52ea None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:09.720486 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d4ad8c-ba8b-4095-9a94-0af09c339b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:09.721544 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d4ad8c-ba8b-4095-9a94-0af09c339b65 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:09.721882 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d4ad8c-ba8b-4095-9a94-0af09c339b65 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:09.722168 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d4ad8c-ba8b-4095-9a94-0af09c339b65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:09.804784 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f202ff-b18b-4f96-bf8d-7942542d52ea None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:09.846631 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80922a06-7c94-4287-a0e1-6ba00a8312b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:09.847314 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80922a06-7c94-4287-a0e1-6ba00a8312b4 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:09.847596 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80922a06-7c94-4287-a0e1-6ba00a8312b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:09.847871 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80922a06-7c94-4287-a0e1-6ba00a8312b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:09.848595 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80922a06-7c94-4287-a0e1-6ba00a8312b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:09.848903 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80922a06-7c94-4287-a0e1-6ba00a8312b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:09.850330 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80922a06-7c94-4287-a0e1-6ba00a8312b4 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:09.852905 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d4ad8c-ba8b-4095-9a94-0af09c339b65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:09.854461 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d4ad8c-ba8b-4095-9a94-0af09c339b65 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:09.865598 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 332/666] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 16:09:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:09.865598 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a6aad4-486a-4f07-b065-ebeab08363d9 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:09.865598 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a6aad4-486a-4f07-b065-ebeab08363d9 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:09.865598 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a6aad4-486a-4f07-b065-ebeab08363d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:09.878264 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-a1d4ad8c-ba8b-4095-9a94-0af09c339b65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:09.878264 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:09.878264 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:09.878264 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:09.878264 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:09.878264 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:09.878264 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:09.878264 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:09.878264 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:09.878264 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:09.878264 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:09.878264 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:09.878264 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:09:09.878264 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:09:09.878264 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:09:09.879363 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:09:09.879363 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:09.879363 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:09.879363 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:09.879363 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:09.879363 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:09.879363 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:09.879363 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:09.879363 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:09:09.879363 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:09.879363 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:09.879363 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:09.879363 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:09.879363 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:09.879363 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:09.879363 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:09.879363 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:09.880509 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:09:09.880509 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:09:09.880509 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:09.880509 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:09.881172 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 335/667] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:09:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:09.882547 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d4ad8c-ba8b-4095-9a94-0af09c339b65 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:09.883560 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-b7a6aad4-486a-4f07-b065-ebeab08363d9 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:09:09.884789 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-b7a6aad4-486a-4f07-b065-ebeab08363d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:09:09.910166 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:09.958370 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 333/668] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:09:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:09:09.958370 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a6aad4-486a-4f07-b065-ebeab08363d9 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:10.004266 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:10.011136 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d4ad8c-ba8b-4095-9a94-0af09c339b65 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:10.048681 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b22ca45-d2bf-4558-be50-2638f104f340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:10.049488 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b22ca45-d2bf-4558-be50-2638f104f340 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:10.049769 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b22ca45-d2bf-4558-be50-2638f104f340 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:10.050044 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b22ca45-d2bf-4558-be50-2638f104f340 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:10.057591 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b22ca45-d2bf-4558-be50-2638f104f340 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:10.058999 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b22ca45-d2bf-4558-be50-2638f104f340 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:10.072023 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a6aad4-486a-4f07-b065-ebeab08363d9 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:10.073597 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-2b22ca45-d2bf-4558-be50-2638f104f340 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:09:10.073597 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:10.073597 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:10.073597 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:10.073597 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:10.073597 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:10.073597 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:10.073597 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:10.073597 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:10.073597 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:10.073597 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:10.073597 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:10.073597 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 16:09:10.073597 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 16:09:10.073597 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 16:09:10.074662 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 16:09:10.074662 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:10.074662 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:10.074662 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:10.074662 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:10.074662 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:10.074662 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:10.074662 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:10.074662 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:09:10.074662 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:10.074662 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:10.074662 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:10.074662 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:10.074662 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:10.074662 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:10.074662 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:10.074662 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:10.075569 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 16:09:10.075569 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 16:09:10.075569 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 16:09:10.075569 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 16:09:10.075569 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 16:09:10.075569 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 16:09:10.075569 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:09:10.075569 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:10.075569 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 336/669] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 16:09:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:10.075569 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b22ca45-d2bf-4558-be50-2638f104f340 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:10.112221 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9832503f-fc14-43d5-b8ee-25f282a8f179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:10.113012 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832503f-fc14-43d5-b8ee-25f282a8f179 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:10.113300 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832503f-fc14-43d5-b8ee-25f282a8f179 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:10.113608 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832503f-fc14-43d5-b8ee-25f282a8f179 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:10.121554 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9832503f-fc14-43d5-b8ee-25f282a8f179 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:10.123051 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9832503f-fc14-43d5-b8ee-25f282a8f179 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:10.137126 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-9832503f-fc14-43d5-b8ee-25f282a8f179 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:09:10.137126 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:10.137126 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:10.137126 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:10.137126 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:10.137126 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:10.137126 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:10.137126 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:10.137126 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:10.137126 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:10.137126 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:10.137126 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:10.137126 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 16:09:10.137126 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 16:09:10.137126 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 16:09:10.138036 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 16:09:10.138036 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:10.138036 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:10.138036 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:10.138036 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:10.138036 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:10.138036 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:10.138036 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:10.138036 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:09:10.138036 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:10.138036 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:10.138036 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:10.138036 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:10.138036 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:10.138036 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:10.138036 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:10.138036 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:10.138993 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 16:09:10.138993 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 16:09:10.138993 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 16:09:10.138993 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 16:09:10.138993 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 16:09:10.138993 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 16:09:10.138993 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:09:10.138993 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:10.138993 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 334/670] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 16:09:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:10.139514 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9832503f-fc14-43d5-b8ee-25f282a8f179 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:10.164019 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:10.182937 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b22ca45-d2bf-4558-be50-2638f104f340 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:10.216401 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b451ca-9a38-4b88-8ba9-fc8407432fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:10.217056 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b451ca-9a38-4b88-8ba9-fc8407432fa3 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:10.217336 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b451ca-9a38-4b88-8ba9-fc8407432fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:10.217606 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b451ca-9a38-4b88-8ba9-fc8407432fa3 None admin] PATH_INFO: `/v3/domains` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:10.218346 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b451ca-9a38-4b88-8ba9-fc8407432fa3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:10.218652 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b451ca-9a38-4b88-8ba9-fc8407432fa3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:10.220000 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b451ca-9a38-4b88-8ba9-fc8407432fa3 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:10.231510 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 337/671] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 16:09:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:10.232297 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b451ca-9a38-4b88-8ba9-fc8407432fa3 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:10.245972 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9832503f-fc14-43d5-b8ee-25f282a8f179 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:10.253419 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:10.279081 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8abf11b-8f05-47e0-b462-f03edbf31fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:10.279874 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8abf11b-8f05-47e0-b462-f03edbf31fb8 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:10.280180 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8abf11b-8f05-47e0-b462-f03edbf31fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:10.280460 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8abf11b-8f05-47e0-b462-f03edbf31fb8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:10.293583 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8abf11b-8f05-47e0-b462-f03edbf31fb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:09:10.304113 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-b8abf11b-8f05-47e0-b462-f03edbf31fb8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:09:10.304113 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:10.304113 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:10.304113 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:10.304113 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:10.304113 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:10.304113 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:10.304113 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:10.304113 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:10.304113 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:10.304113 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:10.304113 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:10.304113 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:09:10.304113 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:09:10.304113 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:09:10.304113 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:09:10.305181 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:09:10.305181 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:09:10.305181 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:09:10.305181 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:09:10.305181 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:10.305181 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:10.305181 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:10.305181 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:10.305181 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:10.305181 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:10.305181 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:10.305181 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:09:10.305181 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:10.305181 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:10.305181 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:10.305181 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:10.306124 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:10.306124 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:10.306124 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:10.306124 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:10.306124 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:09:10.306124 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:09:10.306124 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:09:10.306124 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:09:10.306124 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:09:10.306124 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:09:10.306124 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:09:10.306124 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:10.310237 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 335/672] 10.222.0.62 () {56 vars in 1096 bytes} [Fri May 27 16:09:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:10.310848 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8abf11b-8f05-47e0-b462-f03edbf31fb8 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:10.336940 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b451ca-9a38-4b88-8ba9-fc8407432fa3 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:10.370829 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af874832-4554-4d83-af04-636642f312ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:10.371490 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af874832-4554-4d83-af04-636642f312ba None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:10.371773 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af874832-4554-4d83-af04-636642f312ba None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:10.372057 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af874832-4554-4d83-af04-636642f312ba None admin] PATH_INFO: `/v3/projects` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:10.372839 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af874832-4554-4d83-af04-636642f312ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:10.373153 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af874832-4554-4d83-af04-636642f312ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:10.374605 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af874832-4554-4d83-af04-636642f312ba None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:10.385910 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 338/673] 10.222.0.62 () {56 vars in 1148 bytes} [Fri May 27 16:09:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:10.387239 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266212bd-908b-4ff5-9d87-d2e16a60eb01 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:10.387538 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266212bd-908b-4ff5-9d87-d2e16a60eb01 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:10.387819 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266212bd-908b-4ff5-9d87-d2e16a60eb01 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:10.389160 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 339/674] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:09:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:09:10.389857 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266212bd-908b-4ff5-9d87-d2e16a60eb01 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:10.393043 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:10.415385 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8abf11b-8f05-47e0-b462-f03edbf31fb8 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:10.449126 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21763a99-a09a-4d9d-80a8-1d0ae23de507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:10.449913 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21763a99-a09a-4d9d-80a8-1d0ae23de507 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:10.450200 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21763a99-a09a-4d9d-80a8-1d0ae23de507 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:10.450527 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21763a99-a09a-4d9d-80a8-1d0ae23de507 None admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:10.451307 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21763a99-a09a-4d9d-80a8-1d0ae23de507 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:10.451622 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21763a99-a09a-4d9d-80a8-1d0ae23de507 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:10.453050 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21763a99-a09a-4d9d-80a8-1d0ae23de507 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:10.464769 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 336/675] 10.222.0.62 () {56 vars in 1148 bytes} [Fri May 27 16:09:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:10.465543 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21763a99-a09a-4d9d-80a8-1d0ae23de507 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:10.471247 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:10.493610 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266212bd-908b-4ff5-9d87-d2e16a60eb01 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:10.528578 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248cd040-6e38-49cd-aa67-8af40a83e7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:10.529366 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248cd040-6e38-49cd-aa67-8af40a83e7d7 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:10.529651 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248cd040-6e38-49cd-aa67-8af40a83e7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:10.529929 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248cd040-6e38-49cd-aa67-8af40a83e7d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:10.536519 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248cd040-6e38-49cd-aa67-8af40a83e7d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:10.538057 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248cd040-6e38-49cd-aa67-8af40a83e7d7 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:10.551730 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-248cd040-6e38-49cd-aa67-8af40a83e7d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:09:10.551730 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:10.551730 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:10.551730 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:10.551730 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:10.551730 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:10.551730 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:10.551730 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:10.551730 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:10.551730 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:10.551730 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:10.551730 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:10.551730 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 16:09:10.551730 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 16:09:10.551730 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 16:09:10.552747 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 16:09:10.552747 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:10.552747 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:10.552747 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:10.552747 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:10.552747 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:10.552747 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:10.552747 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:10.552747 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:09:10.552747 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:10.552747 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:10.552747 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:10.552747 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:10.552747 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:10.552747 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:10.552747 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:10.552747 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:10.554304 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 16:09:10.554304 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 16:09:10.554304 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 16:09:10.554304 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 16:09:10.554304 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 16:09:10.554304 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 16:09:10.554304 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:09:10.554304 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:10.554304 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 340/676] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 16:09:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:10.554814 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248cd040-6e38-49cd-aa67-8af40a83e7d7 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:10.567710 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21763a99-a09a-4d9d-80a8-1d0ae23de507 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:10.607026 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab7576e-7dbb-4d85-adef-b32f4019fe75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:10.607695 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab7576e-7dbb-4d85-adef-b32f4019fe75 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:10.607978 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab7576e-7dbb-4d85-adef-b32f4019fe75 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:10.608254 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab7576e-7dbb-4d85-adef-b32f4019fe75 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:10.608997 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab7576e-7dbb-4d85-adef-b32f4019fe75 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:10.609304 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab7576e-7dbb-4d85-adef-b32f4019fe75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:10.610698 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab7576e-7dbb-4d85-adef-b32f4019fe75 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:10.616461 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:10.619727 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 337/677] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 16:09:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:10.621056 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73131838-636a-4447-bf40-cf0902c6be74 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:10.621462 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73131838-636a-4447-bf40-cf0902c6be74 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:10.621835 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73131838-636a-4447-bf40-cf0902c6be74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:10.638186 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-73131838-636a-4447-bf40-cf0902c6be74 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:09:10.639422 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-73131838-636a-4447-bf40-cf0902c6be74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:09:10.662268 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248cd040-6e38-49cd-aa67-8af40a83e7d7 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:10.695735 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe1bf27-9536-49f4-a6bb-f41b405ab1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:10.696414 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe1bf27-9536-49f4-a6bb-f41b405ab1ec None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:10.696703 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe1bf27-9536-49f4-a6bb-f41b405ab1ec None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:10.696981 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe1bf27-9536-49f4-a6bb-f41b405ab1ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:10.697815 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe1bf27-9536-49f4-a6bb-f41b405ab1ec None admin] RBAC: Adding query filter params (role.id=1d9076bd231c43809cb971b6360e0c28, scope.project.id=d48d95a12587479ca5714f6ebd60dd9f, user.id=2b072079733049e8ac204ebe5cc635ec) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:10.698126 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe1bf27-9536-49f4-a6bb-f41b405ab1ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:10.699609 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe1bf27-9536-49f4-a6bb-f41b405ab1ec None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:10.704863 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 338/678] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:09:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:09:10.712056 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 341/679] 10.222.0.62 () {56 vars in 1374 bytes} [Fri May 27 16:09:10 2022] GET /identity/v3/role_assignments?user.id=2b072079733049e8ac204ebe5cc635ec&scope.project.id=d48d95a12587479ca5714f6ebd60dd9f&role.id=1d9076bd231c43809cb971b6360e0c28 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:10.712281 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73131838-636a-4447-bf40-cf0902c6be74 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:10.712376 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe1bf27-9536-49f4-a6bb-f41b405ab1ec None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:10.718640 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:10.828582 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73131838-636a-4447-bf40-cf0902c6be74 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:10.831656 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe1bf27-9536-49f4-a6bb-f41b405ab1ec None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:10.865056 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:10.871577 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac6e8ab-9469-4155-be85-feeff9751b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:10.872247 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac6e8ab-9469-4155-be85-feeff9751b47 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:10.872537 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac6e8ab-9469-4155-be85-feeff9751b47 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:10.872819 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac6e8ab-9469-4155-be85-feeff9751b47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:10.873730 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac6e8ab-9469-4155-be85-feeff9751b47 None admin] RBAC: Adding query filter params (role.id=1d9076bd231c43809cb971b6360e0c28, scope.project.id=d48d95a12587479ca5714f6ebd60dd9f, user.id=b367ccea28d540a0b24ec4e42ebfef65) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:10.873982 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac6e8ab-9469-4155-be85-feeff9751b47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:10.875488 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac6e8ab-9469-4155-be85-feeff9751b47 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:10.881950 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a668931-ae8c-44d2-9d70-fd4a195400ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:10.882472 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 339/680] 10.222.0.62 () {56 vars in 1374 bytes} [Fri May 27 16:09:10 2022] GET /identity/v3/role_assignments?user.id=b367ccea28d540a0b24ec4e42ebfef65&scope.project.id=d48d95a12587479ca5714f6ebd60dd9f&role.id=1d9076bd231c43809cb971b6360e0c28 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:10.883170 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a668931-ae8c-44d2-9d70-fd4a195400ed None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:10.883291 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac6e8ab-9469-4155-be85-feeff9751b47 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:10.883779 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a668931-ae8c-44d2-9d70-fd4a195400ed None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:10.884065 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a668931-ae8c-44d2-9d70-fd4a195400ed None admin] PATH_INFO: `/v3/projects` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:10.884872 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a668931-ae8c-44d2-9d70-fd4a195400ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:10.885186 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a668931-ae8c-44d2-9d70-fd4a195400ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:10.886681 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a668931-ae8c-44d2-9d70-fd4a195400ed None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:10.913951 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 342/681] 10.222.0.62 () {56 vars in 1148 bytes} [Fri May 27 16:09:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:10.914707 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a668931-ae8c-44d2-9d70-fd4a195400ed None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:11.010092 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:11.030046 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac6e8ab-9469-4155-be85-feeff9751b47 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:11.061830 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a668931-ae8c-44d2-9d70-fd4a195400ed None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:11.079945 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcd90a6-83cb-4a62-b24a-2869fe2da8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:11.080671 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd90a6-83cb-4a62-b24a-2869fe2da8cf None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:11.080961 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd90a6-83cb-4a62-b24a-2869fe2da8cf None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:11.081251 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd90a6-83cb-4a62-b24a-2869fe2da8cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:11.093912 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcd90a6-83cb-4a62-b24a-2869fe2da8cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:11.095440 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcd90a6-83cb-4a62-b24a-2869fe2da8cf None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:11.106697 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fad76e-3f36-45fe-91e5-be5690022030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:11.107853 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fad76e-3f36-45fe-91e5-be5690022030 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:11.108334 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fad76e-3f36-45fe-91e5-be5690022030 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:11.108831 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fad76e-3f36-45fe-91e5-be5690022030 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:11.115580 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-fdcd90a6-83cb-4a62-b24a-2869fe2da8cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:11.115580 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:11.115580 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:11.115580 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:11.115580 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:11.115580 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:11.115580 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:11.115580 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:11.115580 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:11.115580 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:11.115580 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:11.115580 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:11.115580 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:09:11.115580 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:09:11.115580 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:09:11.116544 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:09:11.116544 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:11.116544 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:11.116544 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:11.116544 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:11.116544 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:11.116544 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:11.116544 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:11.116544 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:09:11.116544 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:11.116544 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:11.116544 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:11.116544 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:11.116544 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:11.116544 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:11.116544 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:11.116544 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:11.117413 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:09:11.117413 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:09:11.117413 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:11.117413 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:11.117413 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 340/682] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:09:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:11.117774 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcd90a6-83cb-4a62-b24a-2869fe2da8cf None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:11.127565 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fad76e-3f36-45fe-91e5-be5690022030 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:09:11.136582 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-d1fad76e-3f36-45fe-91e5-be5690022030 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 16:09:11.136582 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:11.136582 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:11.136582 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:11.136582 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:11.136582 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:11.136582 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:11.136582 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:11.136582 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:11.136582 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:11.136582 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:11.136582 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:11.136582 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:09:11.136582 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:09:11.136582 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:09:11.136582 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:09:11.137563 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:09:11.137563 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:09:11.137563 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:09:11.137563 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:09:11.137563 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:11.137563 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:11.137563 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:11.137563 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:11.137563 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:11.137563 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:11.137563 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:11.137563 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:09:11.137563 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:11.137563 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:11.137563 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:11.137563 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:11.138473 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:11.138473 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:11.138473 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:11.138473 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:11.138473 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:09:11.138473 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:09:11.138473 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:09:11.138473 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:09:11.138473 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:09:11.138473 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:09:11.138473 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 16:09:11.138473 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:11.143845 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 343/683] 10.222.0.62 () {56 vars in 1102 bytes} [Fri May 27 16:09:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:11.144298 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fad76e-3f36-45fe-91e5-be5690022030 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:11.176871 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:11.243540 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcd90a6-83cb-4a62-b24a-2869fe2da8cf None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:11.270869 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fad76e-3f36-45fe-91e5-be5690022030 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:11.279900 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d40dff8-5bf1-4afd-a079-695f44c1c16a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:11.280641 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40dff8-5bf1-4afd-a079-695f44c1c16a None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:11.280993 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40dff8-5bf1-4afd-a079-695f44c1c16a None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:11.281337 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40dff8-5bf1-4afd-a079-695f44c1c16a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:11.282228 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d40dff8-5bf1-4afd-a079-695f44c1c16a None admin] RBAC: Adding query filter params (role.id=1d9076bd231c43809cb971b6360e0c28, scope.project.id=d48d95a12587479ca5714f6ebd60dd9f, user.id=d8693a1e72f14fdfb383f11e96330726) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:11.282950 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d40dff8-5bf1-4afd-a079-695f44c1c16a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:11.284525 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d40dff8-5bf1-4afd-a079-695f44c1c16a None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:11.298390 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 341/684] 10.222.0.62 () {56 vars in 1374 bytes} [Fri May 27 16:09:11 2022] GET /identity/v3/role_assignments?user.id=d8693a1e72f14fdfb383f11e96330726&scope.project.id=d48d95a12587479ca5714f6ebd60dd9f&role.id=1d9076bd231c43809cb971b6360e0c28 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:11.299498 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d40dff8-5bf1-4afd-a079-695f44c1c16a None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:11.309152 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:11.313050 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5134581-8569-4064-84d4-5670b84b6953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:11.314097 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5134581-8569-4064-84d4-5670b84b6953 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:11.314682 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5134581-8569-4064-84d4-5670b84b6953 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:11.315134 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5134581-8569-4064-84d4-5670b84b6953 None admin] PATH_INFO: `/v3/domains` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:11.327159 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5134581-8569-4064-84d4-5670b84b6953 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:11.327159 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5134581-8569-4064-84d4-5670b84b6953 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:11.327159 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5134581-8569-4064-84d4-5670b84b6953 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:11.336146 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 344/685] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 16:09:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:11.351381 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5134581-8569-4064-84d4-5670b84b6953 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:11.448949 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d40dff8-5bf1-4afd-a079-695f44c1c16a None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:11.470879 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:11.522860 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6754fc54-37e6-4b26-9445-b48941916fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:11.523558 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754fc54-37e6-4b26-9445-b48941916fb7 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:11.523841 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754fc54-37e6-4b26-9445-b48941916fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:11.524112 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754fc54-37e6-4b26-9445-b48941916fb7 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:11.524867 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6754fc54-37e6-4b26-9445-b48941916fb7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:11.525178 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6754fc54-37e6-4b26-9445-b48941916fb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:11.526601 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6754fc54-37e6-4b26-9445-b48941916fb7 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:11.546766 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 342/686] 10.222.0.62 () {56 vars in 1103 bytes} [Fri May 27 16:09:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:11.554865 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5134581-8569-4064-84d4-5670b84b6953 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:11.557876 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6754fc54-37e6-4b26-9445-b48941916fb7 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:11.595961 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c485e84a-27d6-4c7c-8a9a-f6457da22bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:11.597401 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485e84a-27d6-4c7c-8a9a-f6457da22bb0 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:11.597945 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485e84a-27d6-4c7c-8a9a-f6457da22bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:11.598470 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485e84a-27d6-4c7c-8a9a-f6457da22bb0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:11.608613 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c485e84a-27d6-4c7c-8a9a-f6457da22bb0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:11.610807 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c485e84a-27d6-4c7c-8a9a-f6457da22bb0 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:11.629687 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-c485e84a-27d6-4c7c-8a9a-f6457da22bb0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 16:09:11.629687 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:11.629687 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:11.629687 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:11.629687 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:11.629687 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:11.629687 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:11.629687 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:11.629687 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:11.629687 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:11.629687 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:11.629687 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:11.629687 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 16:09:11.629687 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 16:09:11.629687 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 16:09:11.629687 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 16:09:11.630730 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:11.630730 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:11.630730 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 16:09:11.630730 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:09:11.630730 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 16:09:11.630730 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:09:11.630730 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:11.630730 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:11.630730 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:11.630730 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:11.630730 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:11.630730 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:09:11.630730 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:11.630730 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:11.630730 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:11.630730 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:11.630730 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:11.630730 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:11.632233 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:11.632233 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:11.632233 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 16:09:11.632233 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 16:09:11.632233 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 16:09:11.632233 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 16:09:11.632233 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 16:09:11.632233 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 16:09:11.632233 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 16:09:11.632233 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:11.635116 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 345/687] 10.222.0.62 () {56 vars in 1093 bytes} [Fri May 27 16:09:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:09:11.643181 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c485e84a-27d6-4c7c-8a9a-f6457da22bb0 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:11.672038 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6754fc54-37e6-4b26-9445-b48941916fb7 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:11.690696 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:11.708463 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d0ed1e-80b8-4d5a-8f29-dc38b3341afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:11.709270 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0ed1e-80b8-4d5a-8f29-dc38b3341afd None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:11.710417 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0ed1e-80b8-4d5a-8f29-dc38b3341afd None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:11.710417 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0ed1e-80b8-4d5a-8f29-dc38b3341afd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:11.721418 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d0ed1e-80b8-4d5a-8f29-dc38b3341afd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:11.723238 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d0ed1e-80b8-4d5a-8f29-dc38b3341afd None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:11.741974 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-d5d0ed1e-80b8-4d5a-8f29-dc38b3341afd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:11.741974 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:11.741974 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:11.741974 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:11.741974 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:11.741974 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:11.741974 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:11.741974 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:11.741974 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:11.741974 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:11.741974 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:11.741974 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:11.741974 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:09:11.741974 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:09:11.741974 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:09:11.742953 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:09:11.742953 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:11.742953 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:11.742953 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:11.742953 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:11.742953 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:11.742953 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:11.742953 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:11.742953 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:09:11.742953 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:11.742953 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:11.742953 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:11.742953 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:11.742953 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:11.742953 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:11.742953 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:11.742953 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:11.743833 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:09:11.743833 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:09:11.743833 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:11.743833 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:11.748857 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 343/688] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:09:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:11.749778 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d0ed1e-80b8-4d5a-8f29-dc38b3341afd None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:11.759196 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c485e84a-27d6-4c7c-8a9a-f6457da22bb0 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:11.777206 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:11.797391 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91883cb6-d582-4aeb-85eb-7d79337f472f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:11.798453 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91883cb6-d582-4aeb-85eb-7d79337f472f None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:11.799008 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91883cb6-d582-4aeb-85eb-7d79337f472f None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:11.799504 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91883cb6-d582-4aeb-85eb-7d79337f472f None admin] PATH_INFO: `/v3/users` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:11.800615 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91883cb6-d582-4aeb-85eb-7d79337f472f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:11.801420 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91883cb6-d582-4aeb-85eb-7d79337f472f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:11.803246 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91883cb6-d582-4aeb-85eb-7d79337f472f None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:11.824553 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 346/689] 10.222.0.62 () {56 vars in 1133 bytes} [Fri May 27 16:09:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:11.831085 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91883cb6-d582-4aeb-85eb-7d79337f472f None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:11.876081 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d0ed1e-80b8-4d5a-8f29-dc38b3341afd None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:11.955787 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae658a-253f-42e6-ac8b-0a56cd89657f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:11.956454 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae658a-253f-42e6-ac8b-0a56cd89657f None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:11.956739 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae658a-253f-42e6-ac8b-0a56cd89657f None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:11.957066 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae658a-253f-42e6-ac8b-0a56cd89657f None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:11.957816 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ae658a-253f-42e6-ac8b-0a56cd89657f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:11.958125 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ae658a-253f-42e6-ac8b-0a56cd89657f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:11.959664 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ae658a-253f-42e6-ac8b-0a56cd89657f None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:11.963535 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:11.966993 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91883cb6-d582-4aeb-85eb-7d79337f472f None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:11.983709 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 344/690] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 16:09:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:11.988962 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae658a-253f-42e6-ac8b-0a56cd89657f None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:12.012899 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3106bcd6-2a1f-404b-a58f-d5d170937987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:12.014010 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3106bcd6-2a1f-404b-a58f-d5d170937987 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:12.017014 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3106bcd6-2a1f-404b-a58f-d5d170937987 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:12.017616 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3106bcd6-2a1f-404b-a58f-d5d170937987 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:12.091821 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3106bcd6-2a1f-404b-a58f-d5d170937987 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:12.093614 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3106bcd6-2a1f-404b-a58f-d5d170937987 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:12.124009 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:12.146020 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae658a-253f-42e6-ac8b-0a56cd89657f None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:12.204181 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:12.208682 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 347/691] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 16:09:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 27 16:09:12.213096 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac866ee-502b-4f73-a7bc-5e86c8c5b6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:12.214168 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3106bcd6-2a1f-404b-a58f-d5d170937987 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:12.214676 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac866ee-502b-4f73-a7bc-5e86c8c5b6a5 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:12.215301 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac866ee-502b-4f73-a7bc-5e86c8c5b6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:12.215766 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac866ee-502b-4f73-a7bc-5e86c8c5b6a5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:12.233709 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac866ee-502b-4f73-a7bc-5e86c8c5b6a5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:12.235494 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac866ee-502b-4f73-a7bc-5e86c8c5b6a5 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:12.264631 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-5ac866ee-502b-4f73-a7bc-5e86c8c5b6a5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 27 16:09:12.264631 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:12.264631 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:12.264631 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:12.264631 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:12.264631 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:12.264631 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:12.264631 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:12.264631 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:12.264631 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:12.264631 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:12.264631 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:12.264631 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 16:09:12.264631 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 16:09:12.264631 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 16:09:12.264631 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 16:09:12.265753 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:12.265753 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:12.265753 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 16:09:12.265753 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:09:12.265753 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 16:09:12.265753 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:09:12.265753 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:12.265753 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:12.265753 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:12.265753 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:12.265753 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:12.265753 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:09:12.265753 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:12.265753 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:12.265753 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:12.265753 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:12.265753 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:12.265753 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:12.270273 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:12.270273 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:12.270273 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 16:09:12.270273 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 16:09:12.270273 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 16:09:12.270273 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 16:09:12.270273 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 16:09:12.270273 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 16:09:12.270273 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 27 16:09:12.270273 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:12.273488 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 345/692] 10.222.0.62 () {56 vars in 1096 bytes} [Fri May 27 16:09:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:09:12.280892 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac866ee-502b-4f73-a7bc-5e86c8c5b6a5 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:12.398114 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac866ee-502b-4f73-a7bc-5e86c8c5b6a5 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:12.464510 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea39591-c3e0-4f14-8930-8b44a1986131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:12.465181 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea39591-c3e0-4f14-8930-8b44a1986131 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:12.465464 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea39591-c3e0-4f14-8930-8b44a1986131 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:12.465738 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea39591-c3e0-4f14-8930-8b44a1986131 None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:12.466612 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea39591-c3e0-4f14-8930-8b44a1986131 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:12.466921 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea39591-c3e0-4f14-8930-8b44a1986131 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:12.468347 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea39591-c3e0-4f14-8930-8b44a1986131 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:12.473011 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3106bcd6-2a1f-404b-a58f-d5d170937987 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:12.486232 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 346/693] 10.222.0.62 () {56 vars in 1135 bytes} [Fri May 27 16:09:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:12.491658 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea39591-c3e0-4f14-8930-8b44a1986131 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:12.510629 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:12.554612 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca51fda-facf-4b94-85cf-842e9bd13d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:12.555408 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca51fda-facf-4b94-85cf-842e9bd13d11 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:12.555690 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca51fda-facf-4b94-85cf-842e9bd13d11 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:12.555968 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca51fda-facf-4b94-85cf-842e9bd13d11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:12.583329 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca51fda-facf-4b94-85cf-842e9bd13d11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:12.585351 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca51fda-facf-4b94-85cf-842e9bd13d11 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:12.594645 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea39591-c3e0-4f14-8930-8b44a1986131 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:12.626750 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-6ca51fda-facf-4b94-85cf-842e9bd13d11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:12.626750 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:12.626750 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:12.626750 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:12.626750 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:12.626750 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:12.626750 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:12.626750 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:12.626750 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:12.626750 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:12.626750 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:12.626750 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:12.626750 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:09:12.626750 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:09:12.626750 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:09:12.627718 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:09:12.627718 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:12.627718 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:12.627718 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:12.627718 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:12.627718 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:12.627718 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:12.627718 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:12.627718 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:09:12.627718 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:12.627718 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:12.627718 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:12.627718 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:12.627718 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:12.627718 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:12.627718 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:12.627718 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:12.628918 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:09:12.628918 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:09:12.628918 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:12.628918 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:12.628918 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 348/694] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:09:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 415 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:12.635132 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca51fda-facf-4b94-85cf-842e9bd13d11 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:12.636082 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ba816e-5b61-4d38-9d18-b5a3ad273b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:12.636801 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba816e-5b61-4d38-9d18-b5a3ad273b98 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:12.637152 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba816e-5b61-4d38-9d18-b5a3ad273b98 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:12.637496 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba816e-5b61-4d38-9d18-b5a3ad273b98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:12.743627 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:12.744938 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ba816e-5b61-4d38-9d18-b5a3ad273b98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:12.746504 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ba816e-5b61-4d38-9d18-b5a3ad273b98 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:12.750040 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:12.841683 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca51fda-facf-4b94-85cf-842e9bd13d11 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:12.917116 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5237a1f9-711f-4681-b93a-fafc8a0fd8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:12.917782 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5237a1f9-711f-4681-b93a-fafc8a0fd8ce None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:12.918062 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5237a1f9-711f-4681-b93a-fafc8a0fd8ce None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:12.918355 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5237a1f9-711f-4681-b93a-fafc8a0fd8ce None admin] PATH_INFO: `/v3/domains` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:12.919077 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5237a1f9-711f-4681-b93a-fafc8a0fd8ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:12.919380 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5237a1f9-711f-4681-b93a-fafc8a0fd8ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:12.920747 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5237a1f9-711f-4681-b93a-fafc8a0fd8ce None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:12.945232 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 349/696] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 16:09:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:12.946321 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 347/696] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 16:09:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 16:09:12.950583 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5237a1f9-711f-4681-b93a-fafc8a0fd8ce None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:12.950715 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ba816e-5b61-4d38-9d18-b5a3ad273b98 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:13.061564 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5237a1f9-711f-4681-b93a-fafc8a0fd8ce None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:13.082024 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:13.111445 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fd85c2-40e6-47a6-b3c6-c659933d041a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:13.111445 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd85c2-40e6-47a6-b3c6-c659933d041a None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:13.111445 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd85c2-40e6-47a6-b3c6-c659933d041a None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:13.111445 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd85c2-40e6-47a6-b3c6-c659933d041a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:13.120936 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fd85c2-40e6-47a6-b3c6-c659933d041a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:13.122412 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fd85c2-40e6-47a6-b3c6-c659933d041a None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:13.140678 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-16fd85c2-40e6-47a6-b3c6-c659933d041a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:13.140678 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:13.140678 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:13.140678 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:13.140678 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:13.140678 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:13.140678 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:13.140678 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:13.140678 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:13.140678 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:13.140678 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:13.140678 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:13.140678 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:09:13.140678 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:09:13.140678 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:09:13.141605 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:09:13.141605 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:13.141605 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:13.141605 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:13.141605 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:13.141605 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:13.141605 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:13.141605 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:13.141605 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:09:13.141605 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:13.141605 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:13.141605 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:13.141605 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:13.141605 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:13.141605 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:13.141605 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:13.141605 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:13.142843 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:09:13.142843 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:09:13.142843 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:13.142843 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:13.142843 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 350/697] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:09:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:13.147672 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fd85c2-40e6-47a6-b3c6-c659933d041a None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:13.223064 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ba816e-5b61-4d38-9d18-b5a3ad273b98 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:13.227516 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:13.303558 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f309ae5-8692-4b07-9466-f5bb42210b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:13.304369 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f309ae5-8692-4b07-9466-f5bb42210b99 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:13.304659 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f309ae5-8692-4b07-9466-f5bb42210b99 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:13.304940 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f309ae5-8692-4b07-9466-f5bb42210b99 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:13.317116 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fd85c2-40e6-47a6-b3c6-c659933d041a None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:13.323397 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f309ae5-8692-4b07-9466-f5bb42210b99 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:13.324880 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f309ae5-8692-4b07-9466-f5bb42210b99 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:13.348513 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-6f309ae5-8692-4b07-9466-f5bb42210b99 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:09:13.348513 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:13.348513 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:13.348513 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:13.348513 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:13.348513 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:13.348513 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:13.348513 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:13.348513 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:13.348513 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:13.348513 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:13.348513 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:13.348513 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 16:09:13.348513 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 16:09:13.348513 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 16:09:13.349435 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 16:09:13.349435 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:13.349435 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:13.349435 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:13.349435 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:13.349435 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:13.349435 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:13.349435 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:13.349435 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:09:13.349435 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:13.349435 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:13.349435 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:13.349435 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:13.349435 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:13.349435 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:13.349435 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:13.349435 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:13.351120 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 16:09:13.351120 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 16:09:13.351120 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 16:09:13.351120 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 16:09:13.351120 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 16:09:13.351120 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 16:09:13.351120 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:09:13.351120 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:13.356497 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 348/698] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 16:09:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 406 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:13.362807 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f309ae5-8692-4b07-9466-f5bb42210b99 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:13.376473 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7422ff08-7452-492a-aa6a-a3e1fc76f359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:13.377142 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7422ff08-7452-492a-aa6a-a3e1fc76f359 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:13.377423 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7422ff08-7452-492a-aa6a-a3e1fc76f359 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:13.377697 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7422ff08-7452-492a-aa6a-a3e1fc76f359 None admin] PATH_INFO: `/v3/domains` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:13.378542 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7422ff08-7452-492a-aa6a-a3e1fc76f359 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:13.378840 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7422ff08-7452-492a-aa6a-a3e1fc76f359 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:13.380397 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7422ff08-7452-492a-aa6a-a3e1fc76f359 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:13.393338 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 351/699] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 16:09:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:09:13.394877 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc1e0a-bb5d-4ca4-9019-6b8aa1414ac7 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:13.395124 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc1e0a-bb5d-4ca4-9019-6b8aa1414ac7 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:13.395403 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc1e0a-bb5d-4ca4-9019-6b8aa1414ac7 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:13.401112 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 352/700] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:09:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:09:13.402051 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dc1e0a-bb5d-4ca4-9019-6b8aa1414ac7 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:13.430227 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:13.475587 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f309ae5-8692-4b07-9466-f5bb42210b99 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:13.511604 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dc1e0a-bb5d-4ca4-9019-6b8aa1414ac7 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:13.513749 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5e30ea-52d8-4662-a060-34cb96616cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:13.514448 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e30ea-52d8-4662-a060-34cb96616cd3 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:13.514729 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e30ea-52d8-4662-a060-34cb96616cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:13.514996 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e30ea-52d8-4662-a060-34cb96616cd3 None admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:13.515777 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5e30ea-52d8-4662-a060-34cb96616cd3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:13.516089 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5e30ea-52d8-4662-a060-34cb96616cd3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:13.517520 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5e30ea-52d8-4662-a060-34cb96616cd3 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:13.531254 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 349/701] 10.222.0.62 () {56 vars in 1148 bytes} [Fri May 27 16:09:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:13.536936 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6403f971-296b-48e6-a279-80d1ac001948 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:13.537234 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6403f971-296b-48e6-a279-80d1ac001948 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:13.538075 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6403f971-296b-48e6-a279-80d1ac001948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:13.548314 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef61725-d4a8-4f74-8c23-a6e6863ae85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:13.549100 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef61725-d4a8-4f74-8c23-a6e6863ae85d None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:13.549377 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef61725-d4a8-4f74-8c23-a6e6863ae85d None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:13.549645 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef61725-d4a8-4f74-8c23-a6e6863ae85d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:13.554518 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-6403f971-296b-48e6-a279-80d1ac001948 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:09:13.555694 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-6403f971-296b-48e6-a279-80d1ac001948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:09:13.557022 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef61725-d4a8-4f74-8c23-a6e6863ae85d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:13.558934 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef61725-d4a8-4f74-8c23-a6e6863ae85d None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:13.572984 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-2ef61725-d4a8-4f74-8c23-a6e6863ae85d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:09:13.572984 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:13.572984 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:13.572984 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:13.572984 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:13.572984 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:13.572984 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:13.572984 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:13.572984 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:13.572984 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:13.572984 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:13.572984 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:13.572984 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 16:09:13.572984 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 16:09:13.572984 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 16:09:13.573950 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 16:09:13.573950 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:13.573950 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:13.573950 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:13.573950 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:13.573950 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:13.573950 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:13.573950 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:13.573950 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:09:13.573950 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:13.573950 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:13.573950 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:13.573950 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:13.573950 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:13.573950 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:13.573950 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:13.573950 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:13.575408 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 16:09:13.575408 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 16:09:13.575408 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 16:09:13.575408 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 16:09:13.575408 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 16:09:13.575408 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 16:09:13.575408 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:09:13.575408 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:13.575408 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 353/702] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 16:09:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:13.575408 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db72a8-6fe0-4930-bb2c-d496cd42d172 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:13.576079 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db72a8-6fe0-4930-bb2c-d496cd42d172 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:13.576079 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db72a8-6fe0-4930-bb2c-d496cd42d172 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:13.576804 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:13.577578 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 354/703] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:09:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:09:13.578098 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db72a8-6fe0-4930-bb2c-d496cd42d172 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:13.637082 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 350/704] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:09:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:09:13.638329 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6403f971-296b-48e6-a279-80d1ac001948 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:13.686547 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:13.703977 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db72a8-6fe0-4930-bb2c-d496cd42d172 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:13.740392 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae5cf4a-6e62-4dd7-9822-b55a84263635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:13.741198 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5cf4a-6e62-4dd7-9822-b55a84263635 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:13.741480 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5cf4a-6e62-4dd7-9822-b55a84263635 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:13.741758 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5cf4a-6e62-4dd7-9822-b55a84263635 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:13.742673 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae5cf4a-6e62-4dd7-9822-b55a84263635 None admin] RBAC: Adding query filter params (role.id=e04fe3eb1f714d74901ac83e33ea8a16, scope.project.id=d48d95a12587479ca5714f6ebd60dd9f, user.id=cb13ad6d8b1e46029262556bff398796) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:13.742982 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae5cf4a-6e62-4dd7-9822-b55a84263635 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:13.744464 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae5cf4a-6e62-4dd7-9822-b55a84263635 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:13.750571 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 355/705] 10.222.0.62 () {56 vars in 1374 bytes} [Fri May 27 16:09:13 2022] GET /identity/v3/role_assignments?user.id=cb13ad6d8b1e46029262556bff398796&scope.project.id=d48d95a12587479ca5714f6ebd60dd9f&role.id=e04fe3eb1f714d74901ac83e33ea8a16 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:13.754596 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6403f971-296b-48e6-a279-80d1ac001948 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:13.759841 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0bbaa-6369-4dc7-a6fb-f77cbdcd2349 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:13.760470 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0bbaa-6369-4dc7-a6fb-f77cbdcd2349 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:13.760946 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0bbaa-6369-4dc7-a6fb-f77cbdcd2349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:13.786288 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-77f0bbaa-6369-4dc7-a6fb-f77cbdcd2349 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:09:13.788239 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-77f0bbaa-6369-4dc7-a6fb-f77cbdcd2349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:09:13.794864 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4133fbc-cdc7-4ba2-8757-ff0247e66ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:13.795854 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4133fbc-cdc7-4ba2-8757-ff0247e66ed9 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:13.796292 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4133fbc-cdc7-4ba2-8757-ff0247e66ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:13.796766 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4133fbc-cdc7-4ba2-8757-ff0247e66ed9 None admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:13.797802 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4133fbc-cdc7-4ba2-8757-ff0247e66ed9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:13.798334 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4133fbc-cdc7-4ba2-8757-ff0247e66ed9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:13.800051 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4133fbc-cdc7-4ba2-8757-ff0247e66ed9 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:13.815467 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 351/706] 10.222.0.62 () {56 vars in 1148 bytes} [Fri May 27 16:09:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:13.816698 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4133fbc-cdc7-4ba2-8757-ff0247e66ed9 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:13.834097 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:13.886111 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 356/707] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:09:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:09:13.887463 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f0bbaa-6369-4dc7-a6fb-f77cbdcd2349 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:13.970973 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4133fbc-cdc7-4ba2-8757-ff0247e66ed9 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:14.005915 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:14.019556 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f0bbaa-6369-4dc7-a6fb-f77cbdcd2349 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:14.019989 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da09a43-28a5-4d4a-9039-eddab694a930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:14.020788 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da09a43-28a5-4d4a-9039-eddab694a930 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:14.021071 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da09a43-28a5-4d4a-9039-eddab694a930 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:14.021346 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da09a43-28a5-4d4a-9039-eddab694a930 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:14.035010 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da09a43-28a5-4d4a-9039-eddab694a930 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:14.036730 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da09a43-28a5-4d4a-9039-eddab694a930 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:14.059724 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-9da09a43-28a5-4d4a-9039-eddab694a930 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:14.059724 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:14.059724 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:14.059724 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:14.059724 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:14.059724 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:14.059724 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:14.059724 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:14.059724 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:14.059724 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:14.059724 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:14.059724 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:14.059724 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:09:14.059724 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:09:14.059724 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:09:14.060913 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:09:14.060913 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:14.060913 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:14.060913 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:14.060913 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:14.060913 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:14.060913 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:14.060913 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:14.060913 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:09:14.060913 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:14.060913 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:14.060913 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:14.060913 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:14.060913 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:14.060913 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:14.060913 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:14.060913 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:14.062102 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:09:14.062102 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:09:14.062102 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:14.062102 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:14.064541 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43279ac5-a987-4bc5-bf6b-62ec56ce2e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:14.065467 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43279ac5-a987-4bc5-bf6b-62ec56ce2e4d None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:14.065670 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 352/708] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:09:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:14.066223 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43279ac5-a987-4bc5-bf6b-62ec56ce2e4d None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:14.066566 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da09a43-28a5-4d4a-9039-eddab694a930 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:14.066944 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43279ac5-a987-4bc5-bf6b-62ec56ce2e4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:14.067973 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43279ac5-a987-4bc5-bf6b-62ec56ce2e4d None admin] RBAC: Adding query filter params (role.id=1d9076bd231c43809cb971b6360e0c28, scope.project.id=d48d95a12587479ca5714f6ebd60dd9f, user.id=e8e6ec55445045fcac5623b9b6ffa9ab) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:14.068469 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43279ac5-a987-4bc5-bf6b-62ec56ce2e4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:14.072192 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43279ac5-a987-4bc5-bf6b-62ec56ce2e4d None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:14.080176 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 357/709] 10.222.0.62 () {56 vars in 1374 bytes} [Fri May 27 16:09:13 2022] GET /identity/v3/role_assignments?user.id=e8e6ec55445045fcac5623b9b6ffa9ab&scope.project.id=d48d95a12587479ca5714f6ebd60dd9f&role.id=1d9076bd231c43809cb971b6360e0c28 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:14.081279 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43279ac5-a987-4bc5-bf6b-62ec56ce2e4d None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:14.157296 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:14.210519 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da09a43-28a5-4d4a-9039-eddab694a930 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:14.241395 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43279ac5-a987-4bc5-bf6b-62ec56ce2e4d None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:14.254613 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f71ede-1649-4f1b-a11a-c19a93e1f6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:14.255971 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f71ede-1649-4f1b-a11a-c19a93e1f6e1 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:14.256557 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f71ede-1649-4f1b-a11a-c19a93e1f6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:14.257115 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f71ede-1649-4f1b-a11a-c19a93e1f6e1 None admin] PATH_INFO: `/v3/services/network` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:14.257902 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f71ede-1649-4f1b-a11a-c19a93e1f6e1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:14.259641 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f71ede-1649-4f1b-a11a-c19a93e1f6e1 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:14.277916 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-44f71ede-1649-4f1b-a11a-c19a93e1f6e1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 27 16:09:14.277916 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:14.277916 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 16:09:14.277916 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 16:09:14.277916 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 16:09:14.277916 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 16:09:14.277916 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 16:09:14.277916 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:09:14.277916 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 27 16:09:14.277916 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:14.277916 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 16:09:14.277916 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:14.277916 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:14.277916 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:14.277916 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:14.277916 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:14.277916 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:14.279267 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:14.279267 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:14.279267 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:14.279267 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:14.279267 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:14.279267 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:14.279267 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 16:09:14.279267 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 16:09:14.279267 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 16:09:14.279267 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 16:09:14.279267 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:14.279267 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:14.279267 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:14.279267 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:14.279267 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:14.279267 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:14.280194 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:14.280194 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:09:14.280194 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:14.280194 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:14.280194 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:14.280194 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:14.280194 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:14.280194 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:14.280194 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:14.280194 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:14.280194 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 16:09:14.280194 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:09:14.280194 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 27 16:09:14.280194 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:14.284443 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 353/710] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 16:09:14 2022] GET /identity/v3/services/network => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:14.284443 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49488d3b-7e82-4430-b315-0e99a139b1dd None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:14.284443 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49488d3b-7e82-4430-b315-0e99a139b1dd None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:14.284443 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49488d3b-7e82-4430-b315-0e99a139b1dd None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:14.285600 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 354/711] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:09:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:09:14.294514 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679eb834-e00e-48cb-a431-4135f2ee39f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:14.295204 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679eb834-e00e-48cb-a431-4135f2ee39f8 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:14.295491 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679eb834-e00e-48cb-a431-4135f2ee39f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:14.295771 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679eb834-e00e-48cb-a431-4135f2ee39f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:14.295930 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f0772-df1a-4d45-80e2-3e02c58861f7 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:14.296182 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f0772-df1a-4d45-80e2-3e02c58861f7 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:14.296467 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f0772-df1a-4d45-80e2-3e02c58861f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:14.296666 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679eb834-e00e-48cb-a431-4135f2ee39f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:14.296979 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679eb834-e00e-48cb-a431-4135f2ee39f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:14.298523 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679eb834-e00e-48cb-a431-4135f2ee39f8 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:14.312736 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 358/712] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 16:09:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:14.313903 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679eb834-e00e-48cb-a431-4135f2ee39f8 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:14.315344 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-893f0772-df1a-4d45-80e2-3e02c58861f7 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:09:14.316868 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-893f0772-df1a-4d45-80e2-3e02c58861f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:09:14.317636 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:14.406308 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 355/713] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:09:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:09:14.406308 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893f0772-df1a-4d45-80e2-3e02c58861f7 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:14.450493 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679eb834-e00e-48cb-a431-4135f2ee39f8 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:14.479522 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:14.496663 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be311d21-b4e8-4de2-aac5-9b0434c96f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:14.497577 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be311d21-b4e8-4de2-aac5-9b0434c96f27 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:14.498013 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be311d21-b4e8-4de2-aac5-9b0434c96f27 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:14.498475 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be311d21-b4e8-4de2-aac5-9b0434c96f27 None admin] PATH_INFO: `/v3/services` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:14.499336 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be311d21-b4e8-4de2-aac5-9b0434c96f27 None admin] RBAC: Adding query filter params (name=network) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:14.499818 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be311d21-b4e8-4de2-aac5-9b0434c96f27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:14.501891 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be311d21-b4e8-4de2-aac5-9b0434c96f27 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:14.513025 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 359/714] 10.222.0.62 () {56 vars in 1112 bytes} [Fri May 27 16:09:14 2022] GET /identity/v3/services?name=network => generated 124 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:14.513025 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be311d21-b4e8-4de2-aac5-9b0434c96f27 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:14.535454 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893f0772-df1a-4d45-80e2-3e02c58861f7 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:14.575587 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da954fc-480a-4b18-8461-3769150bdc63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:14.576766 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da954fc-480a-4b18-8461-3769150bdc63 None admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:14.577417 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da954fc-480a-4b18-8461-3769150bdc63 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:14.577935 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da954fc-480a-4b18-8461-3769150bdc63 None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:14.578888 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da954fc-480a-4b18-8461-3769150bdc63 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:14.580728 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:14.581154 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da954fc-480a-4b18-8461-3769150bdc63 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:14.615756 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be311d21-b4e8-4de2-aac5-9b0434c96f27 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:14.652467 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401c1a9f-d8b0-4aa6-9cfe-7ae50282294d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:14.653285 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c1a9f-d8b0-4aa6-9cfe-7ae50282294d None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:14.653575 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c1a9f-d8b0-4aa6-9cfe-7ae50282294d None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:14.653859 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c1a9f-d8b0-4aa6-9cfe-7ae50282294d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:14.654551 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401c1a9f-d8b0-4aa6-9cfe-7ae50282294d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:14.655951 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401c1a9f-d8b0-4aa6-9cfe-7ae50282294d None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:14.660696 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 356/715] 10.222.0.62 () {60 vars in 1132 bytes} [Fri May 27 16:09:14 2022] POST /identity/v3/users => generated 254 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:09:14.662487 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da954fc-480a-4b18-8461-3769150bdc63 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:14.671162 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-401c1a9f-d8b0-4aa6-9cfe-7ae50282294d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 16:09:14.671162 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:14.671162 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 16:09:14.671162 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 16:09:14.671162 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 16:09:14.671162 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 16:09:14.671162 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 16:09:14.671162 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:09:14.671162 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 16:09:14.671162 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:14.671162 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 16:09:14.671162 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:14.671162 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:14.671162 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:14.671162 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:14.671162 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:14.672626 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:14.672626 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:14.672626 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:14.672626 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:14.672626 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:14.672626 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:14.672626 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:14.672626 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 16:09:14.672626 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 16:09:14.672626 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 16:09:14.672626 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 16:09:14.672626 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:14.672626 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:14.672626 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:14.672626 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:14.672626 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:14.673971 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:14.673971 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:14.673971 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:09:14.673971 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:14.673971 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:14.673971 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:14.673971 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:14.673971 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:14.673971 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:14.673971 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:14.673971 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:14.673971 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 16:09:14.673971 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:09:14.673971 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 16:09:14.673971 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:14.673971 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 360/716] 10.222.0.62 () {56 vars in 1129 bytes} [Fri May 27 16:09:14 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:14.678876 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401c1a9f-d8b0-4aa6-9cfe-7ae50282294d None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:14.811847 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da954fc-480a-4b18-8461-3769150bdc63 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:14.835068 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:14.884145 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d762d53-88ae-42ac-b1ce-8231ace589f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:14.884821 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d762d53-88ae-42ac-b1ce-8231ace589f7 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:14.885112 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d762d53-88ae-42ac-b1ce-8231ace589f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:14.885387 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d762d53-88ae-42ac-b1ce-8231ace589f7 None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:14.886108 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d762d53-88ae-42ac-b1ce-8231ace589f7 None admin] RBAC: Adding query filter params (type=network) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:14.886445 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d762d53-88ae-42ac-b1ce-8231ace589f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:14.887827 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d762d53-88ae-42ac-b1ce-8231ace589f7 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:14.897628 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401c1a9f-d8b0-4aa6-9cfe-7ae50282294d None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:14.901543 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 357/717] 10.222.0.62 () {56 vars in 1112 bytes} [Fri May 27 16:09:14 2022] GET /identity/v3/services?type=network => generated 124 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:14.940637 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:14.948158 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ebd3fb-a3cf-44d5-9b3b-9f909576b21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:14.952525 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ebd3fb-a3cf-44d5-9b3b-9f909576b21d None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:14.952525 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ebd3fb-a3cf-44d5-9b3b-9f909576b21d None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:14.952525 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ebd3fb-a3cf-44d5-9b3b-9f909576b21d None admin] PATH_INFO: `/v3/services` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:14.952525 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ebd3fb-a3cf-44d5-9b3b-9f909576b21d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:14.952525 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ebd3fb-a3cf-44d5-9b3b-9f909576b21d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:14.953093 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ebd3fb-a3cf-44d5-9b3b-9f909576b21d None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:14.962654 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 361/718] 10.222.0.62 () {56 vars in 1124 bytes} [Fri May 27 16:09:14 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:14.964989 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d762d53-88ae-42ac-b1ce-8231ace589f7 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:15.085870 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d762d53-88ae-42ac-b1ce-8231ace589f7 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:15.124173 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b8036e-1276-4677-bdcc-2d5148995ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:15.124848 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b8036e-1276-4677-bdcc-2d5148995ac0 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:15.125134 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b8036e-1276-4677-bdcc-2d5148995ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:15.125412 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b8036e-1276-4677-bdcc-2d5148995ac0 None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:15.126126 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b8036e-1276-4677-bdcc-2d5148995ac0 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:15.126459 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b8036e-1276-4677-bdcc-2d5148995ac0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:15.127942 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b8036e-1276-4677-bdcc-2d5148995ac0 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:15.136597 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 358/719] 10.222.0.62 () {56 vars in 1124 bytes} [Fri May 27 16:09:14 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:16.121141 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a916ac-4108-44cf-9467-24578f4efcdb None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:16.121644 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a916ac-4108-44cf-9467-24578f4efcdb None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:16.121644 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a916ac-4108-44cf-9467-24578f4efcdb None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:16.123319 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 362/720] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:09:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:09:16.128354 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f692969-cb6f-46eb-84c4-c4511ffa0c54 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:16.128743 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f692969-cb6f-46eb-84c4-c4511ffa0c54 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:16.128907 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f692969-cb6f-46eb-84c4-c4511ffa0c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:16.150264 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-4f692969-cb6f-46eb-84c4-c4511ffa0c54 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:09:16.151445 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-4f692969-cb6f-46eb-84c4-c4511ffa0c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:09:16.198451 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:16.236283 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 359/721] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:09:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:09:16.270019 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a916ac-4108-44cf-9467-24578f4efcdb None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:16.407119 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a916ac-4108-44cf-9467-24578f4efcdb None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:16.448048 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23c9af4-d38a-4052-ab9a-f5dfebf3077c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:16.448850 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23c9af4-d38a-4052-ab9a-f5dfebf3077c None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:16.449136 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23c9af4-d38a-4052-ab9a-f5dfebf3077c None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:16.449414 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23c9af4-d38a-4052-ab9a-f5dfebf3077c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:16.459946 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23c9af4-d38a-4052-ab9a-f5dfebf3077c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:09:16.467672 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-a23c9af4-d38a-4052-ab9a-f5dfebf3077c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:09:16.467672 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:16.467672 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:16.467672 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:16.467672 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:16.467672 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:16.467672 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:16.467672 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:16.467672 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:16.467672 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:16.467672 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:16.467672 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:16.467672 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:09:16.467672 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:09:16.467672 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:09:16.467672 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:09:16.468590 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:09:16.468590 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:09:16.468590 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:09:16.468590 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:09:16.468590 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:16.468590 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:16.468590 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:16.468590 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:16.468590 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:16.468590 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:16.468590 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:16.468590 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:09:16.468590 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:16.468590 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:16.468590 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:16.468590 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:16.469600 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:16.469600 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:16.469600 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:16.469600 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:16.469600 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:09:16.469600 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:09:16.469600 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:09:16.469600 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:09:16.469600 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:09:16.469600 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:09:16.469600 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:09:16.469600 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:16.469600 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 363/722] 10.222.0.62 () {56 vars in 1096 bytes} [Fri May 27 16:09:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:16.475882 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f692969-cb6f-46eb-84c4-c4511ffa0c54 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:16.647292 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f692969-cb6f-46eb-84c4-c4511ffa0c54 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:16.694423 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3e473f-76e3-43c7-a53e-0abc270b6ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:16.695063 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3e473f-76e3-43c7-a53e-0abc270b6ccf None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:16.695299 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3e473f-76e3-43c7-a53e-0abc270b6ccf None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:16.695686 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3e473f-76e3-43c7-a53e-0abc270b6ccf None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:16.696569 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3e473f-76e3-43c7-a53e-0abc270b6ccf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:16.696783 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3e473f-76e3-43c7-a53e-0abc270b6ccf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:16.698164 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3e473f-76e3-43c7-a53e-0abc270b6ccf None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:16.714085 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 360/723] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 16:09:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:16.719693 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23c9af4-d38a-4052-ab9a-f5dfebf3077c None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:16.788053 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4146917-6126-4f5b-95e7-f86802602143 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:16.788403 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4146917-6126-4f5b-95e7-f86802602143 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:16.788628 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4146917-6126-4f5b-95e7-f86802602143 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:16.790627 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 361/724] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:09:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 16:09:16.796540 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358def8e-351f-4e2f-bb73-3128c725ae81 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:16.796832 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358def8e-351f-4e2f-bb73-3128c725ae81 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:16.797113 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358def8e-351f-4e2f-bb73-3128c725ae81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:16.816100 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:16.820601 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-358def8e-351f-4e2f-bb73-3128c725ae81 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:09:16.821801 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-358def8e-351f-4e2f-bb73-3128c725ae81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:09:16.866302 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23c9af4-d38a-4052-ab9a-f5dfebf3077c None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:16.876721 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:16.901823 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bc0724-4ffa-487c-9a0e-8a091999d49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:16.902647 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc0724-4ffa-487c-9a0e-8a091999d49f None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:16.902929 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc0724-4ffa-487c-9a0e-8a091999d49f None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:16.903203 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc0724-4ffa-487c-9a0e-8a091999d49f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:16.914008 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bc0724-4ffa-487c-9a0e-8a091999d49f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:16.915580 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bc0724-4ffa-487c-9a0e-8a091999d49f None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:16.932890 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-09bc0724-4ffa-487c-9a0e-8a091999d49f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:16.932890 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:16.932890 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:16.932890 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:16.932890 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:16.932890 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:16.932890 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:16.932890 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:16.932890 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:16.932890 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:16.932890 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:16.932890 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:16.932890 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:09:16.932890 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:09:16.932890 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:09:16.933803 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:09:16.933803 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:16.933803 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:16.933803 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:16.933803 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:16.933803 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:16.933803 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:16.933803 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:16.933803 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:09:16.933803 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:16.933803 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:16.933803 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:16.933803 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:16.933803 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:16.933803 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:16.933803 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:16.933803 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:16.934736 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:09:16.934736 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:09:16.934736 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:16.934736 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:16.934736 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 364/725] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:09:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:16.939458 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bc0724-4ffa-487c-9a0e-8a091999d49f None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:16.976247 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 362/726] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:09:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 16:09:16.999716 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358def8e-351f-4e2f-bb73-3128c725ae81 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:17.138703 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bc0724-4ffa-487c-9a0e-8a091999d49f None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:17.154613 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:17.197858 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358def8e-351f-4e2f-bb73-3128c725ae81 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:17.212199 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b383eac2-5a44-4160-ba60-c068666c93f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:17.212868 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b383eac2-5a44-4160-ba60-c068666c93f9 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:17.213149 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b383eac2-5a44-4160-ba60-c068666c93f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:17.213420 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b383eac2-5a44-4160-ba60-c068666c93f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:17.214142 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b383eac2-5a44-4160-ba60-c068666c93f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:17.214473 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b383eac2-5a44-4160-ba60-c068666c93f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:17.215833 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b383eac2-5a44-4160-ba60-c068666c93f9 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:17.242153 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 365/727] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 16:09:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:17.255248 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b383eac2-5a44-4160-ba60-c068666c93f9 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:17.259162 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dbf0fb-07bf-4877-992c-567fb7349cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:17.259971 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dbf0fb-07bf-4877-992c-567fb7349cbf None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:17.261170 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dbf0fb-07bf-4877-992c-567fb7349cbf None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:17.261443 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dbf0fb-07bf-4877-992c-567fb7349cbf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:17.283079 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dbf0fb-07bf-4877-992c-567fb7349cbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:09:17.294628 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-a3dbf0fb-07bf-4877-992c-567fb7349cbf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:09:17.294628 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:17.294628 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:17.294628 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:17.294628 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:17.294628 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:17.294628 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:17.294628 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:17.294628 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:17.294628 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:17.294628 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:17.294628 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:17.294628 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:09:17.294628 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:09:17.294628 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:09:17.294628 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:09:17.295588 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:09:17.295588 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:09:17.295588 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:09:17.295588 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:09:17.295588 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:17.295588 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:17.295588 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:17.295588 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:17.295588 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:17.295588 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:17.295588 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:17.295588 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:09:17.295588 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:17.295588 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:17.295588 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:17.295588 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:17.296443 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:17.296443 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:17.296443 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:17.296443 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:17.296443 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:09:17.296443 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:09:17.296443 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:09:17.296443 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:09:17.296443 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:09:17.296443 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:09:17.296443 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:09:17.296443 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:17.300583 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 363/728] 10.222.0.62 () {56 vars in 1096 bytes} [Fri May 27 16:09:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:17.312786 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dbf0fb-07bf-4877-992c-567fb7349cbf None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:17.341038 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:17.419050 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dbf0fb-07bf-4877-992c-567fb7349cbf None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:17.468086 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c229671-8cc1-4770-82c2-3d7d24ecfd73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:17.468841 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c229671-8cc1-4770-82c2-3d7d24ecfd73 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:17.469124 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c229671-8cc1-4770-82c2-3d7d24ecfd73 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:17.469443 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c229671-8cc1-4770-82c2-3d7d24ecfd73 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:17.470198 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c229671-8cc1-4770-82c2-3d7d24ecfd73 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:17.470527 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c229671-8cc1-4770-82c2-3d7d24ecfd73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:17.471914 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c229671-8cc1-4770-82c2-3d7d24ecfd73 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:17.475116 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b383eac2-5a44-4160-ba60-c068666c93f9 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:17.491270 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 364/729] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 16:09:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:09:17.498177 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c229671-8cc1-4770-82c2-3d7d24ecfd73 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:17.543438 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8ab300-8417-4128-9386-b8b4f0d614d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:17.544600 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ab300-8417-4128-9386-b8b4f0d614d0 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:17.545086 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ab300-8417-4128-9386-b8b4f0d614d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:17.545561 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ab300-8417-4128-9386-b8b4f0d614d0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:17.560091 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8ab300-8417-4128-9386-b8b4f0d614d0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:17.565978 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8ab300-8417-4128-9386-b8b4f0d614d0 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:17.586499 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-ab8ab300-8417-4128-9386-b8b4f0d614d0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 16:09:17.586499 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:17.586499 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:17.586499 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:17.586499 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:17.586499 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:17.586499 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:17.586499 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:17.586499 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:17.586499 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:17.586499 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:17.586499 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:17.586499 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 16:09:17.586499 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 16:09:17.586499 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 16:09:17.586499 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 16:09:17.587509 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:17.587509 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:17.587509 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 16:09:17.587509 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:09:17.587509 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 16:09:17.587509 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:09:17.587509 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:17.587509 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:17.587509 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:17.587509 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:17.587509 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:17.587509 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:09:17.587509 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:17.587509 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:17.587509 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:17.587509 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:17.587509 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:17.587509 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:17.588456 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:17.588456 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:17.588456 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 16:09:17.588456 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 16:09:17.588456 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 16:09:17.588456 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 16:09:17.588456 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 16:09:17.588456 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 16:09:17.588456 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 16:09:17.588456 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:17.591146 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 366/730] 10.222.0.62 () {56 vars in 1093 bytes} [Fri May 27 16:09:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:09:17.602278 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8ab300-8417-4128-9386-b8b4f0d614d0 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:17.658600 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:17.667601 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:17.698278 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c229671-8cc1-4770-82c2-3d7d24ecfd73 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:17.734922 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e088f968-5fda-45b3-821b-064a9b08e2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:17.735779 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e088f968-5fda-45b3-821b-064a9b08e2cd None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:17.736258 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e088f968-5fda-45b3-821b-064a9b08e2cd None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:17.736678 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e088f968-5fda-45b3-821b-064a9b08e2cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:17.749063 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e088f968-5fda-45b3-821b-064a9b08e2cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:17.750616 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e088f968-5fda-45b3-821b-064a9b08e2cd None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:17.757424 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8ab300-8417-4128-9386-b8b4f0d614d0 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:17.769355 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-e088f968-5fda-45b3-821b-064a9b08e2cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:17.769355 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:17.769355 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:17.769355 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:17.769355 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:17.769355 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:17.769355 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:17.769355 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:17.769355 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:17.769355 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:17.769355 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:17.769355 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:17.769355 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:09:17.769355 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:09:17.769355 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:09:17.770555 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:09:17.770555 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:17.770555 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:17.770555 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:17.770555 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:17.770555 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:17.770555 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:17.770555 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:17.770555 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:09:17.770555 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:17.770555 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:17.770555 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:17.770555 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:17.770555 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:17.770555 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:17.770555 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:17.770555 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:17.771717 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:09:17.771717 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:09:17.771717 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:17.771717 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:17.773284 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 365/731] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:09:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:17.779443 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd976c-d171-480c-8f1b-c26e5af9e59b None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:17.779879 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd976c-d171-480c-8f1b-c26e5af9e59b None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:17.780261 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd976c-d171-480c-8f1b-c26e5af9e59b None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:17.782020 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 366/732] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:09:17 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:09:17.782843 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bd976c-d171-480c-8f1b-c26e5af9e59b None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:17.801495 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07189707-b5f4-4106-aa40-7aa96e6189a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:17.802181 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07189707-b5f4-4106-aa40-7aa96e6189a2 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:17.803501 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07189707-b5f4-4106-aa40-7aa96e6189a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:17.803906 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07189707-b5f4-4106-aa40-7aa96e6189a2 None admin] PATH_INFO: `/v3/users` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:17.804764 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07189707-b5f4-4106-aa40-7aa96e6189a2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:17.805073 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07189707-b5f4-4106-aa40-7aa96e6189a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:17.806559 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07189707-b5f4-4106-aa40-7aa96e6189a2 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:17.824072 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 367/733] 10.222.0.62 () {56 vars in 1133 bytes} [Fri May 27 16:09:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:17.825332 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78158e2e-377c-4c34-88f1-9e190012760a None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:17.825623 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78158e2e-377c-4c34-88f1-9e190012760a None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:17.825901 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78158e2e-377c-4c34-88f1-9e190012760a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:17.844613 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-78158e2e-377c-4c34-88f1-9e190012760a None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:09:17.846276 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-78158e2e-377c-4c34-88f1-9e190012760a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:09:17.898960 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bd976c-d171-480c-8f1b-c26e5af9e59b None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:17.928693 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 368/734] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:09:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:09:17.930095 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee56feea-1fa5-467a-aeb2-721597135bfc None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:17.930430 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee56feea-1fa5-467a-aeb2-721597135bfc None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:17.930714 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee56feea-1fa5-467a-aeb2-721597135bfc None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:17.932124 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 369/735] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:09:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:09:17.934996 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee56feea-1fa5-467a-aeb2-721597135bfc None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:17.944248 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1e1057-424c-4418-a61f-c0c3ae9a126f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:17.944923 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e1057-424c-4418-a61f-c0c3ae9a126f None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:17.945214 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e1057-424c-4418-a61f-c0c3ae9a126f None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:17.945498 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e1057-424c-4418-a61f-c0c3ae9a126f None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:17.946228 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1e1057-424c-4418-a61f-c0c3ae9a126f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:17.946572 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1e1057-424c-4418-a61f-c0c3ae9a126f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:17.947946 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1e1057-424c-4418-a61f-c0c3ae9a126f None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:17.955310 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:17.956449 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:17.965271 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 367/736] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 16:09:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:17.965271 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a85d45-aabc-4f22-8c79-e4bbdb215884 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:17.965271 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a85d45-aabc-4f22-8c79-e4bbdb215884 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:17.965271 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a85d45-aabc-4f22-8c79-e4bbdb215884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:17.980830 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-b2a85d45-aabc-4f22-8c79-e4bbdb215884 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:09:17.982019 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-b2a85d45-aabc-4f22-8c79-e4bbdb215884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:09:18.047302 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee56feea-1fa5-467a-aeb2-721597135bfc None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:18.050007 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 368/737] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:09:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:09:18.051139 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a85d45-aabc-4f22-8c79-e4bbdb215884 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:18.084658 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ca5976-9fe4-45fd-8198-6eab673bf664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:18.085456 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca5976-9fe4-45fd-8198-6eab673bf664 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:18.086433 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca5976-9fe4-45fd-8198-6eab673bf664 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:18.086433 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca5976-9fe4-45fd-8198-6eab673bf664 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:18.096106 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ca5976-9fe4-45fd-8198-6eab673bf664 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:18.097539 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ca5976-9fe4-45fd-8198-6eab673bf664 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:18.115525 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-93ca5976-9fe4-45fd-8198-6eab673bf664 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:18.115525 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:18.115525 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:18.115525 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:18.115525 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:18.115525 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:18.115525 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:18.115525 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:18.115525 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:18.115525 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:18.115525 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:18.115525 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:18.115525 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:09:18.115525 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:09:18.115525 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:09:18.116594 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:09:18.116594 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:18.116594 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:18.116594 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:18.116594 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:18.116594 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:18.116594 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:18.116594 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:18.116594 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:09:18.116594 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:18.116594 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:18.116594 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:18.116594 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:18.116594 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:18.116594 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:18.116594 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:18.116594 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:18.117523 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:09:18.117523 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:09:18.117523 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:18.117523 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:18.117523 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 370/738] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:09:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:18.117809 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ca5976-9fe4-45fd-8198-6eab673bf664 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:18.157106 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a85d45-aabc-4f22-8c79-e4bbdb215884 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:18.182177 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:18.184116 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:18.191682 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ff6d84-5203-4096-b5a3-b41c64fb7e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:18.192480 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff6d84-5203-4096-b5a3-b41c64fb7e04 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:18.192902 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff6d84-5203-4096-b5a3-b41c64fb7e04 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:18.193132 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff6d84-5203-4096-b5a3-b41c64fb7e04 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:18.203499 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ff6d84-5203-4096-b5a3-b41c64fb7e04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:09:18.211961 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-b0ff6d84-5203-4096-b5a3-b41c64fb7e04 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 16:09:18.211961 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:18.211961 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:18.211961 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:18.211961 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:18.211961 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:18.211961 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:18.211961 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:18.211961 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:18.211961 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:18.211961 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:18.211961 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:18.211961 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:09:18.211961 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:09:18.211961 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:09:18.211961 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:09:18.212960 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:09:18.212960 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:09:18.212960 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:09:18.212960 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:09:18.212960 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:18.212960 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:18.212960 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:18.212960 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:18.212960 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:18.212960 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:18.212960 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:18.212960 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:09:18.212960 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:18.212960 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:18.212960 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:18.212960 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:18.213843 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:18.213843 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:18.213843 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:18.213843 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:18.213843 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:09:18.213843 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:09:18.213843 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:09:18.213843 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:09:18.213843 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:09:18.213843 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:09:18.213843 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 16:09:18.213843 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:18.213843 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 369/739] 10.222.0.62 () {56 vars in 1102 bytes} [Fri May 27 16:09:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:18.215036 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e1c760-0969-402a-a190-c1ce6e5071f6 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:18.215036 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e1c760-0969-402a-a190-c1ce6e5071f6 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:18.215036 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e1c760-0969-402a-a190-c1ce6e5071f6 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:18.220142 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 370/740] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:09:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:09:18.220142 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e1c760-0969-402a-a190-c1ce6e5071f6 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:18.221984 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ca5976-9fe4-45fd-8198-6eab673bf664 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:18.256075 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1052179d-b198-4726-9d85-09620808bc2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:18.256873 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1052179d-b198-4726-9d85-09620808bc2f None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:18.257158 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1052179d-b198-4726-9d85-09620808bc2f None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:18.257434 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1052179d-b198-4726-9d85-09620808bc2f None admin] PATH_INFO: `/v3/users/swift` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:18.264380 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1052179d-b198-4726-9d85-09620808bc2f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:18.265816 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1052179d-b198-4726-9d85-09620808bc2f None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:18.280764 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-1052179d-b198-4726-9d85-09620808bc2f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 27 16:09:18.280764 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:18.280764 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:18.280764 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:18.280764 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:18.280764 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:18.280764 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:18.280764 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:18.280764 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:18.280764 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:18.280764 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:18.280764 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:18.280764 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 16:09:18.280764 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 16:09:18.280764 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 16:09:18.280764 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 16:09:18.281916 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:18.281916 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:18.281916 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 16:09:18.281916 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:09:18.281916 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 16:09:18.281916 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:09:18.281916 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:18.281916 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:18.281916 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:18.281916 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:18.281916 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:18.281916 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:09:18.281916 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:18.281916 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:18.281916 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:18.281916 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:18.281916 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:18.281916 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:18.283151 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:18.283151 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:18.283151 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 16:09:18.283151 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 16:09:18.283151 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 16:09:18.283151 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 16:09:18.283151 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 16:09:18.283151 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 16:09:18.283151 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 27 16:09:18.283151 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:18.283151 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 371/741] 10.222.0.62 () {56 vars in 1096 bytes} [Fri May 27 16:09:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:18.283151 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1052179d-b198-4726-9d85-09620808bc2f None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:18.329277 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e1c760-0969-402a-a190-c1ce6e5071f6 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:18.364089 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378c7727-71e7-44c5-bb2b-1fc2437616d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:18.364752 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c7727-71e7-44c5-bb2b-1fc2437616d6 None admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:18.365038 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c7727-71e7-44c5-bb2b-1fc2437616d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:18.365387 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c7727-71e7-44c5-bb2b-1fc2437616d6 None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:18.366138 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378c7727-71e7-44c5-bb2b-1fc2437616d6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:18.367569 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378c7727-71e7-44c5-bb2b-1fc2437616d6 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:18.383339 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1052179d-b198-4726-9d85-09620808bc2f None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:18.408244 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:18.416374 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8165b2-063a-427b-8770-84414eb917ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:18.417021 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8165b2-063a-427b-8770-84414eb917ce None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:18.417301 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8165b2-063a-427b-8770-84414eb917ce None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:18.417576 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8165b2-063a-427b-8770-84414eb917ce None admin] PATH_INFO: `/v3/domains` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:18.418323 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8165b2-063a-427b-8770-84414eb917ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:18.418626 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8165b2-063a-427b-8770-84414eb917ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:18.419966 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8165b2-063a-427b-8770-84414eb917ce None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:18.430964 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 372/742] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 16:09:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:18.431729 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8165b2-063a-427b-8770-84414eb917ce None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:18.486277 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 371/743] 10.222.0.62 () {60 vars in 1141 bytes} [Fri May 27 16:09:18 2022] POST /identity/v3/services => generated 240 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:09:18.486277 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c5e715-3ef4-4654-8543-a9eb5e22eb39 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:18.486277 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c5e715-3ef4-4654-8543-a9eb5e22eb39 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:18.486277 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c5e715-3ef4-4654-8543-a9eb5e22eb39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:18.494754 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-b9c5e715-3ef4-4654-8543-a9eb5e22eb39 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:09:18.496043 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-b9c5e715-3ef4-4654-8543-a9eb5e22eb39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:09:18.539861 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8165b2-063a-427b-8770-84414eb917ce None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:18.549038 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:18.596165 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 372/744] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:09:18 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:09:18.596165 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c5e715-3ef4-4654-8543-a9eb5e22eb39 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:18.600580 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3670c78-b675-45df-a3ff-6beaf0a354ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:18.601570 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3670c78-b675-45df-a3ff-6beaf0a354ed None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:18.601860 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3670c78-b675-45df-a3ff-6beaf0a354ed None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:18.602142 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3670c78-b675-45df-a3ff-6beaf0a354ed None admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:18.603332 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3670c78-b675-45df-a3ff-6beaf0a354ed None admin] RBAC: Adding query filter params (name=service) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:18.604094 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3670c78-b675-45df-a3ff-6beaf0a354ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:18.606049 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3670c78-b675-45df-a3ff-6beaf0a354ed None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:18.618568 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 373/745] 10.222.0.62 () {56 vars in 1103 bytes} [Fri May 27 16:09:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:18.619902 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3670c78-b675-45df-a3ff-6beaf0a354ed None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:18.673221 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:18.703680 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c5e715-3ef4-4654-8543-a9eb5e22eb39 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:18.729263 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3670c78-b675-45df-a3ff-6beaf0a354ed None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:18.743369 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14320f50-923d-4abc-b743-91bb978960b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:18.744311 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14320f50-923d-4abc-b743-91bb978960b2 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:18.744758 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14320f50-923d-4abc-b743-91bb978960b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:18.745193 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14320f50-923d-4abc-b743-91bb978960b2 None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:18.746308 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14320f50-923d-4abc-b743-91bb978960b2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:18.746889 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14320f50-923d-4abc-b743-91bb978960b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:18.748458 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14320f50-923d-4abc-b743-91bb978960b2 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:18.765008 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a372a16-7615-4fad-81c1-c883201d9cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:18.765811 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a372a16-7615-4fad-81c1-c883201d9cf4 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:18.766097 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a372a16-7615-4fad-81c1-c883201d9cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:18.766418 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a372a16-7615-4fad-81c1-c883201d9cf4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:18.769398 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 373/746] 10.222.0.62 () {56 vars in 1135 bytes} [Fri May 27 16:09:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:18.770440 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14320f50-923d-4abc-b743-91bb978960b2 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:18.775161 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a372a16-7615-4fad-81c1-c883201d9cf4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:18.776609 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a372a16-7615-4fad-81c1-c883201d9cf4 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:18.790813 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-7a372a16-7615-4fad-81c1-c883201d9cf4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:09:18.790813 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:18.790813 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:18.790813 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:18.790813 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:18.790813 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:18.790813 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:18.790813 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:18.790813 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:18.790813 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:18.790813 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:18.790813 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:18.790813 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 16:09:18.790813 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 16:09:18.790813 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 16:09:18.791742 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 16:09:18.791742 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:18.791742 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:18.791742 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:18.791742 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:18.791742 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:18.791742 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:18.791742 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:18.791742 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:09:18.791742 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:18.791742 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:18.791742 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:18.791742 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:18.791742 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:18.791742 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:18.791742 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:18.791742 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:18.792628 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 16:09:18.792628 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 16:09:18.792628 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 16:09:18.792628 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 16:09:18.792628 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 16:09:18.792628 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 16:09:18.792628 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:09:18.792628 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:18.792628 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 374/747] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 16:09:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:18.793115 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a372a16-7615-4fad-81c1-c883201d9cf4 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:18.810470 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:18.884136 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14320f50-923d-4abc-b743-91bb978960b2 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:18.909853 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a372a16-7615-4fad-81c1-c883201d9cf4 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:18.912553 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:18.919787 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3617f224-d084-4a2c-aa38-f92ba5e312f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:18.920456 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3617f224-d084-4a2c-aa38-f92ba5e312f4 None admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:18.926316 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3617f224-d084-4a2c-aa38-f92ba5e312f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:18.926316 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3617f224-d084-4a2c-aa38-f92ba5e312f4 None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:18.926316 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3617f224-d084-4a2c-aa38-f92ba5e312f4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:18.926316 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3617f224-d084-4a2c-aa38-f92ba5e312f4 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:18.945228 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c44b204-daac-4895-835c-11a0fae1b097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:18.946023 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44b204-daac-4895-835c-11a0fae1b097 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:18.946359 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44b204-daac-4895-835c-11a0fae1b097 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:18.946659 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44b204-daac-4895-835c-11a0fae1b097 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:18.957125 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c44b204-daac-4895-835c-11a0fae1b097 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:18.958588 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c44b204-daac-4895-835c-11a0fae1b097 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:18.975943 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-7c44b204-daac-4895-835c-11a0fae1b097 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:18.975943 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:18.975943 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:18.975943 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:18.975943 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:18.975943 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:18.975943 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:18.975943 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:18.975943 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:18.975943 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:18.975943 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:18.975943 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:18.975943 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:09:18.975943 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:09:18.975943 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:09:18.976907 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:09:18.976907 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:18.976907 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:18.976907 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:18.976907 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:18.976907 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:18.976907 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:18.976907 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:18.976907 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:09:18.976907 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:18.976907 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:18.976907 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:18.976907 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:18.976907 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:18.976907 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:18.976907 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:18.976907 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:18.977811 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:09:18.977811 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:09:18.977811 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:18.977811 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:18.977811 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 375/748] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:09:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:18.978086 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c44b204-daac-4895-835c-11a0fae1b097 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:19.022280 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 374/749] 10.222.0.62 () {60 vars in 1141 bytes} [Fri May 27 16:09:18 2022] POST /identity/v3/services => generated 251 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:09:19.022280 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3617f224-d084-4a2c-aa38-f92ba5e312f4 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:19.125545 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:19.135080 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c44b204-daac-4895-835c-11a0fae1b097 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:19.146181 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3617f224-d084-4a2c-aa38-f92ba5e312f4 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:19.180631 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db185b40-743b-4622-9c00-337d20f17f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:19.181425 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db185b40-743b-4622-9c00-337d20f17f19 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:19.181712 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db185b40-743b-4622-9c00-337d20f17f19 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:19.181988 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db185b40-743b-4622-9c00-337d20f17f19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:19.203176 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07539341-d5a3-4cb0-acad-dcce288d012b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:19.204654 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07539341-d5a3-4cb0-acad-dcce288d012b None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:19.205585 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07539341-d5a3-4cb0-acad-dcce288d012b None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:19.206068 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07539341-d5a3-4cb0-acad-dcce288d012b None admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:19.207670 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07539341-d5a3-4cb0-acad-dcce288d012b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:19.208485 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07539341-d5a3-4cb0-acad-dcce288d012b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:19.211286 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:19.211879 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07539341-d5a3-4cb0-acad-dcce288d012b None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:19.267225 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db185b40-743b-4622-9c00-337d20f17f19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:19.268753 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db185b40-743b-4622-9c00-337d20f17f19 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:19.353281 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 375/750] 10.222.0.62 () {56 vars in 1148 bytes} [Fri May 27 16:09:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:19.354502 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07539341-d5a3-4cb0-acad-dcce288d012b None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:19.380040 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 376/751] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 16:09:18 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 16:09:19.381009 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db185b40-743b-4622-9c00-337d20f17f19 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:19.450632 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:19.459091 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07539341-d5a3-4cb0-acad-dcce288d012b None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:19.487582 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db185b40-743b-4622-9c00-337d20f17f19 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:19.495846 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c499c4eb-cad2-4ad4-9ca5-3a8bbcba1181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:19.496894 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c499c4eb-cad2-4ad4-9ca5-3a8bbcba1181 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:19.497389 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c499c4eb-cad2-4ad4-9ca5-3a8bbcba1181 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:19.497902 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c499c4eb-cad2-4ad4-9ca5-3a8bbcba1181 None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:19.498861 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c499c4eb-cad2-4ad4-9ca5-3a8bbcba1181 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:19.499392 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c499c4eb-cad2-4ad4-9ca5-3a8bbcba1181 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:19.500960 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c499c4eb-cad2-4ad4-9ca5-3a8bbcba1181 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:19.517257 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 376/752] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 16:09:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:19.518475 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c499c4eb-cad2-4ad4-9ca5-3a8bbcba1181 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:19.524096 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74721ff2-2b5e-4ed4-8363-9b6b57992018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:19.524421 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74721ff2-2b5e-4ed4-8363-9b6b57992018 None admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:19.524751 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74721ff2-2b5e-4ed4-8363-9b6b57992018 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:19.525032 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74721ff2-2b5e-4ed4-8363-9b6b57992018 None admin] PATH_INFO: `/v3/projects/d48d95a12587479ca5714f6ebd60dd9f/users/cb13ad6d8b1e46029262556bff398796/roles/e04fe3eb1f714d74901ac83e33ea8a16` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:19.527199 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74721ff2-2b5e-4ed4-8363-9b6b57992018 None admin] RBAC: Authorizing `identity:create_grant(project_id=d48d95a12587479ca5714f6ebd60dd9f, user_id=cb13ad6d8b1e46029262556bff398796, role_id=e04fe3eb1f714d74901ac83e33ea8a16)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:19.528631 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74721ff2-2b5e-4ed4-8363-9b6b57992018 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:19.532629 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:19.634978 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 377/753] 10.222.0.62 () {58 vars in 1439 bytes} [Fri May 27 16:09:19 2022] PUT /identity/v3/projects/d48d95a12587479ca5714f6ebd60dd9f/users/cb13ad6d8b1e46029262556bff398796/roles/e04fe3eb1f714d74901ac83e33ea8a16 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:09:19.642282 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74721ff2-2b5e-4ed4-8363-9b6b57992018 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:19.642480 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c499c4eb-cad2-4ad4-9ca5-3a8bbcba1181 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:19.723310 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906a5acb-f4da-4058-a67c-2eb0d67c7bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:19.724152 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a5acb-f4da-4058-a67c-2eb0d67c7bf9 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:19.724444 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a5acb-f4da-4058-a67c-2eb0d67c7bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:19.724768 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a5acb-f4da-4058-a67c-2eb0d67c7bf9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:19.738390 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906a5acb-f4da-4058-a67c-2eb0d67c7bf9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:19.739881 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906a5acb-f4da-4058-a67c-2eb0d67c7bf9 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:19.762896 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-906a5acb-f4da-4058-a67c-2eb0d67c7bf9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:19.762896 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:19.762896 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:19.762896 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:19.762896 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:19.762896 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:19.762896 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:19.762896 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:19.762896 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:19.762896 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:19.762896 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:19.762896 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:19.762896 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:09:19.762896 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:09:19.762896 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:09:19.763889 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:09:19.763889 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:19.763889 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:19.763889 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:19.763889 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:19.763889 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:19.763889 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:19.763889 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:19.763889 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:09:19.763889 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:19.763889 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:19.763889 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:19.763889 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:19.763889 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:19.763889 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:19.763889 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:19.763889 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:19.764788 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:09:19.764788 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:09:19.764788 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:19.764788 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:19.764788 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 377/754] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:09:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:19.771780 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906a5acb-f4da-4058-a67c-2eb0d67c7bf9 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:19.843301 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:19.894838 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74721ff2-2b5e-4ed4-8363-9b6b57992018 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:19.903265 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906a5acb-f4da-4058-a67c-2eb0d67c7bf9 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:19.938436 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:19.960113 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b5506d-6691-437a-ace0-7125eacd2c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:19.961152 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b5506d-6691-437a-ace0-7125eacd2c62 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:19.961265 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b5506d-6691-437a-ace0-7125eacd2c62 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:19.961497 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b5506d-6691-437a-ace0-7125eacd2c62 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:19.979306 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b5506d-6691-437a-ace0-7125eacd2c62 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:19.980773 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b5506d-6691-437a-ace0-7125eacd2c62 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:19.984805 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8453f366-0d72-4e9b-ac8f-c8f4b09ec8a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:19.985458 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8453f366-0d72-4e9b-ac8f-c8f4b09ec8a2 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:19.985746 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8453f366-0d72-4e9b-ac8f-c8f4b09ec8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:19.988683 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8453f366-0d72-4e9b-ac8f-c8f4b09ec8a2 None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:19.988683 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8453f366-0d72-4e9b-ac8f-c8f4b09ec8a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:19.988683 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8453f366-0d72-4e9b-ac8f-c8f4b09ec8a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:19.988683 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8453f366-0d72-4e9b-ac8f-c8f4b09ec8a2 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:20.013333 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-32b5506d-6691-437a-ace0-7125eacd2c62 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 16:09:20.013333 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:20.013333 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:20.013333 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:20.013333 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:20.013333 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:20.013333 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:20.013333 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:20.013333 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:20.013333 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:20.013333 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:20.013333 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:20.013333 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 16:09:20.013333 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 16:09:20.013333 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 16:09:20.013333 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 16:09:20.014409 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:20.014409 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:20.014409 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 16:09:20.014409 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:09:20.014409 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 16:09:20.014409 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:09:20.014409 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:20.014409 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:20.014409 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:20.014409 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:20.014409 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:20.014409 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:09:20.014409 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:20.014409 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:20.014409 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:20.014409 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:20.014409 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:20.014409 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:20.015446 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:20.015446 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:20.015446 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 16:09:20.015446 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 16:09:20.015446 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 16:09:20.015446 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 16:09:20.015446 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 16:09:20.015446 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 16:09:20.015446 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 16:09:20.015446 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:20.020976 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 378/755] 10.222.0.62 () {56 vars in 1117 bytes} [Fri May 27 16:09:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 385 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:20.023646 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 378/756] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 16:09:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:20.024314 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b5506d-6691-437a-ace0-7125eacd2c62 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:20.031198 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8453f366-0d72-4e9b-ac8f-c8f4b09ec8a2 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:20.223490 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b5506d-6691-437a-ace0-7125eacd2c62 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:20.277208 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09471187-ba5b-4f53-a82e-9b00d41230d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:20.277923 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09471187-ba5b-4f53-a82e-9b00d41230d8 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:20.278303 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09471187-ba5b-4f53-a82e-9b00d41230d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:20.278828 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09471187-ba5b-4f53-a82e-9b00d41230d8 None admin] PATH_INFO: `/v3/users` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:20.279445 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09471187-ba5b-4f53-a82e-9b00d41230d8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:20.279763 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09471187-ba5b-4f53-a82e-9b00d41230d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:20.281276 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09471187-ba5b-4f53-a82e-9b00d41230d8 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:20.310230 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 379/757] 10.222.0.62 () {56 vars in 1149 bytes} [Fri May 27 16:09:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:20.319523 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09471187-ba5b-4f53-a82e-9b00d41230d8 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:20.365727 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8453f366-0d72-4e9b-ac8f-c8f4b09ec8a2 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:20.410864 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:20.431583 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:20.469574 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df8b6bb-60c0-4dab-a463-5cf99f937c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:20.473587 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8b6bb-60c0-4dab-a463-5cf99f937c5a None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:20.474070 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8b6bb-60c0-4dab-a463-5cf99f937c5a None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:20.474408 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8b6bb-60c0-4dab-a463-5cf99f937c5a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:20.498868 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df8b6bb-60c0-4dab-a463-5cf99f937c5a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:20.500343 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df8b6bb-60c0-4dab-a463-5cf99f937c5a None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:20.530452 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-6df8b6bb-60c0-4dab-a463-5cf99f937c5a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:09:20.530452 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:20.530452 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:20.530452 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:20.530452 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:20.530452 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:20.530452 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:20.530452 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:20.530452 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:20.530452 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:20.530452 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:20.530452 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:20.530452 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 16:09:20.530452 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 16:09:20.530452 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 16:09:20.531405 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 16:09:20.531405 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:20.531405 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:20.531405 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:20.531405 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:20.531405 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:20.531405 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:20.531405 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:20.531405 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:09:20.531405 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:20.531405 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:20.531405 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:20.531405 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:20.531405 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:20.531405 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:20.531405 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:20.531405 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:20.532305 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 16:09:20.532305 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 16:09:20.532305 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 16:09:20.532305 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 16:09:20.532305 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 16:09:20.532305 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 16:09:20.532305 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:09:20.532305 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:20.532305 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 379/758] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 16:09:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 501 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:20.549074 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df8b6bb-60c0-4dab-a463-5cf99f937c5a None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:20.589020 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09471187-ba5b-4f53-a82e-9b00d41230d8 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:20.679876 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d5682a-9a87-4cc6-84db-667b6d8da748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:20.680554 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d5682a-9a87-4cc6-84db-667b6d8da748 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:20.680840 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d5682a-9a87-4cc6-84db-667b6d8da748 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:20.681120 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d5682a-9a87-4cc6-84db-667b6d8da748 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:20.782119 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df8b6bb-60c0-4dab-a463-5cf99f937c5a None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:20.826572 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d5682a-9a87-4cc6-84db-667b6d8da748 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:20.828050 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d5682a-9a87-4cc6-84db-667b6d8da748 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:20.851894 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4914fcc4-dabe-4fa2-bbe7-9c63fabc460f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:20.852574 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4914fcc4-dabe-4fa2-bbe7-9c63fabc460f None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:20.852860 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4914fcc4-dabe-4fa2-bbe7-9c63fabc460f None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:20.853147 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4914fcc4-dabe-4fa2-bbe7-9c63fabc460f None admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:20.853943 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4914fcc4-dabe-4fa2-bbe7-9c63fabc460f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:20.854273 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4914fcc4-dabe-4fa2-bbe7-9c63fabc460f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:20.855878 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4914fcc4-dabe-4fa2-bbe7-9c63fabc460f None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:20.868563 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 380/759] 10.222.0.62 () {56 vars in 1148 bytes} [Fri May 27 16:09:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:20.874433 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4914fcc4-dabe-4fa2-bbe7-9c63fabc460f None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:20.918095 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:20.922632 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:20.962098 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 380/760] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 16:09:20 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 643 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 27 16:09:20.963546 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0bf98a-76ec-4b9b-973a-146fc86af566 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:20.963841 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0bf98a-76ec-4b9b-973a-146fc86af566 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:20.964120 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0bf98a-76ec-4b9b-973a-146fc86af566 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:20.966150 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 381/761] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:09:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:09:20.969012 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0bf98a-76ec-4b9b-973a-146fc86af566 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:20.986675 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4914fcc4-dabe-4fa2-bbe7-9c63fabc460f None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:21.024613 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20af3b39-7266-42e6-b655-f914f036942f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:21.025541 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af3b39-7266-42e6-b655-f914f036942f None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:21.025834 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af3b39-7266-42e6-b655-f914f036942f None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:21.026119 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af3b39-7266-42e6-b655-f914f036942f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:21.027152 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20af3b39-7266-42e6-b655-f914f036942f None admin] RBAC: Adding query filter params (role.id=e04fe3eb1f714d74901ac83e33ea8a16, scope.project.id=d48d95a12587479ca5714f6ebd60dd9f, user.id=e8e6ec55445045fcac5623b9b6ffa9ab) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:21.027763 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20af3b39-7266-42e6-b655-f914f036942f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:21.029207 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20af3b39-7266-42e6-b655-f914f036942f None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:21.038415 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 381/762] 10.222.0.62 () {56 vars in 1374 bytes} [Fri May 27 16:09:20 2022] GET /identity/v3/role_assignments?user.id=e8e6ec55445045fcac5623b9b6ffa9ab&scope.project.id=d48d95a12587479ca5714f6ebd60dd9f&role.id=e04fe3eb1f714d74901ac83e33ea8a16 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:09:21.039710 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8631fd78-1ffa-4539-aeea-1594104acf38 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:21.040000 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8631fd78-1ffa-4539-aeea-1594104acf38 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:21.040281 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8631fd78-1ffa-4539-aeea-1594104acf38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:21.077161 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-8631fd78-1ffa-4539-aeea-1594104acf38 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:09:21.080637 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-8631fd78-1ffa-4539-aeea-1594104acf38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:09:21.117862 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0bf98a-76ec-4b9b-973a-146fc86af566 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:21.159473 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f31768d-b5f1-4426-a674-a7c57811b372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:21.160368 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f31768d-b5f1-4426-a674-a7c57811b372 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:21.160659 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f31768d-b5f1-4426-a674-a7c57811b372 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:21.160934 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f31768d-b5f1-4426-a674-a7c57811b372 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:21.163383 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:21.177219 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f31768d-b5f1-4426-a674-a7c57811b372 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:21.177219 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f31768d-b5f1-4426-a674-a7c57811b372 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:21.201392 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-0f31768d-b5f1-4426-a674-a7c57811b372 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:21.201392 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:21.201392 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:21.201392 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:21.201392 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:21.201392 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:21.201392 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:21.201392 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:21.201392 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:21.201392 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:21.201392 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:21.201392 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:21.201392 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:09:21.201392 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:09:21.201392 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:09:21.203541 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:09:21.203541 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:21.203541 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:21.203541 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:21.203541 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:21.203541 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:21.203541 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:21.203541 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:21.203541 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:09:21.203541 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:21.203541 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:21.203541 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:21.203541 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:21.203541 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:21.203541 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:21.203541 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:21.203541 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:21.205691 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:09:21.205691 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:09:21.205691 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:21.205691 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:21.205691 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 382/763] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:09:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:09:21.211567 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f31768d-b5f1-4426-a674-a7c57811b372 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:21.262912 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 382/764] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:09:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:09:21.297328 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8631fd78-1ffa-4539-aeea-1594104acf38 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:21.360069 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:21.411436 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f31768d-b5f1-4426-a674-a7c57811b372 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:21.482701 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628643a5-05cb-4967-ae2a-b9fa90d94656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:21.483369 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628643a5-05cb-4967-ae2a-b9fa90d94656 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:21.483652 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628643a5-05cb-4967-ae2a-b9fa90d94656 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:21.483928 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628643a5-05cb-4967-ae2a-b9fa90d94656 None admin] PATH_INFO: `/v3/domains` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:21.484654 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628643a5-05cb-4967-ae2a-b9fa90d94656 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:21.484959 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628643a5-05cb-4967-ae2a-b9fa90d94656 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:21.486355 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628643a5-05cb-4967-ae2a-b9fa90d94656 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:21.491820 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8631fd78-1ffa-4539-aeea-1594104acf38 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:21.514165 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 383/765] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 16:09:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:09:21.520114 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628643a5-05cb-4967-ae2a-b9fa90d94656 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:21.545075 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c531502-da7e-47dd-a068-95f916198442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:21.545915 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c531502-da7e-47dd-a068-95f916198442 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:21.546202 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c531502-da7e-47dd-a068-95f916198442 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:21.546502 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c531502-da7e-47dd-a068-95f916198442 None admin] PATH_INFO: `/v3/services/network` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:21.547159 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c531502-da7e-47dd-a068-95f916198442 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:21.548589 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c531502-da7e-47dd-a068-95f916198442 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:21.560856 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-0c531502-da7e-47dd-a068-95f916198442 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 27 16:09:21.560856 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:21.560856 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 16:09:21.560856 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 16:09:21.560856 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 16:09:21.560856 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 16:09:21.560856 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 16:09:21.560856 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:09:21.560856 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 27 16:09:21.560856 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:21.560856 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 16:09:21.560856 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:21.560856 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:21.560856 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:21.560856 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:21.560856 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:21.560856 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:21.562120 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:21.562120 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:21.562120 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:21.562120 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:21.562120 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:21.562120 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:21.562120 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 16:09:21.562120 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 16:09:21.562120 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 16:09:21.562120 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 16:09:21.562120 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:21.562120 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:21.562120 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:21.562120 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:21.562120 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:21.562120 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:21.563009 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:21.563009 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:09:21.563009 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:21.563009 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:21.563009 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:21.563009 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:21.563009 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:21.563009 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:21.563009 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:21.563009 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:21.563009 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 16:09:21.563009 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:09:21.563009 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 27 16:09:21.563009 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:21.567041 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 383/766] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 16:09:21 2022] GET /identity/v3/services/network => generated 88 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:09:21.568942 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94e32a-68ba-4536-9dd3-0a3d8d73eb53 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:21.569238 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94e32a-68ba-4536-9dd3-0a3d8d73eb53 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:21.569517 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94e32a-68ba-4536-9dd3-0a3d8d73eb53 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:21.571124 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 384/767] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:09:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:09:21.571848 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a94e32a-68ba-4536-9dd3-0a3d8d73eb53 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:21.598765 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:21.659887 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628643a5-05cb-4967-ae2a-b9fa90d94656 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:21.683871 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:21.689010 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a94e32a-68ba-4536-9dd3-0a3d8d73eb53 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:21.707255 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24ff364-7cea-40f6-b0fc-7add71ae9cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:21.708333 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ff364-7cea-40f6-b0fc-7add71ae9cbb None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:21.708623 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ff364-7cea-40f6-b0fc-7add71ae9cbb None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:21.708971 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ff364-7cea-40f6-b0fc-7add71ae9cbb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:21.718367 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24ff364-7cea-40f6-b0fc-7add71ae9cbb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:21.720146 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24ff364-7cea-40f6-b0fc-7add71ae9cbb None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:21.732741 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94059444-ac77-49dd-8a1c-4b1515b6f34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:21.733401 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94059444-ac77-49dd-8a1c-4b1515b6f34b None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:21.733684 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94059444-ac77-49dd-8a1c-4b1515b6f34b None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:21.734016 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94059444-ac77-49dd-8a1c-4b1515b6f34b None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:21.734818 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94059444-ac77-49dd-8a1c-4b1515b6f34b None admin] RBAC: Adding query filter params (name=network) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:21.735127 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94059444-ac77-49dd-8a1c-4b1515b6f34b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:21.736479 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94059444-ac77-49dd-8a1c-4b1515b6f34b None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:21.745485 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 385/768] 10.222.0.62 () {56 vars in 1112 bytes} [Fri May 27 16:09:21 2022] GET /identity/v3/services?name=network => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:21.745485 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b5e38-029e-4de6-aace-f12358a0a375 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:21.745485 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b5e38-029e-4de6-aace-f12358a0a375 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:21.745485 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b5e38-029e-4de6-aace-f12358a0a375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:21.746690 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-f24ff364-7cea-40f6-b0fc-7add71ae9cbb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:09:21.746690 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:21.746690 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:21.746690 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:21.746690 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:21.746690 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:21.746690 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:21.746690 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:21.746690 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:21.746690 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:21.746690 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:21.746690 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:21.746690 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 16:09:21.746690 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 16:09:21.746690 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 16:09:21.747609 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 16:09:21.747609 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:21.747609 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:21.747609 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:21.747609 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:21.747609 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:21.747609 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:21.747609 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:21.747609 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:09:21.747609 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:21.747609 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:21.747609 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:21.747609 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:21.747609 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:21.747609 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:21.747609 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:21.747609 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:21.748510 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 16:09:21.748510 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 16:09:21.748510 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 16:09:21.748510 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 16:09:21.748510 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 16:09:21.748510 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 16:09:21.748510 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:09:21.748510 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:21.750726 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 384/769] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 16:09:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:21.751689 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24ff364-7cea-40f6-b0fc-7add71ae9cbb None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:21.765185 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-900b5e38-029e-4de6-aace-f12358a0a375 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:09:21.767066 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-900b5e38-029e-4de6-aace-f12358a0a375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:09:21.862583 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 386/770] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:09:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:09:21.863737 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b5e38-029e-4de6-aace-f12358a0a375 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:21.873211 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24ff364-7cea-40f6-b0fc-7add71ae9cbb None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:21.890673 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:21.913794 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d349c28-1574-4ecf-bc63-967f142e4123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:21.914628 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d349c28-1574-4ecf-bc63-967f142e4123 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:21.915221 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d349c28-1574-4ecf-bc63-967f142e4123 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:21.915576 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d349c28-1574-4ecf-bc63-967f142e4123 None admin] PATH_INFO: `/v3/services` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:21.916435 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d349c28-1574-4ecf-bc63-967f142e4123 None admin] RBAC: Adding query filter params (type=network) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:21.916975 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d349c28-1574-4ecf-bc63-967f142e4123 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:21.919189 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d349c28-1574-4ecf-bc63-967f142e4123 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:21.934398 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 385/771] 10.222.0.62 () {56 vars in 1112 bytes} [Fri May 27 16:09:21 2022] GET /identity/v3/services?type=network => generated 350 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:21.934398 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d349c28-1574-4ecf-bc63-967f142e4123 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:21.998861 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:22.010219 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b5e38-029e-4de6-aace-f12358a0a375 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:22.050896 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d349c28-1574-4ecf-bc63-967f142e4123 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:22.053295 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8617cf-4b00-403b-bf36-855ada21437b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:22.054133 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8617cf-4b00-403b-bf36-855ada21437b None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:22.054524 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8617cf-4b00-403b-bf36-855ada21437b None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:22.054876 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8617cf-4b00-403b-bf36-855ada21437b None admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:22.056532 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8617cf-4b00-403b-bf36-855ada21437b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:22.056921 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8617cf-4b00-403b-bf36-855ada21437b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:22.058472 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8617cf-4b00-403b-bf36-855ada21437b None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:22.077677 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 387/772] 10.222.0.62 () {56 vars in 1148 bytes} [Fri May 27 16:09:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:22.077677 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8617cf-4b00-403b-bf36-855ada21437b None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:22.102195 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0097ca-a06b-498c-8620-ca46ce7efbb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:22.103679 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0097ca-a06b-498c-8620-ca46ce7efbb7 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:22.104073 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0097ca-a06b-498c-8620-ca46ce7efbb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:22.104460 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0097ca-a06b-498c-8620-ca46ce7efbb7 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:22.105579 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0097ca-a06b-498c-8620-ca46ce7efbb7 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:22.107668 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0097ca-a06b-498c-8620-ca46ce7efbb7 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:22.123858 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-6c0097ca-a06b-498c-8620-ca46ce7efbb7 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 16:09:22.123858 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:22.123858 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 16:09:22.123858 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 16:09:22.123858 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 16:09:22.123858 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 16:09:22.123858 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 16:09:22.123858 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:09:22.123858 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 16:09:22.123858 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:22.123858 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 16:09:22.123858 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:22.123858 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:22.123858 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:22.123858 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:22.123858 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:22.124821 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:22.124821 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:22.124821 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:22.124821 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:22.124821 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:22.124821 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:22.124821 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:22.124821 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 16:09:22.124821 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 16:09:22.124821 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 16:09:22.124821 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 16:09:22.124821 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:22.124821 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:22.124821 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:22.124821 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:22.124821 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:22.125672 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:22.125672 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:22.125672 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:09:22.125672 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:22.125672 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:22.125672 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:22.125672 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:22.125672 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:22.125672 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:22.125672 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:22.125672 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:22.125672 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 16:09:22.125672 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:09:22.125672 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 16:09:22.125672 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:22.130327 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 386/773] 10.222.0.62 () {56 vars in 1129 bytes} [Fri May 27 16:09:21 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:22.133142 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0097ca-a06b-498c-8620-ca46ce7efbb7 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:22.172259 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:22.191215 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8617cf-4b00-403b-bf36-855ada21437b None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:22.226010 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194052f0-9bb8-4e97-9896-2d41648db238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:22.226705 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194052f0-9bb8-4e97-9896-2d41648db238 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:22.226998 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194052f0-9bb8-4e97-9896-2d41648db238 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:22.227277 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194052f0-9bb8-4e97-9896-2d41648db238 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:22.228070 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194052f0-9bb8-4e97-9896-2d41648db238 None admin] RBAC: Adding query filter params (interface=public, service_id=00ebf731119940768cc34c0e9d3f2718, region_id=RegionOne) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:22.228395 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194052f0-9bb8-4e97-9896-2d41648db238 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:22.229740 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194052f0-9bb8-4e97-9896-2d41648db238 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:22.237105 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 388/774] 10.222.0.62 () {56 vars in 1251 bytes} [Fri May 27 16:09:22 2022] GET /identity/v3/endpoints?service_id=00ebf731119940768cc34c0e9d3f2718&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:22.237903 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194052f0-9bb8-4e97-9896-2d41648db238 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:22.252211 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0097ca-a06b-498c-8620-ca46ce7efbb7 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:22.259405 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:22.295178 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f07c3ab-d173-45cb-98fb-9faab41f3ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:22.295839 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07c3ab-d173-45cb-98fb-9faab41f3ff7 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:22.296132 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07c3ab-d173-45cb-98fb-9faab41f3ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:22.296425 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07c3ab-d173-45cb-98fb-9faab41f3ff7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:22.297693 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f07c3ab-d173-45cb-98fb-9faab41f3ff7 None admin] RBAC: Adding query filter params (role.id=1d9076bd231c43809cb971b6360e0c28, scope.project.id=d48d95a12587479ca5714f6ebd60dd9f, user.id=eb50bf5f39b04ab689b55f46d3dd2640) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:22.298014 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f07c3ab-d173-45cb-98fb-9faab41f3ff7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:22.299637 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f07c3ab-d173-45cb-98fb-9faab41f3ff7 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:22.306308 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 387/775] 10.222.0.62 () {56 vars in 1374 bytes} [Fri May 27 16:09:22 2022] GET /identity/v3/role_assignments?user.id=eb50bf5f39b04ab689b55f46d3dd2640&scope.project.id=d48d95a12587479ca5714f6ebd60dd9f&role.id=1d9076bd231c43809cb971b6360e0c28 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:22.307285 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6008e9b-61fc-4a7e-85bc-a0fa9e598ae1 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:22.307583 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6008e9b-61fc-4a7e-85bc-a0fa9e598ae1 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:22.307862 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6008e9b-61fc-4a7e-85bc-a0fa9e598ae1 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:22.310384 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 388/776] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:09:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:09:22.310384 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6008e9b-61fc-4a7e-85bc-a0fa9e598ae1 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:22.367096 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194052f0-9bb8-4e97-9896-2d41648db238 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:22.409059 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08106fd-bc8f-4b54-b5cb-8a43aaadda1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:22.409675 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08106fd-bc8f-4b54-b5cb-8a43aaadda1e None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:22.409937 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08106fd-bc8f-4b54-b5cb-8a43aaadda1e None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:22.410216 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08106fd-bc8f-4b54-b5cb-8a43aaadda1e None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:22.410972 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08106fd-bc8f-4b54-b5cb-8a43aaadda1e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:22.411283 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08106fd-bc8f-4b54-b5cb-8a43aaadda1e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:22.412747 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08106fd-bc8f-4b54-b5cb-8a43aaadda1e None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:22.418577 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 389/777] 10.222.0.62 () {56 vars in 1124 bytes} [Fri May 27 16:09:22 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:22.419912 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba710ba-2733-4e79-9f11-6e372ea9ba6d None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:22.420209 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba710ba-2733-4e79-9f11-6e372ea9ba6d None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:22.420495 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba710ba-2733-4e79-9f11-6e372ea9ba6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:22.442492 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-bba710ba-2733-4e79-9f11-6e372ea9ba6d None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:09:22.444575 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-bba710ba-2733-4e79-9f11-6e372ea9ba6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:09:22.453539 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:22.462086 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6008e9b-61fc-4a7e-85bc-a0fa9e598ae1 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:22.518425 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fe968d-4e9a-4337-80c3-decdccad6fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:22.519513 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe968d-4e9a-4337-80c3-decdccad6fce None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:22.519904 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe968d-4e9a-4337-80c3-decdccad6fce None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:22.520252 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe968d-4e9a-4337-80c3-decdccad6fce None admin] PATH_INFO: `/v3/services` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:22.522434 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fe968d-4e9a-4337-80c3-decdccad6fce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:22.524511 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fe968d-4e9a-4337-80c3-decdccad6fce None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:22.533435 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 390/779] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:09:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:09:22.534335 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba710ba-2733-4e79-9f11-6e372ea9ba6d None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:22.536866 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 389/779] 10.222.0.62 () {56 vars in 1087 bytes} [Fri May 27 16:09:22 2022] GET /identity/v3/services => generated 772 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:22.552497 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:22.574407 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fe968d-4e9a-4337-80c3-decdccad6fce None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:22.731240 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba710ba-2733-4e79-9f11-6e372ea9ba6d None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:22.763650 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fe968d-4e9a-4337-80c3-decdccad6fce None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:22.784164 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476f3eed-e4cc-4a44-9729-70d6689afa2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:22.784842 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f3eed-e4cc-4a44-9729-70d6689afa2f None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:22.785129 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f3eed-e4cc-4a44-9729-70d6689afa2f None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:22.785410 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f3eed-e4cc-4a44-9729-70d6689afa2f None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:22.786729 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476f3eed-e4cc-4a44-9729-70d6689afa2f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:22.787102 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476f3eed-e4cc-4a44-9729-70d6689afa2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:22.788488 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476f3eed-e4cc-4a44-9729-70d6689afa2f None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:22.793982 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 391/780] 10.222.0.62 () {56 vars in 1124 bytes} [Fri May 27 16:09:22 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:22.803815 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476f3eed-e4cc-4a44-9729-70d6689afa2f None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:22.807065 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeed6108-c517-48bd-8b87-05e41ec3321d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:22.808083 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed6108-c517-48bd-8b87-05e41ec3321d None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:22.808506 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed6108-c517-48bd-8b87-05e41ec3321d None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:22.808975 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed6108-c517-48bd-8b87-05e41ec3321d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:22.821520 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeed6108-c517-48bd-8b87-05e41ec3321d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:09:22.830969 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-eeed6108-c517-48bd-8b87-05e41ec3321d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:09:22.830969 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:22.830969 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:22.830969 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:22.830969 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:22.830969 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:22.830969 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:22.830969 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:22.830969 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:22.830969 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:22.830969 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:22.830969 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:22.830969 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:09:22.830969 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:09:22.830969 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:09:22.830969 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:09:22.832007 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:09:22.832007 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:09:22.832007 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:09:22.832007 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:09:22.832007 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:22.832007 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:22.832007 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:22.832007 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:22.832007 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:22.832007 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:22.832007 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:22.832007 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:09:22.832007 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:22.832007 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:22.832007 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:22.832007 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:22.832877 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:22.832877 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:22.832877 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:22.832877 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:22.832877 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:09:22.832877 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:09:22.832877 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:09:22.832877 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:09:22.832877 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:09:22.832877 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:09:22.832877 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:09:22.832877 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:22.839354 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 390/781] 10.222.0.62 () {56 vars in 1096 bytes} [Fri May 27 16:09:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:09:22.842339 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeed6108-c517-48bd-8b87-05e41ec3321d None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:22.871007 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:22.948687 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:22.952805 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeed6108-c517-48bd-8b87-05e41ec3321d None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:22.993155 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f565c5e-262f-46f9-a32f-084b7949c716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:22.994259 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f565c5e-262f-46f9-a32f-084b7949c716 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:22.995843 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f565c5e-262f-46f9-a32f-084b7949c716 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:22.997154 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f565c5e-262f-46f9-a32f-084b7949c716 None admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:22.998774 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f565c5e-262f-46f9-a32f-084b7949c716 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:22.999390 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f565c5e-262f-46f9-a32f-084b7949c716 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:23.001946 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f565c5e-262f-46f9-a32f-084b7949c716 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:23.008253 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476f3eed-e4cc-4a44-9729-70d6689afa2f None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:23.027337 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 391/782] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 16:09:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:09:23.030692 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f565c5e-262f-46f9-a32f-084b7949c716 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:23.088130 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5c79ff-d438-46c6-a41e-fd919e79d5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:23.089809 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c79ff-d438-46c6-a41e-fd919e79d5be None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:23.090486 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c79ff-d438-46c6-a41e-fd919e79d5be None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:23.092097 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c79ff-d438-46c6-a41e-fd919e79d5be None admin] PATH_INFO: `/v3/endpoints` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:23.093242 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5c79ff-d438-46c6-a41e-fd919e79d5be None admin] RBAC: Adding query filter params (interface=public, service_id=655d4622f477426889eea9b2bad167b6, region_id=RegionOne) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:23.094648 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5c79ff-d438-46c6-a41e-fd919e79d5be None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:23.099243 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5c79ff-d438-46c6-a41e-fd919e79d5be None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:23.113008 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 392/783] 10.222.0.62 () {56 vars in 1251 bytes} [Fri May 27 16:09:22 2022] GET /identity/v3/endpoints?service_id=655d4622f477426889eea9b2bad167b6&interface=public®ion_id=RegionOne => generated 194 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:23.118645 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5c79ff-d438-46c6-a41e-fd919e79d5be None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:23.235514 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:23.264281 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f565c5e-262f-46f9-a32f-084b7949c716 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:23.293974 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5c79ff-d438-46c6-a41e-fd919e79d5be None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:23.305002 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9112a94-833d-4f7e-9f33-8d2b4212a4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:23.306089 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9112a94-833d-4f7e-9f33-8d2b4212a4bf None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:23.306537 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9112a94-833d-4f7e-9f33-8d2b4212a4bf None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:23.306956 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9112a94-833d-4f7e-9f33-8d2b4212a4bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:23.318149 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9112a94-833d-4f7e-9f33-8d2b4212a4bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:23.320572 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9112a94-833d-4f7e-9f33-8d2b4212a4bf None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:23.340139 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-b9112a94-833d-4f7e-9f33-8d2b4212a4bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:23.340139 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:23.340139 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:23.340139 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:23.340139 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:23.340139 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:23.340139 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:23.340139 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:23.340139 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:23.340139 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:23.340139 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:23.340139 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:23.340139 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:09:23.340139 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:09:23.340139 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:09:23.341277 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:09:23.341277 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:23.341277 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:23.341277 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:23.341277 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:23.341277 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:23.341277 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:23.341277 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:23.341277 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:09:23.341277 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:23.341277 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:23.341277 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:23.341277 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:23.341277 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:23.341277 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:23.341277 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:23.341277 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:23.342376 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:09:23.342376 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:09:23.342376 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:23.342376 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:23.348609 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 392/784] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:09:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:09:23.350175 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9112a94-833d-4f7e-9f33-8d2b4212a4bf None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:23.363557 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6cc2c4-09d5-456f-8f00-d251c5e675ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:23.364248 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6cc2c4-09d5-456f-8f00-d251c5e675ce None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:23.364541 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6cc2c4-09d5-456f-8f00-d251c5e675ce None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:23.364827 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6cc2c4-09d5-456f-8f00-d251c5e675ce None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:23.366044 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6cc2c4-09d5-456f-8f00-d251c5e675ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:23.367458 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6cc2c4-09d5-456f-8f00-d251c5e675ce None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:23.378751 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 393/785] 10.222.0.62 () {56 vars in 1087 bytes} [Fri May 27 16:09:23 2022] GET /identity/v3/services => generated 772 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:09:23.475278 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8749239-54ff-4cd9-b85d-5d641c65e479 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:23.475571 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8749239-54ff-4cd9-b85d-5d641c65e479 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:23.475857 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8749239-54ff-4cd9-b85d-5d641c65e479 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:23.477542 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 394/786] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:09:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 16:09:23.478946 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9112a94-833d-4f7e-9f33-8d2b4212a4bf None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:23.489713 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5feafa1-d7c5-44bc-948d-d1367a8a4722 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:23.490802 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5feafa1-d7c5-44bc-948d-d1367a8a4722 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:23.491268 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5feafa1-d7c5-44bc-948d-d1367a8a4722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:23.500566 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:23.524230 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-a5feafa1-d7c5-44bc-948d-d1367a8a4722 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:09:23.525404 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-a5feafa1-d7c5-44bc-948d-d1367a8a4722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:09:23.546311 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0db63f6-2dde-4141-a3b8-7a13ee714fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:23.547017 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db63f6-2dde-4141-a3b8-7a13ee714fe4 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:23.547310 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db63f6-2dde-4141-a3b8-7a13ee714fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:23.547596 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db63f6-2dde-4141-a3b8-7a13ee714fe4 None admin] PATH_INFO: `/v3/domains` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:23.548421 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0db63f6-2dde-4141-a3b8-7a13ee714fe4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:23.548738 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0db63f6-2dde-4141-a3b8-7a13ee714fe4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:23.550223 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0db63f6-2dde-4141-a3b8-7a13ee714fe4 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:23.565702 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:23.565970 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 393/787] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 16:09:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:09:23.573568 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0db63f6-2dde-4141-a3b8-7a13ee714fe4 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:23.646416 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 395/788] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:09:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 16:09:23.668021 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5feafa1-d7c5-44bc-948d-d1367a8a4722 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:23.692986 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0db63f6-2dde-4141-a3b8-7a13ee714fe4 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:23.731190 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba425bed-9043-4fc1-bdcd-28056b2ebad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:23.732087 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba425bed-9043-4fc1-bdcd-28056b2ebad4 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:23.732382 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba425bed-9043-4fc1-bdcd-28056b2ebad4 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:23.732666 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba425bed-9043-4fc1-bdcd-28056b2ebad4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:23.741287 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba425bed-9043-4fc1-bdcd-28056b2ebad4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:23.742881 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba425bed-9043-4fc1-bdcd-28056b2ebad4 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:23.759370 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-ba425bed-9043-4fc1-bdcd-28056b2ebad4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 16:09:23.759370 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:23.759370 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:23.759370 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:23.759370 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:23.759370 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:23.759370 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:23.759370 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:23.759370 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:23.759370 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:23.759370 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:23.759370 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:23.759370 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 16:09:23.759370 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 16:09:23.759370 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 16:09:23.759370 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 16:09:23.760575 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:23.760575 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:23.760575 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 16:09:23.760575 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:09:23.760575 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 16:09:23.760575 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:09:23.760575 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:23.760575 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:23.760575 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:23.760575 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:23.760575 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:23.760575 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:09:23.760575 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:23.760575 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:23.760575 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:23.760575 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:23.760575 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:23.760575 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:23.766320 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:23.766320 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:23.766320 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 16:09:23.766320 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 16:09:23.766320 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 16:09:23.766320 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 16:09:23.766320 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 16:09:23.766320 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 16:09:23.766320 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 16:09:23.766320 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:23.766320 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 394/789] 10.222.0.62 () {56 vars in 1093 bytes} [Fri May 27 16:09:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:23.768800 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba425bed-9043-4fc1-bdcd-28056b2ebad4 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:23.787674 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5feafa1-d7c5-44bc-948d-d1367a8a4722 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:23.825815 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a764424-776d-4b27-95ee-b891fb6b07f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:23.827223 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a764424-776d-4b27-95ee-b891fb6b07f7 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:23.828518 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a764424-776d-4b27-95ee-b891fb6b07f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:23.829102 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a764424-776d-4b27-95ee-b891fb6b07f7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:23.834553 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:23.849394 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a764424-776d-4b27-95ee-b891fb6b07f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:09:23.865722 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-7a764424-776d-4b27-95ee-b891fb6b07f7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:09:23.865722 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:23.865722 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:23.865722 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:23.865722 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:23.865722 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:23.865722 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:23.865722 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:23.865722 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:23.865722 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:23.865722 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:23.865722 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:23.865722 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:09:23.865722 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:09:23.865722 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:09:23.865722 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:09:23.866911 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:09:23.866911 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:09:23.866911 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:09:23.866911 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:09:23.866911 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:23.866911 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:23.866911 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:23.866911 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:23.866911 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:23.866911 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:23.866911 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:23.866911 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:09:23.866911 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:23.866911 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:23.866911 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:23.866911 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:23.867765 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:23.867765 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:23.867765 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:23.867765 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:23.867765 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:09:23.867765 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:09:23.867765 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:09:23.867765 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:09:23.867765 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:09:23.867765 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:09:23.867765 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:09:23.867765 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:23.873002 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 396/790] 10.222.0.62 () {56 vars in 1096 bytes} [Fri May 27 16:09:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:23.875379 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:23.876997 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a764424-776d-4b27-95ee-b891fb6b07f7 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:23.964011 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba425bed-9043-4fc1-bdcd-28056b2ebad4 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:24.033377 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5d438b-4e5a-43da-b522-03e940b3c77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:24.034061 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d438b-4e5a-43da-b522-03e940b3c77e None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:24.034374 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d438b-4e5a-43da-b522-03e940b3c77e None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:24.034654 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d438b-4e5a-43da-b522-03e940b3c77e None admin] PATH_INFO: `/v3/users` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:24.035494 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5d438b-4e5a-43da-b522-03e940b3c77e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:24.035802 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5d438b-4e5a-43da-b522-03e940b3c77e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:24.037346 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5d438b-4e5a-43da-b522-03e940b3c77e None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:24.075423 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 395/791] 10.222.0.62 () {56 vars in 1133 bytes} [Fri May 27 16:09:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:09:24.077298 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a764424-776d-4b27-95ee-b891fb6b07f7 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:24.080146 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5d438b-4e5a-43da-b522-03e940b3c77e None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:24.138847 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1f21a6-2af8-45ce-84c5-495efb79943f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:24.139723 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f21a6-2af8-45ce-84c5-495efb79943f None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:24.140020 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f21a6-2af8-45ce-84c5-495efb79943f None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:24.140302 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f21a6-2af8-45ce-84c5-495efb79943f None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:24.141060 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1f21a6-2af8-45ce-84c5-495efb79943f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:24.141376 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1f21a6-2af8-45ce-84c5-495efb79943f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:24.143395 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1f21a6-2af8-45ce-84c5-495efb79943f None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:24.153599 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 397/792] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 16:09:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:24.175933 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1f21a6-2af8-45ce-84c5-495efb79943f None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:24.224838 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5d438b-4e5a-43da-b522-03e940b3c77e None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:24.239772 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:24.261172 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41196be1-3603-47c7-9bd0-4153f25d9e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:24.261827 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41196be1-3603-47c7-9bd0-4153f25d9e02 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:24.262111 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41196be1-3603-47c7-9bd0-4153f25d9e02 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:24.262407 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41196be1-3603-47c7-9bd0-4153f25d9e02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:24.298587 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:24.335291 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41196be1-3603-47c7-9bd0-4153f25d9e02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:24.336666 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41196be1-3603-47c7-9bd0-4153f25d9e02 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:24.393240 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1f21a6-2af8-45ce-84c5-495efb79943f None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:24.440332 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 396/793] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 16:09:24 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 16:09:24.446505 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41196be1-3603-47c7-9bd0-4153f25d9e02 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:24.469016 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d41ce7-0d80-4b1c-8151-f22faac879be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:24.469813 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d41ce7-0d80-4b1c-8151-f22faac879be None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:24.470095 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d41ce7-0d80-4b1c-8151-f22faac879be None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:24.470418 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d41ce7-0d80-4b1c-8151-f22faac879be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:24.478602 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:24.493822 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d41ce7-0d80-4b1c-8151-f22faac879be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:24.495301 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d41ce7-0d80-4b1c-8151-f22faac879be None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:24.529902 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-83d41ce7-0d80-4b1c-8151-f22faac879be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:24.529902 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:24.529902 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:24.529902 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:24.529902 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:24.529902 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:24.529902 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:24.529902 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:24.529902 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:24.529902 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:24.529902 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:24.529902 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:24.529902 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:09:24.529902 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:09:24.529902 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:09:24.530922 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:09:24.530922 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:24.530922 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:24.530922 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:24.530922 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:24.530922 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:24.530922 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:24.530922 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:24.530922 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:09:24.530922 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:24.530922 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:24.530922 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:24.530922 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:24.530922 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:24.530922 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:24.530922 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:24.530922 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:24.531826 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:09:24.531826 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:09:24.531826 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:24.531826 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:24.531826 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 398/794] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:09:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:09:24.537285 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d41ce7-0d80-4b1c-8151-f22faac879be None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:24.594355 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41196be1-3603-47c7-9bd0-4153f25d9e02 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:24.625484 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d7c17e-f87c-4db7-8412-0f681d900ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:24.626307 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7c17e-f87c-4db7-8412-0f681d900ac1 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:24.626603 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7c17e-f87c-4db7-8412-0f681d900ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:24.626880 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7c17e-f87c-4db7-8412-0f681d900ac1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:24.637348 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d7c17e-f87c-4db7-8412-0f681d900ac1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:24.638913 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d7c17e-f87c-4db7-8412-0f681d900ac1 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:24.659661 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-75d7c17e-f87c-4db7-8412-0f681d900ac1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:24.659661 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:24.659661 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:24.659661 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:24.659661 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:24.659661 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:24.659661 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:24.659661 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:24.659661 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:24.659661 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:24.659661 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:24.659661 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:24.659661 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:09:24.659661 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:09:24.659661 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:09:24.660650 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:09:24.660650 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:24.660650 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:24.660650 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:24.660650 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:24.660650 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:24.660650 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:24.660650 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:24.660650 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:09:24.660650 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:24.660650 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:24.660650 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:24.660650 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:24.660650 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:24.660650 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:24.660650 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:24.660650 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:24.661550 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:09:24.661550 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:09:24.661550 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:24.661550 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:24.661550 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 397/795] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:09:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:09:24.671341 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d7c17e-f87c-4db7-8412-0f681d900ac1 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:24.727489 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d41ce7-0d80-4b1c-8151-f22faac879be None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:24.736688 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:24.767458 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52044504-4276-4dd5-ae41-d63561d55eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:24.768517 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52044504-4276-4dd5-ae41-d63561d55eff None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:24.769010 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52044504-4276-4dd5-ae41-d63561d55eff None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:24.769658 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52044504-4276-4dd5-ae41-d63561d55eff None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:24.770619 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52044504-4276-4dd5-ae41-d63561d55eff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:24.771691 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52044504-4276-4dd5-ae41-d63561d55eff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:24.773351 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52044504-4276-4dd5-ae41-d63561d55eff None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:24.788831 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 399/796] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 16:09:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:24.793762 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52044504-4276-4dd5-ae41-d63561d55eff None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:24.821139 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:24.891218 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d7c17e-f87c-4db7-8412-0f681d900ac1 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:24.944003 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0290452d-8f29-4f83-960c-bff77a25aa94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:24.944686 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0290452d-8f29-4f83-960c-bff77a25aa94 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:24.944975 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0290452d-8f29-4f83-960c-bff77a25aa94 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:24.945253 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0290452d-8f29-4f83-960c-bff77a25aa94 None admin] PATH_INFO: `/v3/domains` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:24.945988 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0290452d-8f29-4f83-960c-bff77a25aa94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:24.946333 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0290452d-8f29-4f83-960c-bff77a25aa94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:24.948292 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0290452d-8f29-4f83-960c-bff77a25aa94 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:24.966428 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 398/797] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 16:09:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:24.968317 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1144dd-8728-409b-baee-586562155ac3 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:24.969875 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1144dd-8728-409b-baee-586562155ac3 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:24.970133 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1144dd-8728-409b-baee-586562155ac3 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:24.971629 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 399/798] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:09:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:09:24.973257 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1144dd-8728-409b-baee-586562155ac3 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:24.977380 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52044504-4276-4dd5-ae41-d63561d55eff None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:25.023430 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a2357d-eacb-46d6-89c2-8523b5465f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:25.024322 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a2357d-eacb-46d6-89c2-8523b5465f9e None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:25.024606 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a2357d-eacb-46d6-89c2-8523b5465f9e None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:25.024880 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a2357d-eacb-46d6-89c2-8523b5465f9e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:25.034049 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a2357d-eacb-46d6-89c2-8523b5465f9e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:25.035675 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a2357d-eacb-46d6-89c2-8523b5465f9e None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:25.055415 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-50a2357d-eacb-46d6-89c2-8523b5465f9e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 27 16:09:25.055415 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:25.055415 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:25.055415 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:25.055415 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:25.055415 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:25.055415 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:25.055415 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:25.055415 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:25.055415 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:25.055415 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:25.055415 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:25.055415 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 16:09:25.055415 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 16:09:25.055415 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 16:09:25.055415 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 16:09:25.056415 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:25.056415 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:25.056415 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 16:09:25.056415 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:09:25.056415 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 16:09:25.056415 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:09:25.056415 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:25.056415 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:25.056415 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:25.056415 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:25.056415 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:25.056415 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:09:25.056415 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:25.056415 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:25.056415 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:25.056415 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:25.056415 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:25.056415 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:25.057352 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:25.057352 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:25.057352 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 16:09:25.057352 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 16:09:25.057352 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 16:09:25.057352 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 16:09:25.057352 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 16:09:25.057352 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 16:09:25.057352 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 27 16:09:25.057352 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:25.061591 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 400/799] 10.222.0.62 () {56 vars in 1096 bytes} [Fri May 27 16:09:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:25.063206 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfed7bc-7822-4a98-a641-6eec0f905300 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:25.063498 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfed7bc-7822-4a98-a641-6eec0f905300 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:25.063775 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfed7bc-7822-4a98-a641-6eec0f905300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:25.083249 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-8bfed7bc-7822-4a98-a641-6eec0f905300 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:09:25.084545 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-8bfed7bc-7822-4a98-a641-6eec0f905300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:09:25.106524 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:25.122065 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1144dd-8728-409b-baee-586562155ac3 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:25.148651 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:25.157405 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbadd3b-3d5c-4a74-9410-fc30c9a6e17e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:25.158358 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbadd3b-3d5c-4a74-9410-fc30c9a6e17e None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:25.158703 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbadd3b-3d5c-4a74-9410-fc30c9a6e17e None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:25.159046 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbadd3b-3d5c-4a74-9410-fc30c9a6e17e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:25.168371 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbadd3b-3d5c-4a74-9410-fc30c9a6e17e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:25.171205 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbadd3b-3d5c-4a74-9410-fc30c9a6e17e None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:25.175720 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 401/800] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:09:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:09:25.176720 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfed7bc-7822-4a98-a641-6eec0f905300 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:25.191497 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-4bbadd3b-3d5c-4a74-9410-fc30c9a6e17e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:09:25.191497 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:25.191497 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:25.191497 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:25.191497 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:25.191497 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:25.191497 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:25.191497 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:25.191497 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:25.191497 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:25.191497 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:25.191497 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:25.191497 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 16:09:25.191497 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 16:09:25.191497 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 16:09:25.192481 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 16:09:25.192481 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:25.192481 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:25.192481 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:25.192481 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:25.192481 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:25.192481 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:25.192481 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:25.192481 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:09:25.192481 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:25.192481 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:25.192481 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:25.192481 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:25.192481 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:25.192481 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:25.192481 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:25.192481 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:25.193431 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 16:09:25.193431 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 16:09:25.193431 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 16:09:25.193431 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 16:09:25.193431 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 16:09:25.193431 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 16:09:25.193431 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:09:25.193431 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:25.198326 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 400/801] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 16:09:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:25.199663 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae825b2b-5f4a-46ab-add4-69e611957f7d None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:25.199951 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae825b2b-5f4a-46ab-add4-69e611957f7d None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:25.200422 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae825b2b-5f4a-46ab-add4-69e611957f7d None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:25.201636 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 401/802] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:09:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:09:25.204022 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae825b2b-5f4a-46ab-add4-69e611957f7d None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:25.291094 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfed7bc-7822-4a98-a641-6eec0f905300 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:25.324493 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae825b2b-5f4a-46ab-add4-69e611957f7d None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:25.332585 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7658fe-4aec-41bf-942a-1e6680ea9bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:25.333269 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7658fe-4aec-41bf-942a-1e6680ea9bb1 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:25.333556 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7658fe-4aec-41bf-942a-1e6680ea9bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:25.334345 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7658fe-4aec-41bf-942a-1e6680ea9bb1 None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:25.335771 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7658fe-4aec-41bf-942a-1e6680ea9bb1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:25.336097 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7658fe-4aec-41bf-942a-1e6680ea9bb1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:25.338183 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7658fe-4aec-41bf-942a-1e6680ea9bb1 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:25.359952 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7276c0-a7f2-4385-9e3c-383f7a0b5e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:25.360745 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7276c0-a7f2-4385-9e3c-383f7a0b5e30 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:25.361034 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7276c0-a7f2-4385-9e3c-383f7a0b5e30 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:25.361311 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7276c0-a7f2-4385-9e3c-383f7a0b5e30 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:25.367156 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 402/803] 10.222.0.62 () {56 vars in 1135 bytes} [Fri May 27 16:09:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:25.367156 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7658fe-4aec-41bf-942a-1e6680ea9bb1 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:25.372837 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7276c0-a7f2-4385-9e3c-383f7a0b5e30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:09:25.380624 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-6a7276c0-a7f2-4385-9e3c-383f7a0b5e30 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 16:09:25.380624 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:25.380624 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:25.380624 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:25.380624 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:25.380624 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:25.380624 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:25.380624 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:25.380624 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:25.380624 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:25.380624 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:25.380624 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:25.380624 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:09:25.380624 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:09:25.380624 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:09:25.380624 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:09:25.381568 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:09:25.381568 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:09:25.381568 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:09:25.381568 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:09:25.381568 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:25.381568 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:25.381568 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:25.381568 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:25.381568 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:25.381568 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:25.381568 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:25.381568 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:09:25.381568 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:25.381568 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:25.381568 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:25.381568 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:25.382474 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:25.382474 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:25.382474 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:25.382474 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:25.382474 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:09:25.382474 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:09:25.382474 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:09:25.382474 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:09:25.382474 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:09:25.382474 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:09:25.382474 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 16:09:25.382474 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:25.382474 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 402/804] 10.222.0.62 () {56 vars in 1102 bytes} [Fri May 27 16:09:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:25.383218 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb00c02-a400-4e7e-b217-ecbad87a8e72 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:25.383924 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb00c02-a400-4e7e-b217-ecbad87a8e72 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:25.383924 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb00c02-a400-4e7e-b217-ecbad87a8e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:25.388082 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:25.400735 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-5eb00c02-a400-4e7e-b217-ecbad87a8e72 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:09:25.401995 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-5eb00c02-a400-4e7e-b217-ecbad87a8e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:09:25.449342 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:25.475277 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 403/805] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:09:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:09:25.476010 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb00c02-a400-4e7e-b217-ecbad87a8e72 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:25.487792 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7658fe-4aec-41bf-942a-1e6680ea9bb1 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:25.532467 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024de53a-74b2-4efb-83c0-688478f7f7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:25.533118 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024de53a-74b2-4efb-83c0-688478f7f7ff None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:25.533401 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024de53a-74b2-4efb-83c0-688478f7f7ff None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:25.533671 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024de53a-74b2-4efb-83c0-688478f7f7ff None admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:25.534470 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024de53a-74b2-4efb-83c0-688478f7f7ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:25.534774 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024de53a-74b2-4efb-83c0-688478f7f7ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:25.536190 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024de53a-74b2-4efb-83c0-688478f7f7ff None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:25.554474 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 403/806] 10.222.0.62 () {56 vars in 1148 bytes} [Fri May 27 16:09:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:25.554474 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024de53a-74b2-4efb-83c0-688478f7f7ff None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:25.587528 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb00c02-a400-4e7e-b217-ecbad87a8e72 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:25.623482 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8a0c58-2037-4b14-a428-87691845ae46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:25.624198 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a0c58-2037-4b14-a428-87691845ae46 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:25.624487 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a0c58-2037-4b14-a428-87691845ae46 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:25.624769 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a0c58-2037-4b14-a428-87691845ae46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:25.632886 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:25.636066 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8a0c58-2037-4b14-a428-87691845ae46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:25.637551 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8a0c58-2037-4b14-a428-87691845ae46 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:25.656661 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-ec8a0c58-2037-4b14-a428-87691845ae46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:25.656661 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:25.656661 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:25.656661 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:25.656661 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:25.656661 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:25.656661 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:25.656661 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:25.656661 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:25.656661 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:25.656661 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:25.656661 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:25.656661 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:09:25.656661 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:09:25.656661 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:09:25.657633 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:09:25.657633 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:25.657633 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:25.657633 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:25.657633 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:25.657633 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:25.657633 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:25.657633 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:25.657633 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:09:25.657633 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:25.657633 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:25.657633 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:25.657633 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:25.657633 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:25.657633 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:25.657633 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:25.657633 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:25.658558 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:09:25.658558 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:09:25.658558 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:25.658558 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:25.658558 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 404/807] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:09:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:25.658831 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8a0c58-2037-4b14-a428-87691845ae46 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:25.665900 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024de53a-74b2-4efb-83c0-688478f7f7ff None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:25.687978 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:25.701729 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d18da8-8175-46cf-a3f4-ca62f65012c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:25.702425 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d18da8-8175-46cf-a3f4-ca62f65012c6 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:25.702710 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d18da8-8175-46cf-a3f4-ca62f65012c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:25.702984 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d18da8-8175-46cf-a3f4-ca62f65012c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:25.703720 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d18da8-8175-46cf-a3f4-ca62f65012c6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:25.704036 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d18da8-8175-46cf-a3f4-ca62f65012c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:25.705393 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d18da8-8175-46cf-a3f4-ca62f65012c6 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:25.714801 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 404/808] 10.222.0.62 () {56 vars in 1103 bytes} [Fri May 27 16:09:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:25.715610 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d18da8-8175-46cf-a3f4-ca62f65012c6 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:25.767814 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8a0c58-2037-4b14-a428-87691845ae46 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:25.814728 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1ca6d3-6b28-4330-bf82-84e9d34149fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:25.815533 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1ca6d3-6b28-4330-bf82-84e9d34149fe None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:25.815822 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1ca6d3-6b28-4330-bf82-84e9d34149fe None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:25.816096 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1ca6d3-6b28-4330-bf82-84e9d34149fe None admin] PATH_INFO: `/v3/services/network` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:25.816750 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1ca6d3-6b28-4330-bf82-84e9d34149fe None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:25.818154 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1ca6d3-6b28-4330-bf82-84e9d34149fe None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:25.826826 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d18da8-8175-46cf-a3f4-ca62f65012c6 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:25.831684 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-3a1ca6d3-6b28-4330-bf82-84e9d34149fe None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 27 16:09:25.831684 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:25.831684 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 16:09:25.831684 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 16:09:25.831684 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 16:09:25.831684 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 16:09:25.831684 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 16:09:25.831684 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:09:25.831684 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 27 16:09:25.831684 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:25.831684 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 16:09:25.831684 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:25.831684 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:25.831684 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:25.831684 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:25.831684 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:25.831684 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:25.832675 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:25.832675 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:25.832675 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:25.832675 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:25.832675 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:25.832675 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:25.832675 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 16:09:25.832675 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 16:09:25.832675 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 16:09:25.832675 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 16:09:25.832675 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:25.832675 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:25.832675 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:25.832675 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:25.832675 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:25.832675 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:25.834066 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:25.834066 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:09:25.834066 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:25.834066 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:25.834066 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:25.834066 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:25.834066 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:25.834066 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:25.834066 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:25.834066 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:25.834066 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 16:09:25.834066 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:09:25.834066 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 27 16:09:25.834066 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:25.834066 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 405/809] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 16:09:25 2022] GET /identity/v3/services/network => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:25.834953 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1ca6d3-6b28-4330-bf82-84e9d34149fe None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:25.877238 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac2db63-6fbc-42ba-ba1f-e11122c8ac10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:25.877869 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac2db63-6fbc-42ba-ba1f-e11122c8ac10 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:25.878119 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac2db63-6fbc-42ba-ba1f-e11122c8ac10 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:25.878465 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac2db63-6fbc-42ba-ba1f-e11122c8ac10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:25.879319 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac2db63-6fbc-42ba-ba1f-e11122c8ac10 None admin] RBAC: Adding query filter params (role.id=e04fe3eb1f714d74901ac83e33ea8a16, scope.project.id=d48d95a12587479ca5714f6ebd60dd9f, user.id=cb13ad6d8b1e46029262556bff398796) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:25.879639 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac2db63-6fbc-42ba-ba1f-e11122c8ac10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:25.881675 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac2db63-6fbc-42ba-ba1f-e11122c8ac10 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:25.885515 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:25.889315 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 405/810] 10.222.0.62 () {56 vars in 1374 bytes} [Fri May 27 16:09:25 2022] GET /identity/v3/role_assignments?user.id=cb13ad6d8b1e46029262556bff398796&scope.project.id=d48d95a12587479ca5714f6ebd60dd9f&role.id=e04fe3eb1f714d74901ac83e33ea8a16 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:25.897828 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac2db63-6fbc-42ba-ba1f-e11122c8ac10 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:25.954434 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:25.971286 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1ca6d3-6b28-4330-bf82-84e9d34149fe None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:26.024319 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba7ff1a-7f34-46f9-9ffd-f12f4b4275c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:26.025727 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba7ff1a-7f34-46f9-9ffd-f12f4b4275c8 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:26.026737 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba7ff1a-7f34-46f9-9ffd-f12f4b4275c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:26.027261 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba7ff1a-7f34-46f9-9ffd-f12f4b4275c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:26.028493 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba7ff1a-7f34-46f9-9ffd-f12f4b4275c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:26.029235 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba7ff1a-7f34-46f9-9ffd-f12f4b4275c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:26.031654 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba7ff1a-7f34-46f9-9ffd-f12f4b4275c8 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:26.036388 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac2db63-6fbc-42ba-ba1f-e11122c8ac10 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:26.049365 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 406/811] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 16:09:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:26.050908 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba7ff1a-7f34-46f9-9ffd-f12f4b4275c8 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:26.084740 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b806c2-0961-4421-b075-d7bb09574ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:26.085649 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b806c2-0961-4421-b075-d7bb09574ac0 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:26.085860 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b806c2-0961-4421-b075-d7bb09574ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:26.086103 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b806c2-0961-4421-b075-d7bb09574ac0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:26.103106 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b806c2-0961-4421-b075-d7bb09574ac0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:26.104566 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b806c2-0961-4421-b075-d7bb09574ac0 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:26.121817 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-25b806c2-0961-4421-b075-d7bb09574ac0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:26.121817 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:26.121817 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:26.121817 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:26.121817 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:26.121817 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:26.121817 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:26.121817 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:26.121817 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:26.121817 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:26.121817 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:26.121817 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:26.121817 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:09:26.121817 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:09:26.121817 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:09:26.122841 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:09:26.122841 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:26.122841 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:26.122841 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:26.122841 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:26.122841 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:26.122841 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:26.122841 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:26.122841 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:09:26.122841 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:26.122841 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:26.122841 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:26.122841 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:26.122841 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:26.122841 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:26.122841 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:26.122841 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:26.123738 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:09:26.123738 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:09:26.123738 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:26.123738 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:26.123973 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 406/812] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:09:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:26.124837 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b806c2-0961-4421-b075-d7bb09574ac0 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:26.179707 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba7ff1a-7f34-46f9-9ffd-f12f4b4275c8 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:26.182497 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:26.215967 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026c7679-3e5d-4910-8bc4-4262c80f687f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:26.216636 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c7679-3e5d-4910-8bc4-4262c80f687f None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:26.216918 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c7679-3e5d-4910-8bc4-4262c80f687f None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:26.217198 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c7679-3e5d-4910-8bc4-4262c80f687f None admin] PATH_INFO: `/v3/services` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:26.217903 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026c7679-3e5d-4910-8bc4-4262c80f687f None admin] RBAC: Adding query filter params (name=network) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:26.218208 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026c7679-3e5d-4910-8bc4-4262c80f687f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:26.219668 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026c7679-3e5d-4910-8bc4-4262c80f687f None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:26.224791 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 407/813] 10.222.0.62 () {56 vars in 1112 bytes} [Fri May 27 16:09:26 2022] GET /identity/v3/services?name=network => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:26.224791 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c076c6-eb70-498b-8dd8-745834510d08 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:26.224791 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c076c6-eb70-498b-8dd8-745834510d08 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:26.224791 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c076c6-eb70-498b-8dd8-745834510d08 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:26.224791 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 408/814] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:09:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:09:26.224791 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c076c6-eb70-498b-8dd8-745834510d08 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:26.238161 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b806c2-0961-4421-b075-d7bb09574ac0 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:26.253736 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:26.274115 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3629f3a2-c5a9-405b-bdd9-79ba924890e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:26.274992 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629f3a2-c5a9-405b-bdd9-79ba924890e4 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:26.275273 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629f3a2-c5a9-405b-bdd9-79ba924890e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:26.275545 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629f3a2-c5a9-405b-bdd9-79ba924890e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:26.284233 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3629f3a2-c5a9-405b-bdd9-79ba924890e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:26.286197 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3629f3a2-c5a9-405b-bdd9-79ba924890e4 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:26.304990 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-3629f3a2-c5a9-405b-bdd9-79ba924890e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:09:26.304990 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:26.304990 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:26.304990 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:26.304990 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:26.304990 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:26.304990 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:26.304990 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:26.304990 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:26.304990 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:26.304990 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:26.304990 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:26.304990 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 16:09:26.304990 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 16:09:26.304990 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 16:09:26.305947 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 16:09:26.305947 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:26.305947 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:26.305947 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:26.305947 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:26.305947 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:26.305947 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:26.305947 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:26.305947 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:09:26.305947 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:26.305947 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:26.305947 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:26.305947 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:26.305947 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:26.305947 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:26.305947 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:26.305947 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:26.307342 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 16:09:26.307342 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 16:09:26.307342 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 16:09:26.307342 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 16:09:26.307342 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 16:09:26.307342 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 16:09:26.307342 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:09:26.307342 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:26.307342 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 407/815] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 16:09:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:26.307342 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3629f3a2-c5a9-405b-bdd9-79ba924890e4 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:26.349250 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c076c6-eb70-498b-8dd8-745834510d08 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:26.387545 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d56e3d9-6b9e-4834-afe4-2c14cfa7e003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:26.388217 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56e3d9-6b9e-4834-afe4-2c14cfa7e003 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:26.388501 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56e3d9-6b9e-4834-afe4-2c14cfa7e003 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:26.388778 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56e3d9-6b9e-4834-afe4-2c14cfa7e003 None admin] PATH_INFO: `/v3/domains` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:26.389504 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d56e3d9-6b9e-4834-afe4-2c14cfa7e003 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:26.389806 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d56e3d9-6b9e-4834-afe4-2c14cfa7e003 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:26.391218 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d56e3d9-6b9e-4834-afe4-2c14cfa7e003 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:26.408213 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 409/816] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 16:09:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:26.408213 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32cad52-157b-46f9-9904-3107b1e8dfd4 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:26.408213 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32cad52-157b-46f9-9904-3107b1e8dfd4 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:26.408213 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32cad52-157b-46f9-9904-3107b1e8dfd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:26.412497 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3629f3a2-c5a9-405b-bdd9-79ba924890e4 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:26.425297 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-d32cad52-157b-46f9-9904-3107b1e8dfd4 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:09:26.426796 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-d32cad52-157b-46f9-9904-3107b1e8dfd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:09:26.427767 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:26.448881 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86a3725-7aa5-437b-a122-b97ebb302c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:26.449509 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a3725-7aa5-437b-a122-b97ebb302c43 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:26.449801 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a3725-7aa5-437b-a122-b97ebb302c43 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:26.450080 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a3725-7aa5-437b-a122-b97ebb302c43 None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:26.450840 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86a3725-7aa5-437b-a122-b97ebb302c43 None admin] RBAC: Adding query filter params (type=network) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:26.451160 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86a3725-7aa5-437b-a122-b97ebb302c43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:26.452518 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86a3725-7aa5-437b-a122-b97ebb302c43 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:26.457463 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 408/817] 10.222.0.62 () {56 vars in 1112 bytes} [Fri May 27 16:09:26 2022] GET /identity/v3/services?type=network => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:26.458280 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86a3725-7aa5-437b-a122-b97ebb302c43 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:26.518288 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 410/818] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:09:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:09:26.518288 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32cad52-157b-46f9-9904-3107b1e8dfd4 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:26.528447 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:26.577503 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86a3725-7aa5-437b-a122-b97ebb302c43 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:26.612690 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d0ba6-8adf-4eb9-b547-a2add821d6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:26.613351 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d0ba6-8adf-4eb9-b547-a2add821d6e3 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:26.613639 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d0ba6-8adf-4eb9-b547-a2add821d6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:26.613921 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d0ba6-8adf-4eb9-b547-a2add821d6e3 None admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:26.614748 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372d0ba6-8adf-4eb9-b547-a2add821d6e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:26.615188 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372d0ba6-8adf-4eb9-b547-a2add821d6e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:26.616619 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372d0ba6-8adf-4eb9-b547-a2add821d6e3 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:26.623904 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32cad52-157b-46f9-9904-3107b1e8dfd4 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:26.634136 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 409/819] 10.222.0.62 () {56 vars in 1148 bytes} [Fri May 27 16:09:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:26.634136 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d0ba6-8adf-4eb9-b547-a2add821d6e3 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:26.659784 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9fa219-b499-4abf-aa03-bd9db691e032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:26.660600 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9fa219-b499-4abf-aa03-bd9db691e032 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:26.660887 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9fa219-b499-4abf-aa03-bd9db691e032 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:26.661168 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9fa219-b499-4abf-aa03-bd9db691e032 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:26.668536 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9fa219-b499-4abf-aa03-bd9db691e032 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:26.669981 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9fa219-b499-4abf-aa03-bd9db691e032 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:26.670210 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:26.686049 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-2a9fa219-b499-4abf-aa03-bd9db691e032 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 16:09:26.686049 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:26.686049 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:26.686049 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:26.686049 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:26.686049 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:26.686049 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:26.686049 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:26.686049 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:26.686049 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:26.686049 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:26.686049 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:26.686049 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 16:09:26.686049 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 16:09:26.686049 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 16:09:26.686049 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 16:09:26.687065 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:26.687065 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:26.687065 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 16:09:26.687065 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:09:26.687065 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 16:09:26.687065 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:09:26.687065 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:26.687065 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:26.687065 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:26.687065 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:26.687065 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:26.687065 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:09:26.687065 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:26.687065 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:26.687065 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:26.687065 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:26.687065 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:26.687065 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:26.692707 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:26.692707 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:26.692707 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 16:09:26.692707 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 16:09:26.692707 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 16:09:26.692707 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 16:09:26.692707 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 16:09:26.692707 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 16:09:26.692707 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 16:09:26.692707 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:26.692707 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 411/820] 10.222.0.62 () {56 vars in 1117 bytes} [Fri May 27 16:09:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:26.692707 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9fa219-b499-4abf-aa03-bd9db691e032 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:26.749860 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d0ba6-8adf-4eb9-b547-a2add821d6e3 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:26.758375 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:26.786000 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aca221-4536-4473-abc4-97d9d2b1a8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:26.787294 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aca221-4536-4473-abc4-97d9d2b1a8f0 None admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:26.787598 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aca221-4536-4473-abc4-97d9d2b1a8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:26.787878 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aca221-4536-4473-abc4-97d9d2b1a8f0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:26.788623 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aca221-4536-4473-abc4-97d9d2b1a8f0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:26.789983 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aca221-4536-4473-abc4-97d9d2b1a8f0 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:26.796380 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9fa219-b499-4abf-aa03-bd9db691e032 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:26.830396 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c102b82-ea40-4be1-8681-670eb9115394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:26.831208 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c102b82-ea40-4be1-8681-670eb9115394 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:26.831493 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c102b82-ea40-4be1-8681-670eb9115394 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:26.831771 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c102b82-ea40-4be1-8681-670eb9115394 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:26.832423 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c102b82-ea40-4be1-8681-670eb9115394 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:26.834435 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c102b82-ea40-4be1-8681-670eb9115394 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:26.846540 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-0c102b82-ea40-4be1-8681-670eb9115394 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 16:09:26.846540 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:26.846540 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 16:09:26.846540 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 16:09:26.846540 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 16:09:26.846540 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 16:09:26.846540 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 16:09:26.846540 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:09:26.846540 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 16:09:26.846540 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:26.846540 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 16:09:26.846540 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:26.846540 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:26.846540 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:26.846540 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:26.846540 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:26.850917 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:26.850917 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:26.850917 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:26.850917 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:26.850917 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:26.850917 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:26.850917 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:26.850917 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 16:09:26.850917 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 16:09:26.850917 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 16:09:26.850917 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 16:09:26.850917 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:26.850917 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:26.850917 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:26.850917 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:26.850917 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:26.851834 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:26.851834 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:26.851834 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:09:26.851834 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:26.851834 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:26.851834 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:26.851834 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:26.851834 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:26.851834 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:26.851834 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:26.851834 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:26.851834 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 16:09:26.851834 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:09:26.851834 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 16:09:26.851834 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:26.851834 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 412/821] 10.222.0.62 () {56 vars in 1129 bytes} [Fri May 27 16:09:26 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:26.852733 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c102b82-ea40-4be1-8681-670eb9115394 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:26.908845 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 410/822] 10.222.0.62 () {60 vars in 1144 bytes} [Fri May 27 16:09:26 2022] POST /identity/v3/endpoints => generated 327 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:09:26.909813 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aca221-4536-4473-abc4-97d9d2b1a8f0 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:26.983659 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c102b82-ea40-4be1-8681-670eb9115394 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:27.028865 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:27.030953 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:27.047631 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aca221-4536-4473-abc4-97d9d2b1a8f0 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:27.048516 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f0735-4464-4942-ac77-112ff93ffaa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:27.049938 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f0735-4464-4942-ac77-112ff93ffaa3 None admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:27.051914 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f0735-4464-4942-ac77-112ff93ffaa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:27.053016 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f0735-4464-4942-ac77-112ff93ffaa3 None admin] PATH_INFO: `/v3/projects/d48d95a12587479ca5714f6ebd60dd9f/users/e8e6ec55445045fcac5623b9b6ffa9ab/roles/e04fe3eb1f714d74901ac83e33ea8a16` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:27.055647 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70f0735-4464-4942-ac77-112ff93ffaa3 None admin] RBAC: Authorizing `identity:create_grant(project_id=d48d95a12587479ca5714f6ebd60dd9f, user_id=e8e6ec55445045fcac5623b9b6ffa9ab, role_id=e04fe3eb1f714d74901ac83e33ea8a16)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:27.058127 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70f0735-4464-4942-ac77-112ff93ffaa3 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:27.088328 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cc396a-2ca1-4f06-9e22-0e02f6ec6cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:27.089282 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc396a-2ca1-4f06-9e22-0e02f6ec6cbd None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:27.089646 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc396a-2ca1-4f06-9e22-0e02f6ec6cbd None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:27.089998 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc396a-2ca1-4f06-9e22-0e02f6ec6cbd None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:27.090962 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cc396a-2ca1-4f06-9e22-0e02f6ec6cbd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:27.091343 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cc396a-2ca1-4f06-9e22-0e02f6ec6cbd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:27.092872 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cc396a-2ca1-4f06-9e22-0e02f6ec6cbd None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:27.112544 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 411/823] 10.222.0.62 () {56 vars in 1149 bytes} [Fri May 27 16:09:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:27.113687 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cc396a-2ca1-4f06-9e22-0e02f6ec6cbd None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:27.138644 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 413/824] 10.222.0.62 () {58 vars in 1439 bytes} [Fri May 27 16:09:26 2022] PUT /identity/v3/projects/d48d95a12587479ca5714f6ebd60dd9f/users/e8e6ec55445045fcac5623b9b6ffa9ab/roles/e04fe3eb1f714d74901ac83e33ea8a16 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:09:27.140709 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f0735-4464-4942-ac77-112ff93ffaa3 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:27.249433 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cc396a-2ca1-4f06-9e22-0e02f6ec6cbd None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:27.295261 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f0735-4464-4942-ac77-112ff93ffaa3 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:27.304192 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971a21a8-f084-4462-9005-df33130baec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:27.305238 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a21a8-f084-4462-9005-df33130baec3 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:27.305728 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a21a8-f084-4462-9005-df33130baec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:27.306241 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a21a8-f084-4462-9005-df33130baec3 None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:27.307320 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971a21a8-f084-4462-9005-df33130baec3 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:27.307857 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971a21a8-f084-4462-9005-df33130baec3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:27.309691 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971a21a8-f084-4462-9005-df33130baec3 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:27.315930 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 412/825] 10.222.0.62 () {56 vars in 1124 bytes} [Fri May 27 16:09:27 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:27.321740 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971a21a8-f084-4462-9005-df33130baec3 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:27.338901 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:27.355958 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff217b-c949-4530-b6fd-da3f31177086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:27.357006 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff217b-c949-4530-b6fd-da3f31177086 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:27.357459 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff217b-c949-4530-b6fd-da3f31177086 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:27.357831 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff217b-c949-4530-b6fd-da3f31177086 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:27.370094 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ff217b-c949-4530-b6fd-da3f31177086 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:27.372348 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ff217b-c949-4530-b6fd-da3f31177086 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:27.391923 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-15ff217b-c949-4530-b6fd-da3f31177086 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:27.391923 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:27.391923 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:27.391923 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:27.391923 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:27.391923 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:27.391923 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:27.391923 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:27.391923 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:27.391923 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:27.391923 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:27.391923 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:27.391923 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:09:27.391923 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:09:27.391923 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:09:27.392905 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:09:27.392905 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:27.392905 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:27.392905 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:27.392905 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:27.392905 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:27.392905 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:27.392905 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:27.392905 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:09:27.392905 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:27.392905 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:27.392905 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:27.392905 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:27.392905 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:27.392905 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:27.392905 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:27.392905 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:27.393815 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:09:27.393815 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:09:27.393815 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:27.393815 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:27.393815 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 414/826] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:09:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:27.398866 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff217b-c949-4530-b6fd-da3f31177086 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:27.446734 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:27.452017 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971a21a8-f084-4462-9005-df33130baec3 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:27.488438 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a28360b-b31c-40ab-ba39-b518ec65e425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:27.488918 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a28360b-b31c-40ab-ba39-b518ec65e425 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:27.489365 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a28360b-b31c-40ab-ba39-b518ec65e425 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:27.489885 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a28360b-b31c-40ab-ba39-b518ec65e425 None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:27.491775 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a28360b-b31c-40ab-ba39-b518ec65e425 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:27.492272 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a28360b-b31c-40ab-ba39-b518ec65e425 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:27.493859 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a28360b-b31c-40ab-ba39-b518ec65e425 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:27.499822 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 413/827] 10.222.0.62 () {56 vars in 1124 bytes} [Fri May 27 16:09:27 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:09:27.505482 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a28360b-b31c-40ab-ba39-b518ec65e425 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:27.530213 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff217b-c949-4530-b6fd-da3f31177086 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:27.568446 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32948b3a-ff77-43d2-b103-d950a6999c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:27.569509 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32948b3a-ff77-43d2-b103-d950a6999c2f None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:27.569981 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32948b3a-ff77-43d2-b103-d950a6999c2f None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:27.570477 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32948b3a-ff77-43d2-b103-d950a6999c2f None admin] PATH_INFO: `/v3/domains` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:27.571376 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32948b3a-ff77-43d2-b103-d950a6999c2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:27.571857 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32948b3a-ff77-43d2-b103-d950a6999c2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:27.573436 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32948b3a-ff77-43d2-b103-d950a6999c2f None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:27.590375 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 415/828] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 16:09:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:09:27.592325 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32948b3a-ff77-43d2-b103-d950a6999c2f None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:27.606635 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:27.625450 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a28360b-b31c-40ab-ba39-b518ec65e425 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:27.672561 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280bf6ba-a854-4f7c-846d-c388ef0cc43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:27.673235 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280bf6ba-a854-4f7c-846d-c388ef0cc43a None admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:27.673525 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280bf6ba-a854-4f7c-846d-c388ef0cc43a None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:27.673807 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280bf6ba-a854-4f7c-846d-c388ef0cc43a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:27.674888 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280bf6ba-a854-4f7c-846d-c388ef0cc43a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:27.676780 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280bf6ba-a854-4f7c-846d-c388ef0cc43a None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:27.711602 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:27.716040 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32948b3a-ff77-43d2-b103-d950a6999c2f None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:27.763169 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d738dc-5526-4cf5-b8f5-8eab1fd8f471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:27.764008 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d738dc-5526-4cf5-b8f5-8eab1fd8f471 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:27.764298 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d738dc-5526-4cf5-b8f5-8eab1fd8f471 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:27.764574 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d738dc-5526-4cf5-b8f5-8eab1fd8f471 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:27.772324 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d738dc-5526-4cf5-b8f5-8eab1fd8f471 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:27.773767 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d738dc-5526-4cf5-b8f5-8eab1fd8f471 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:27.790293 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-67d738dc-5526-4cf5-b8f5-8eab1fd8f471 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:09:27.790293 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:27.790293 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:27.790293 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:27.790293 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:27.790293 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:27.790293 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:27.790293 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:27.790293 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:27.790293 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:27.790293 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:27.790293 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:27.790293 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 16:09:27.790293 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 16:09:27.790293 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 16:09:27.791373 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 16:09:27.791373 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:27.791373 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:27.791373 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:27.791373 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:27.791373 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:27.791373 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:27.791373 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:27.791373 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:09:27.791373 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:27.791373 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:27.791373 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:27.791373 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:27.791373 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:27.791373 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:27.791373 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:27.791373 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:27.792274 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 16:09:27.792274 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 16:09:27.792274 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 16:09:27.792274 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 16:09:27.792274 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 16:09:27.792274 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 16:09:27.792274 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:09:27.792274 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:27.792274 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 416/829] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 16:09:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:27.795535 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d738dc-5526-4cf5-b8f5-8eab1fd8f471 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:27.806737 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 414/830] 10.222.0.62 () {60 vars in 1144 bytes} [Fri May 27 16:09:27 2022] POST /identity/v3/endpoints => generated 346 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:09:27.915854 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d738dc-5526-4cf5-b8f5-8eab1fd8f471 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:27.961097 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f7764a-67f6-4b6f-9a9c-c1638ab7a212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:27.961766 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7764a-67f6-4b6f-9a9c-c1638ab7a212 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:27.962048 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7764a-67f6-4b6f-9a9c-c1638ab7a212 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:27.962379 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7764a-67f6-4b6f-9a9c-c1638ab7a212 None admin] PATH_INFO: `/v3/projects` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:27.963144 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f7764a-67f6-4b6f-9a9c-c1638ab7a212 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:27.963449 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f7764a-67f6-4b6f-9a9c-c1638ab7a212 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:27.964900 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f7764a-67f6-4b6f-9a9c-c1638ab7a212 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:27.979556 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 417/831] 10.222.0.62 () {56 vars in 1148 bytes} [Fri May 27 16:09:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:09:27.985374 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280bf6ba-a854-4f7c-846d-c388ef0cc43a None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:28.104208 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280bf6ba-a854-4f7c-846d-c388ef0cc43a None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:28.139049 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:28.145356 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c530dc1-29f4-44c4-9afb-f19b064d3bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:28.146841 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c530dc1-29f4-44c4-9afb-f19b064d3bb8 None admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:28.147128 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c530dc1-29f4-44c4-9afb-f19b064d3bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:28.147410 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c530dc1-29f4-44c4-9afb-f19b064d3bb8 None admin] PATH_INFO: `/v3/projects/d48d95a12587479ca5714f6ebd60dd9f/users/eb50bf5f39b04ab689b55f46d3dd2640/roles/1d9076bd231c43809cb971b6360e0c28` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:28.163245 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c530dc1-29f4-44c4-9afb-f19b064d3bb8 None admin] RBAC: Authorizing `identity:create_grant(project_id=d48d95a12587479ca5714f6ebd60dd9f, user_id=eb50bf5f39b04ab689b55f46d3dd2640, role_id=1d9076bd231c43809cb971b6360e0c28)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:28.164697 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c530dc1-29f4-44c4-9afb-f19b064d3bb8 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:28.182907 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d76c5b-923e-46ed-a039-76c98f7f39e5 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:28.183208 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d76c5b-923e-46ed-a039-76c98f7f39e5 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:28.183492 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d76c5b-923e-46ed-a039-76c98f7f39e5 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:28.185049 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 418/832] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:09:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 16:09:28.189896 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f562e858-51d6-4c2d-ae03-810df3c508c4 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:28.192637 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f562e858-51d6-4c2d-ae03-810df3c508c4 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:28.192637 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f562e858-51d6-4c2d-ae03-810df3c508c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:28.207904 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-f562e858-51d6-4c2d-ae03-810df3c508c4 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:09:28.209784 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-f562e858-51d6-4c2d-ae03-810df3c508c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:09:28.219676 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:28.239607 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 415/833] 10.222.0.62 () {58 vars in 1439 bytes} [Fri May 27 16:09:27 2022] PUT /identity/v3/projects/d48d95a12587479ca5714f6ebd60dd9f/users/eb50bf5f39b04ab689b55f46d3dd2640/roles/1d9076bd231c43809cb971b6360e0c28 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:09:28.291967 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 419/834] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:09:28 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 16:09:28.315005 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c530dc1-29f4-44c4-9afb-f19b064d3bb8 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:28.436308 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c530dc1-29f4-44c4-9afb-f19b064d3bb8 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:28.475978 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9531f26e-0bbb-4b97-96ab-e9862bc39ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:28.476796 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9531f26e-0bbb-4b97-96ab-e9862bc39ec2 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:28.477073 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9531f26e-0bbb-4b97-96ab-e9862bc39ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:28.477352 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9531f26e-0bbb-4b97-96ab-e9862bc39ec2 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:28.478006 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9531f26e-0bbb-4b97-96ab-e9862bc39ec2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:28.479405 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9531f26e-0bbb-4b97-96ab-e9862bc39ec2 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:28.491575 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-9531f26e-0bbb-4b97-96ab-e9862bc39ec2 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 16:09:28.491575 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:28.491575 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 16:09:28.491575 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 16:09:28.491575 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 16:09:28.491575 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 16:09:28.491575 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 16:09:28.491575 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:09:28.491575 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 16:09:28.491575 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:28.491575 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 16:09:28.491575 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:28.491575 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:28.491575 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:28.491575 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:28.491575 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:28.492542 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:28.492542 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:28.492542 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:28.492542 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:28.492542 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:28.492542 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:28.492542 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:28.492542 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 16:09:28.492542 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 16:09:28.492542 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 16:09:28.492542 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 16:09:28.492542 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:28.492542 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:28.492542 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:28.492542 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:28.492542 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:28.493587 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:28.493587 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:28.493587 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:09:28.493587 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:28.493587 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:28.493587 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:28.493587 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:28.493587 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:28.493587 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:28.493587 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:28.493587 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:28.493587 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 16:09:28.493587 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:09:28.493587 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 16:09:28.493587 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:28.493587 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 416/835] 10.222.0.62 () {56 vars in 1132 bytes} [Fri May 27 16:09:28 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:28.498910 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f562e858-51d6-4c2d-ae03-810df3c508c4 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:28.607489 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f562e858-51d6-4c2d-ae03-810df3c508c4 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:28.644300 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3521c56d-13f1-465a-be1f-9172f3994744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:28.645317 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3521c56d-13f1-465a-be1f-9172f3994744 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:28.645800 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3521c56d-13f1-465a-be1f-9172f3994744 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:28.646431 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3521c56d-13f1-465a-be1f-9172f3994744 None admin] PATH_INFO: `/v3/services` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:28.647360 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3521c56d-13f1-465a-be1f-9172f3994744 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:28.647861 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3521c56d-13f1-465a-be1f-9172f3994744 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:28.649425 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3521c56d-13f1-465a-be1f-9172f3994744 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:28.654884 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 420/836] 10.222.0.62 () {56 vars in 1126 bytes} [Fri May 27 16:09:28 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:28.663342 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9531f26e-0bbb-4b97-96ab-e9862bc39ec2 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:28.710955 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:28.766120 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9531f26e-0bbb-4b97-96ab-e9862bc39ec2 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:28.803334 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc72fa-abdf-49ee-b9d0-21ea22583997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:28.804008 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc72fa-abdf-49ee-b9d0-21ea22583997 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:28.804294 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc72fa-abdf-49ee-b9d0-21ea22583997 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:28.804581 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc72fa-abdf-49ee-b9d0-21ea22583997 None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:28.805297 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bc72fa-abdf-49ee-b9d0-21ea22583997 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:28.805610 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bc72fa-abdf-49ee-b9d0-21ea22583997 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:28.807087 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bc72fa-abdf-49ee-b9d0-21ea22583997 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:28.815922 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 417/837] 10.222.0.62 () {56 vars in 1126 bytes} [Fri May 27 16:09:28 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:29.524913 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e810dd-9fa5-4902-a3df-79dd0654ce8f None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:29.525438 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e810dd-9fa5-4902-a3df-79dd0654ce8f None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:29.525517 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e810dd-9fa5-4902-a3df-79dd0654ce8f None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:29.527156 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 421/838] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:09:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:09:29.532295 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b632169d-3f0b-4299-85c8-d6d69ac31da3 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:29.532710 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b632169d-3f0b-4299-85c8-d6d69ac31da3 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:29.532857 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b632169d-3f0b-4299-85c8-d6d69ac31da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:29.551528 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-b632169d-3f0b-4299-85c8-d6d69ac31da3 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:09:29.552761 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-b632169d-3f0b-4299-85c8-d6d69ac31da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:09:29.622050 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 418/839] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:09:29 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:09:29.645717 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e810dd-9fa5-4902-a3df-79dd0654ce8f None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:29.658277 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:29.755081 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e810dd-9fa5-4902-a3df-79dd0654ce8f None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:29.795395 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7f9426-e293-4a00-86db-20ee282ffdbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:29.796633 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f9426-e293-4a00-86db-20ee282ffdbb None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:29.797139 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f9426-e293-4a00-86db-20ee282ffdbb None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:29.797629 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f9426-e293-4a00-86db-20ee282ffdbb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:29.809954 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7f9426-e293-4a00-86db-20ee282ffdbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:09:29.819848 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-bb7f9426-e293-4a00-86db-20ee282ffdbb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:09:29.819848 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:29.819848 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:29.819848 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:29.819848 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:29.819848 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:29.819848 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:29.819848 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:29.819848 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:29.819848 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:29.819848 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:29.819848 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:29.819848 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:09:29.819848 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:09:29.819848 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:09:29.819848 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:09:29.820896 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:09:29.820896 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:09:29.820896 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:09:29.820896 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:09:29.820896 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:29.820896 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:29.820896 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:29.820896 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:29.820896 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:29.820896 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:29.820896 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:29.820896 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:09:29.820896 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:29.820896 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:29.820896 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:29.820896 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:29.821744 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:29.821744 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:29.821744 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:29.821744 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:29.821744 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:09:29.821744 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:09:29.821744 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:09:29.821744 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:09:29.821744 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:09:29.821744 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:09:29.821744 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:09:29.821744 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:29.824456 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 422/840] 10.222.0.62 () {56 vars in 1096 bytes} [Fri May 27 16:09:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:29.829656 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b632169d-3f0b-4299-85c8-d6d69ac31da3 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:29.895147 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:29.943154 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b632169d-3f0b-4299-85c8-d6d69ac31da3 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:29.979468 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c700bc-346c-49bf-a501-6461c0313244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:29.980177 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c700bc-346c-49bf-a501-6461c0313244 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:29.980467 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c700bc-346c-49bf-a501-6461c0313244 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:29.980752 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c700bc-346c-49bf-a501-6461c0313244 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:29.981552 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c700bc-346c-49bf-a501-6461c0313244 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:29.981866 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c700bc-346c-49bf-a501-6461c0313244 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:29.983398 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c700bc-346c-49bf-a501-6461c0313244 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:29.994800 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 419/841] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 16:09:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:30.000603 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7f9426-e293-4a00-86db-20ee282ffdbb None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:30.072094 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:30.110719 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7f9426-e293-4a00-86db-20ee282ffdbb None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:30.152696 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb6b7b-569f-493a-be83-02ee5c8cdfb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:30.153505 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb6b7b-569f-493a-be83-02ee5c8cdfb0 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:30.153789 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb6b7b-569f-493a-be83-02ee5c8cdfb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:30.154065 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb6b7b-569f-493a-be83-02ee5c8cdfb0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:30.166398 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fb6b7b-569f-493a-be83-02ee5c8cdfb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:30.168062 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fb6b7b-569f-493a-be83-02ee5c8cdfb0 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:30.186962 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-d7fb6b7b-569f-493a-be83-02ee5c8cdfb0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:30.186962 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:30.186962 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:30.186962 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:30.186962 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:30.186962 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:30.186962 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:30.186962 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:30.186962 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:30.186962 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:30.186962 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:30.186962 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:30.186962 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:09:30.186962 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:09:30.186962 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:09:30.188435 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:09:30.188435 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:30.188435 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:30.188435 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:30.188435 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:30.188435 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:30.188435 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:30.188435 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:30.188435 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:09:30.188435 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:30.188435 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:30.188435 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:30.188435 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:30.188435 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:30.188435 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:30.188435 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:30.188435 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:30.189932 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:09:30.189932 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:09:30.189932 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:30.189932 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:30.189932 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 423/842] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:09:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:30.199401 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c700bc-346c-49bf-a501-6461c0313244 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:30.235682 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32aee4-452b-403b-92b9-974da31b6494 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:30.236002 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32aee4-452b-403b-92b9-974da31b6494 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:30.236244 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32aee4-452b-403b-92b9-974da31b6494 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:30.237861 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 424/843] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:09:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:09:30.243692 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16fd822-e080-4e01-afa9-3d838e6650cc None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:30.243976 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16fd822-e080-4e01-afa9-3d838e6650cc None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:30.244264 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16fd822-e080-4e01-afa9-3d838e6650cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:30.262006 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-f16fd822-e080-4e01-afa9-3d838e6650cc None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:09:30.263265 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-f16fd822-e080-4e01-afa9-3d838e6650cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:09:30.311044 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c700bc-346c-49bf-a501-6461c0313244 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:30.318706 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:30.338489 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 425/844] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:09:30 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 16:09:30.348642 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f4870-d96f-4e3d-9c84-c25dc37b3b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:30.349862 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f4870-d96f-4e3d-9c84-c25dc37b3b6d None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:30.350549 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f4870-d96f-4e3d-9c84-c25dc37b3b6d None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:30.350549 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f4870-d96f-4e3d-9c84-c25dc37b3b6d None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:30.351192 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4f4870-d96f-4e3d-9c84-c25dc37b3b6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:30.351509 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4f4870-d96f-4e3d-9c84-c25dc37b3b6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:30.352992 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4f4870-d96f-4e3d-9c84-c25dc37b3b6d None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:30.357491 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16fd822-e080-4e01-afa9-3d838e6650cc None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:30.369943 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 420/845] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 16:09:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:30.375733 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f4870-d96f-4e3d-9c84-c25dc37b3b6d None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:30.420785 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:30.478072 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16fd822-e080-4e01-afa9-3d838e6650cc None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:30.519851 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f4870-d96f-4e3d-9c84-c25dc37b3b6d None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:30.528778 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53d0583-0ba1-45ae-b956-697ffb28af9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:30.530433 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d0583-0ba1-45ae-b956-697ffb28af9c None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:30.530833 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d0583-0ba1-45ae-b956-697ffb28af9c None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:30.531231 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d0583-0ba1-45ae-b956-697ffb28af9c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:30.531962 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53d0583-0ba1-45ae-b956-697ffb28af9c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:30.533476 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53d0583-0ba1-45ae-b956-697ffb28af9c None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:30.548312 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-b53d0583-0ba1-45ae-b956-697ffb28af9c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 16:09:30.548312 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:30.548312 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 16:09:30.548312 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 16:09:30.548312 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 16:09:30.548312 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 16:09:30.548312 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 16:09:30.548312 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:09:30.548312 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 16:09:30.548312 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:30.548312 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 16:09:30.548312 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:30.548312 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:30.548312 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:30.548312 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:30.548312 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:30.548312 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:30.549423 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:30.549423 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:30.549423 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:30.549423 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:30.549423 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:30.549423 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:30.549423 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 16:09:30.549423 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 16:09:30.549423 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 16:09:30.549423 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 16:09:30.549423 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:30.549423 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:30.549423 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:30.549423 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:30.549423 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:30.549423 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:30.560241 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:30.560241 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:09:30.560241 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:30.560241 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:30.560241 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:30.560241 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:30.560241 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:30.560241 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:30.560241 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:30.560241 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:30.560241 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 16:09:30.560241 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:09:30.560241 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 16:09:30.560241 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:30.560241 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 426/846] 10.222.0.62 () {56 vars in 1114 bytes} [Fri May 27 16:09:30 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:30.566036 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53d0583-0ba1-45ae-b956-697ffb28af9c None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:30.580268 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307795ba-1dad-4eb6-a7dc-900459a013cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:30.581378 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307795ba-1dad-4eb6-a7dc-900459a013cc None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:30.581673 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307795ba-1dad-4eb6-a7dc-900459a013cc None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:30.581952 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307795ba-1dad-4eb6-a7dc-900459a013cc None admin] PATH_INFO: `/v3/users/swift` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:30.590004 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307795ba-1dad-4eb6-a7dc-900459a013cc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:30.591431 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307795ba-1dad-4eb6-a7dc-900459a013cc None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:30.607867 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-307795ba-1dad-4eb6-a7dc-900459a013cc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 27 16:09:30.607867 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:30.607867 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:30.607867 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:30.607867 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:30.607867 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:30.607867 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:30.607867 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:30.607867 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:30.607867 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:30.607867 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:30.607867 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:30.607867 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 16:09:30.607867 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 16:09:30.607867 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 16:09:30.607867 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 16:09:30.608936 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:30.608936 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:30.608936 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 16:09:30.608936 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:09:30.608936 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 16:09:30.608936 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:09:30.608936 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:30.608936 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:30.608936 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:30.608936 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:30.608936 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:30.608936 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:09:30.608936 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:30.608936 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:30.608936 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:30.608936 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:30.608936 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:30.608936 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:30.610128 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:30.610128 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:30.610128 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 16:09:30.610128 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 16:09:30.610128 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 16:09:30.610128 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 16:09:30.610128 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 16:09:30.610128 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 16:09:30.610128 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 27 16:09:30.610128 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:30.610128 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 421/847] 10.222.0.62 () {56 vars in 1096 bytes} [Fri May 27 16:09:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:30.610799 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf100f-0a55-4ccc-9f45-a70848793979 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:30.611412 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf100f-0a55-4ccc-9f45-a70848793979 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:30.611412 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf100f-0a55-4ccc-9f45-a70848793979 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:30.612792 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 422/848] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:09:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:09:30.618396 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecf100f-0a55-4ccc-9f45-a70848793979 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:30.642334 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:30.683842 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53d0583-0ba1-45ae-b956-697ffb28af9c None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:30.698963 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:30.719370 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedc5d85-2477-4f84-bf05-b63aae896986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:30.721322 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc5d85-2477-4f84-bf05-b63aae896986 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:30.721322 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc5d85-2477-4f84-bf05-b63aae896986 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:30.721322 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc5d85-2477-4f84-bf05-b63aae896986 None admin] PATH_INFO: `/v3/services` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:30.721322 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedc5d85-2477-4f84-bf05-b63aae896986 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:30.721654 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedc5d85-2477-4f84-bf05-b63aae896986 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:30.723032 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedc5d85-2477-4f84-bf05-b63aae896986 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:30.728266 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 427/849] 10.222.0.62 () {56 vars in 1114 bytes} [Fri May 27 16:09:30 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:09:30.729274 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092b2f1e-c1c0-4431-8119-99be47763b9b None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:30.729566 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092b2f1e-c1c0-4431-8119-99be47763b9b None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:30.729913 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092b2f1e-c1c0-4431-8119-99be47763b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:30.737409 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecf100f-0a55-4ccc-9f45-a70848793979 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:30.749211 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-092b2f1e-c1c0-4431-8119-99be47763b9b None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:09:30.750443 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-092b2f1e-c1c0-4431-8119-99be47763b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:09:30.775084 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3323aa-3abe-4f0a-bec0-40743bbebf71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:30.775759 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3323aa-3abe-4f0a-bec0-40743bbebf71 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:30.776044 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3323aa-3abe-4f0a-bec0-40743bbebf71 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:30.776323 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3323aa-3abe-4f0a-bec0-40743bbebf71 None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:30.777164 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3323aa-3abe-4f0a-bec0-40743bbebf71 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:30.777477 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3323aa-3abe-4f0a-bec0-40743bbebf71 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:30.779022 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3323aa-3abe-4f0a-bec0-40743bbebf71 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:30.798905 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 423/850] 10.222.0.62 () {56 vars in 1135 bytes} [Fri May 27 16:09:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:30.799506 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3323aa-3abe-4f0a-bec0-40743bbebf71 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:30.830725 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 428/851] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:09:30 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:09:30.830725 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092b2f1e-c1c0-4431-8119-99be47763b9b None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:30.911494 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:30.936417 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3323aa-3abe-4f0a-bec0-40743bbebf71 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:30.966946 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092b2f1e-c1c0-4431-8119-99be47763b9b None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:30.977053 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:30.980124 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99680987-babc-4943-9ac3-fe9d7c1cbeeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:30.981054 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99680987-babc-4943-9ac3-fe9d7c1cbeeb None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:30.981442 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99680987-babc-4943-9ac3-fe9d7c1cbeeb None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:30.981725 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99680987-babc-4943-9ac3-fe9d7c1cbeeb None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:30.982467 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99680987-babc-4943-9ac3-fe9d7c1cbeeb None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:30.982779 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99680987-babc-4943-9ac3-fe9d7c1cbeeb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:30.984151 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99680987-babc-4943-9ac3-fe9d7c1cbeeb None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:30.989586 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 424/852] 10.222.0.62 () {56 vars in 1114 bytes} [Fri May 27 16:09:30 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:31.006288 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99680987-babc-4943-9ac3-fe9d7c1cbeeb None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:31.016416 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d08863-79ef-4efc-b8c9-fc0458cb7ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:31.017266 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d08863-79ef-4efc-b8c9-fc0458cb7ee3 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:31.017657 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d08863-79ef-4efc-b8c9-fc0458cb7ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:31.017995 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d08863-79ef-4efc-b8c9-fc0458cb7ee3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:31.106328 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d08863-79ef-4efc-b8c9-fc0458cb7ee3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:31.107849 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d08863-79ef-4efc-b8c9-fc0458cb7ee3 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:31.155650 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99680987-babc-4943-9ac3-fe9d7c1cbeeb None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:31.199186 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a7eb58-17b5-4597-abdd-d695523ddf67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:31.200220 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a7eb58-17b5-4597-abdd-d695523ddf67 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:31.200522 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a7eb58-17b5-4597-abdd-d695523ddf67 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:31.200793 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a7eb58-17b5-4597-abdd-d695523ddf67 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:31.217464 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a7eb58-17b5-4597-abdd-d695523ddf67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:09:31.228662 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 429/853] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 16:09:30 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 16:09:31.231370 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-58a7eb58-17b5-4597-abdd-d695523ddf67 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 16:09:31.231370 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:31.231370 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:31.231370 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:31.231370 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:31.231370 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:31.231370 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:31.231370 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:31.231370 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:31.231370 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:31.231370 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:31.231370 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:31.231370 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:09:31.231370 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:09:31.231370 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:09:31.231370 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:09:31.233167 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:09:31.233167 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:09:31.233167 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:09:31.233167 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:09:31.233167 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:31.233167 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:31.233167 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:31.233167 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:31.233167 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:31.233167 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:31.233167 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:31.233167 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:09:31.233167 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:31.233167 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:31.233167 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:31.233167 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:31.235527 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:31.235527 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:31.235527 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:31.235527 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:31.235527 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:09:31.235527 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:09:31.235527 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:09:31.235527 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:09:31.235527 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:09:31.235527 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:09:31.235527 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 16:09:31.235527 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:31.237160 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 425/854] 10.222.0.62 () {56 vars in 1102 bytes} [Fri May 27 16:09:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:31.238539 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a7eb58-17b5-4597-abdd-d695523ddf67 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:31.238661 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d08863-79ef-4efc-b8c9-fc0458cb7ee3 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:31.242500 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:31.254818 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:31.359627 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d08863-79ef-4efc-b8c9-fc0458cb7ee3 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:31.370868 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a7eb58-17b5-4597-abdd-d695523ddf67 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:31.397102 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60150551-dc39-49cf-a080-fa67f92dcfbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:31.397897 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60150551-dc39-49cf-a080-fa67f92dcfbd None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:31.398181 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60150551-dc39-49cf-a080-fa67f92dcfbd None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:31.398485 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60150551-dc39-49cf-a080-fa67f92dcfbd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:31.407962 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f614b-0e96-4f48-aea5-06030381f810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:31.408573 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f614b-0e96-4f48-aea5-06030381f810 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:31.408924 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f614b-0e96-4f48-aea5-06030381f810 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:31.409168 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60150551-dc39-49cf-a080-fa67f92dcfbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:31.409285 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f614b-0e96-4f48-aea5-06030381f810 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:31.410002 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8f614b-0e96-4f48-aea5-06030381f810 None admin] RBAC: Adding query filter params (name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:31.410350 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8f614b-0e96-4f48-aea5-06030381f810 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:31.410642 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60150551-dc39-49cf-a080-fa67f92dcfbd None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:31.412460 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8f614b-0e96-4f48-aea5-06030381f810 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:31.426490 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 426/855] 10.222.0.62 () {56 vars in 1103 bytes} [Fri May 27 16:09:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:31.427694 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49029c4e-734c-4e2a-8955-f57b2d73d67d None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:31.427992 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49029c4e-734c-4e2a-8955-f57b2d73d67d None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:31.428277 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49029c4e-734c-4e2a-8955-f57b2d73d67d None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:31.429084 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-60150551-dc39-49cf-a080-fa67f92dcfbd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:31.429084 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:31.429084 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:31.429084 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:31.429084 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:31.429084 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:31.429084 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:31.429084 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:31.429084 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:31.429084 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:31.429084 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:31.429084 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:31.429084 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:09:31.429084 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:09:31.429084 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:09:31.434515 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:09:31.434515 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:31.434515 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:31.434515 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:31.434515 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:31.434515 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:31.434515 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:31.434515 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:31.434515 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:09:31.434515 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:31.434515 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:31.434515 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:31.434515 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:31.434515 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:31.434515 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:31.434515 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:31.434515 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:31.435448 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:09:31.435448 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:09:31.435448 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:31.435448 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:31.435698 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 427/856] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:09:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:09:31.435698 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49029c4e-734c-4e2a-8955-f57b2d73d67d None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:31.435836 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 430/857] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:09:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:31.435910 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3100ab4a-1a05-484f-ba04-485de9d9d224 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:31.436173 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3100ab4a-1a05-484f-ba04-485de9d9d224 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:31.436464 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3100ab4a-1a05-484f-ba04-485de9d9d224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:31.453860 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-3100ab4a-1a05-484f-ba04-485de9d9d224 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:09:31.455312 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-3100ab4a-1a05-484f-ba04-485de9d9d224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:09:31.502850 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:31.514999 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:31.526908 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 431/858] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:09:31 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:09:31.527635 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3100ab4a-1a05-484f-ba04-485de9d9d224 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:31.555575 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49029c4e-734c-4e2a-8955-f57b2d73d67d None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:31.602448 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0613c4c-eb1d-489d-a76c-c48a60b437ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:31.603255 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0613c4c-eb1d-489d-a76c-c48a60b437ea None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:31.603544 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0613c4c-eb1d-489d-a76c-c48a60b437ea None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:31.603890 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0613c4c-eb1d-489d-a76c-c48a60b437ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:31.616638 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0613c4c-eb1d-489d-a76c-c48a60b437ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:31.618098 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0613c4c-eb1d-489d-a76c-c48a60b437ea None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:31.631643 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3100ab4a-1a05-484f-ba04-485de9d9d224 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:31.636075 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-d0613c4c-eb1d-489d-a76c-c48a60b437ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:31.636075 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:31.636075 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:31.636075 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:31.636075 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:31.636075 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:31.636075 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:31.636075 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:31.636075 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:31.636075 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:31.636075 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:31.636075 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:31.636075 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:09:31.636075 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:09:31.636075 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:09:31.636959 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:09:31.636959 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:31.636959 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:31.636959 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:31.636959 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:31.636959 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:31.636959 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:31.636959 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:31.636959 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:09:31.636959 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:31.636959 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:31.636959 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:31.636959 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:31.636959 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:31.636959 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:31.636959 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:31.636959 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:31.637880 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:09:31.637880 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:09:31.637880 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:31.637880 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:31.641891 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 428/859] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:09:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:31.642745 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0613c4c-eb1d-489d-a76c-c48a60b437ea None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:31.671373 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8727ca-7bd5-4cde-8097-dcbe588a0ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:31.672310 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8727ca-7bd5-4cde-8097-dcbe588a0ab0 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:31.672604 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8727ca-7bd5-4cde-8097-dcbe588a0ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:31.672891 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8727ca-7bd5-4cde-8097-dcbe588a0ab0 None admin] PATH_INFO: `/v3/domains` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:31.673630 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8727ca-7bd5-4cde-8097-dcbe588a0ab0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:31.673950 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8727ca-7bd5-4cde-8097-dcbe588a0ab0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:31.675640 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8727ca-7bd5-4cde-8097-dcbe588a0ab0 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:31.687689 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 432/860] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 16:09:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:31.688503 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8727ca-7bd5-4cde-8097-dcbe588a0ab0 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:31.744105 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:31.754568 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0613c4c-eb1d-489d-a76c-c48a60b437ea None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:31.773000 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:31.791953 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b399c0-03f2-4b0f-826d-80d3a4009acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:31.792624 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b399c0-03f2-4b0f-826d-80d3a4009acf None admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:31.792916 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b399c0-03f2-4b0f-826d-80d3a4009acf None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:31.793196 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b399c0-03f2-4b0f-826d-80d3a4009acf None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:31.793986 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b399c0-03f2-4b0f-826d-80d3a4009acf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:31.795463 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b399c0-03f2-4b0f-826d-80d3a4009acf None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:31.796264 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8727ca-7bd5-4cde-8097-dcbe588a0ab0 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:31.830621 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fb6fc4-f97a-4ac0-b48d-898ad7aea5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:31.831292 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb6fc4-f97a-4ac0-b48d-898ad7aea5ac None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:31.831580 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb6fc4-f97a-4ac0-b48d-898ad7aea5ac None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:31.831863 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb6fc4-f97a-4ac0-b48d-898ad7aea5ac None admin] PATH_INFO: `/v3/domains` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:31.832639 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fb6fc4-f97a-4ac0-b48d-898ad7aea5ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:31.832997 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fb6fc4-f97a-4ac0-b48d-898ad7aea5ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:31.834952 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fb6fc4-f97a-4ac0-b48d-898ad7aea5ac None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:31.847284 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 433/861] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 16:09:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:31.848089 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fb6fc4-f97a-4ac0-b48d-898ad7aea5ac None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:31.870308 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 429/862] 10.222.0.62 () {60 vars in 1141 bytes} [Fri May 27 16:09:31 2022] POST /identity/v3/services => generated 269 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:09:31.870308 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b399c0-03f2-4b0f-826d-80d3a4009acf None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:31.974132 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fb6fc4-f97a-4ac0-b48d-898ad7aea5ac None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:31.990496 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:31.995627 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b399c0-03f2-4b0f-826d-80d3a4009acf None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:32.029823 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ece160-34de-477d-8394-eab64f141797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:32.031691 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ece160-34de-477d-8394-eab64f141797 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:32.032544 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ece160-34de-477d-8394-eab64f141797 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:32.033041 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ece160-34de-477d-8394-eab64f141797 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:32.037331 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e54ced4-d86d-4af7-a65f-8060ffcb6c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:32.038166 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e54ced4-d86d-4af7-a65f-8060ffcb6c19 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:32.038484 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e54ced4-d86d-4af7-a65f-8060ffcb6c19 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:32.038767 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e54ced4-d86d-4af7-a65f-8060ffcb6c19 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:32.043875 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ece160-34de-477d-8394-eab64f141797 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:32.045697 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ece160-34de-477d-8394-eab64f141797 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:32.047911 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e54ced4-d86d-4af7-a65f-8060ffcb6c19 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:32.049639 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e54ced4-d86d-4af7-a65f-8060ffcb6c19 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:32.063925 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-96ece160-34de-477d-8394-eab64f141797 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:09:32.063925 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:32.063925 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:32.063925 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:32.063925 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:32.063925 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:32.063925 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:32.063925 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:32.063925 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:32.063925 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:32.063925 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:32.063925 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:32.063925 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 16:09:32.063925 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 16:09:32.063925 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 16:09:32.064935 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 16:09:32.064935 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:32.064935 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:32.064935 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:32.064935 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:32.064935 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:32.064935 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:32.064935 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:32.064935 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:09:32.064935 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:32.064935 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:32.064935 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:32.064935 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:32.064935 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:32.064935 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:32.064935 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:32.064935 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:32.065954 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 16:09:32.065954 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 16:09:32.065954 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 16:09:32.065954 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 16:09:32.065954 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 16:09:32.065954 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 16:09:32.065954 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:09:32.065954 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:32.069199 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 434/863] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 16:09:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:32.074563 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ece160-34de-477d-8394-eab64f141797 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:32.075701 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-9e54ced4-d86d-4af7-a65f-8060ffcb6c19 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 16:09:32.075701 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:32.075701 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:32.075701 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:32.075701 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:32.075701 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:32.075701 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:32.075701 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:32.075701 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:32.075701 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:32.075701 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:32.075701 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:32.075701 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 16:09:32.075701 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 16:09:32.075701 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 16:09:32.075701 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 16:09:32.076637 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:32.076637 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:32.076637 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 16:09:32.076637 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:09:32.076637 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 16:09:32.076637 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:09:32.076637 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:32.076637 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:32.076637 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:32.076637 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:32.076637 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:32.076637 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:09:32.076637 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:32.076637 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:32.076637 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:32.076637 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:32.076637 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:32.076637 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:32.077949 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:32.077949 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:32.077949 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 16:09:32.077949 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 16:09:32.077949 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 16:09:32.077949 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 16:09:32.077949 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 16:09:32.077949 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 16:09:32.077949 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 16:09:32.077949 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:32.077949 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 430/864] 10.222.0.62 () {56 vars in 1117 bytes} [Fri May 27 16:09:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:32.083243 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e54ced4-d86d-4af7-a65f-8060ffcb6c19 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:32.127033 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:32.217633 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ece160-34de-477d-8394-eab64f141797 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:32.224476 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e54ced4-d86d-4af7-a65f-8060ffcb6c19 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:32.263729 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e273e9-4f89-4712-99da-c4f9b8d6386b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:32.264397 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e273e9-4f89-4712-99da-c4f9b8d6386b None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:32.264682 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e273e9-4f89-4712-99da-c4f9b8d6386b None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:32.264788 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3115f7fd-67ec-48ad-bf78-374bce0cdcdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:32.264982 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e273e9-4f89-4712-99da-c4f9b8d6386b None admin] PATH_INFO: `/v3/projects` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:32.265424 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115f7fd-67ec-48ad-bf78-374bce0cdcdf None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:32.265712 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115f7fd-67ec-48ad-bf78-374bce0cdcdf None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:32.265823 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e273e9-4f89-4712-99da-c4f9b8d6386b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:32.265989 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115f7fd-67ec-48ad-bf78-374bce0cdcdf None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:32.266092 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e273e9-4f89-4712-99da-c4f9b8d6386b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:32.267343 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3115f7fd-67ec-48ad-bf78-374bce0cdcdf None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:32.267704 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e273e9-4f89-4712-99da-c4f9b8d6386b None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:32.267810 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3115f7fd-67ec-48ad-bf78-374bce0cdcdf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:32.269357 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3115f7fd-67ec-48ad-bf78-374bce0cdcdf None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:32.283640 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 435/865] 10.222.0.62 () {56 vars in 1148 bytes} [Fri May 27 16:09:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:09:32.292579 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 431/866] 10.222.0.62 () {56 vars in 1149 bytes} [Fri May 27 16:09:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:32.292746 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e273e9-4f89-4712-99da-c4f9b8d6386b None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:32.294829 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3115f7fd-67ec-48ad-bf78-374bce0cdcdf None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:32.333097 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:32.424727 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:32.430834 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e273e9-4f89-4712-99da-c4f9b8d6386b None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:32.438184 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3115f7fd-67ec-48ad-bf78-374bce0cdcdf None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:32.475352 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5721c5a1-e3db-43f7-aa1a-b49c9c3fbd7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:32.475922 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5721c5a1-e3db-43f7-aa1a-b49c9c3fbd7d None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:32.476208 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5721c5a1-e3db-43f7-aa1a-b49c9c3fbd7d None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:32.476492 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5721c5a1-e3db-43f7-aa1a-b49c9c3fbd7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:32.495959 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac36e60-4be9-4a85-89d5-d1c2ad32b59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:32.497442 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac36e60-4be9-4a85-89d5-d1c2ad32b59b None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:32.498196 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac36e60-4be9-4a85-89d5-d1c2ad32b59b None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:32.498970 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac36e60-4be9-4a85-89d5-d1c2ad32b59b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:32.500875 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac36e60-4be9-4a85-89d5-d1c2ad32b59b None admin] RBAC: Adding query filter params (role.id=e04fe3eb1f714d74901ac83e33ea8a16, scope.project.id=d48d95a12587479ca5714f6ebd60dd9f, user.id=e8e6ec55445045fcac5623b9b6ffa9ab) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:32.501688 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac36e60-4be9-4a85-89d5-d1c2ad32b59b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:32.504741 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac36e60-4be9-4a85-89d5-d1c2ad32b59b None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:32.522732 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 436/867] 10.222.0.62 () {56 vars in 1374 bytes} [Fri May 27 16:09:32 2022] GET /identity/v3/role_assignments?user.id=e8e6ec55445045fcac5623b9b6ffa9ab&scope.project.id=d48d95a12587479ca5714f6ebd60dd9f&role.id=e04fe3eb1f714d74901ac83e33ea8a16 => generated 608 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:32.555558 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5721c5a1-e3db-43f7-aa1a-b49c9c3fbd7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:32.557035 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5721c5a1-e3db-43f7-aa1a-b49c9c3fbd7d None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:32.656312 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:32.668785 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 432/868] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 16:09:32 2022] GET /identity/v3/auth/tokens => generated 1261 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 16:09:32.678407 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac36e60-4be9-4a85-89d5-d1c2ad32b59b None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:32.811442 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:32.819196 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac36e60-4be9-4a85-89d5-d1c2ad32b59b None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:32.853702 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9ca668-9f69-4a92-8280-4e7f7249d7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:32.854711 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ca668-9f69-4a92-8280-4e7f7249d7f6 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:32.854996 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ca668-9f69-4a92-8280-4e7f7249d7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:32.855271 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ca668-9f69-4a92-8280-4e7f7249d7f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:32.869368 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9ca668-9f69-4a92-8280-4e7f7249d7f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:32.870871 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9ca668-9f69-4a92-8280-4e7f7249d7f6 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:32.889460 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-0d9ca668-9f69-4a92-8280-4e7f7249d7f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:32.889460 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:32.889460 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:32.889460 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:32.889460 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:32.889460 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:32.889460 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:32.889460 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:32.889460 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:32.889460 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:32.889460 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:32.889460 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:32.889460 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:09:32.889460 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:09:32.889460 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:09:32.890437 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:09:32.890437 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:32.890437 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:32.890437 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:32.890437 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:32.890437 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:32.890437 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:32.890437 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:32.890437 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:09:32.890437 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:32.890437 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:32.890437 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:32.890437 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:32.890437 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:32.890437 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:32.890437 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:32.890437 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:32.891356 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:09:32.891356 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:09:32.891356 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:32.891356 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:32.891356 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 437/869] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:09:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:32.897210 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5721c5a1-e3db-43f7-aa1a-b49c9c3fbd7d None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:33.007313 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5721c5a1-e3db-43f7-aa1a-b49c9c3fbd7d None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:33.043202 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a789dc-36e9-446f-b3de-c20e08af21cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:33.044238 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a789dc-36e9-446f-b3de-c20e08af21cd None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:33.044767 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a789dc-36e9-446f-b3de-c20e08af21cd None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:33.045248 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a789dc-36e9-446f-b3de-c20e08af21cd None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:33.046188 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a789dc-36e9-446f-b3de-c20e08af21cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:33.046733 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a789dc-36e9-446f-b3de-c20e08af21cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:33.048326 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a789dc-36e9-446f-b3de-c20e08af21cd None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:33.062837 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 433/870] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 16:09:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:33.068475 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9ca668-9f69-4a92-8280-4e7f7249d7f6 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:33.174798 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9ca668-9f69-4a92-8280-4e7f7249d7f6 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:33.211705 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0152ac60-a39d-49a0-812e-7095aa2f7138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:33.212506 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0152ac60-a39d-49a0-812e-7095aa2f7138 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:33.212786 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0152ac60-a39d-49a0-812e-7095aa2f7138 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:33.213058 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0152ac60-a39d-49a0-812e-7095aa2f7138 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:33.220141 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0152ac60-a39d-49a0-812e-7095aa2f7138 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:33.221586 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0152ac60-a39d-49a0-812e-7095aa2f7138 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:33.235581 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-0152ac60-a39d-49a0-812e-7095aa2f7138 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:09:33.235581 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:33.235581 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:33.235581 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:33.235581 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:33.235581 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:33.235581 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:33.235581 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:33.235581 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:33.235581 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:33.235581 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:33.235581 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:33.235581 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 16:09:33.235581 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 16:09:33.235581 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 16:09:33.236519 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 16:09:33.236519 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:33.236519 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:33.236519 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:33.236519 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:33.236519 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:33.236519 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:33.236519 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:33.236519 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:09:33.236519 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:33.236519 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:33.236519 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:33.236519 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:33.236519 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:33.236519 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:33.236519 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:33.236519 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:33.237446 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 16:09:33.237446 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 16:09:33.237446 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 16:09:33.237446 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 16:09:33.237446 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 16:09:33.237446 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 16:09:33.237446 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:09:33.237446 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:33.237446 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 438/871] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 16:09:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:33.243502 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a789dc-36e9-446f-b3de-c20e08af21cd None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:33.300991 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:33.358535 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a789dc-36e9-446f-b3de-c20e08af21cd None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:33.394771 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a962929-6fcb-4fed-bf5b-0dec57c23a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:33.395446 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a962929-6fcb-4fed-bf5b-0dec57c23a18 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:33.395757 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a962929-6fcb-4fed-bf5b-0dec57c23a18 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:33.396502 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a962929-6fcb-4fed-bf5b-0dec57c23a18 None admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:33.397079 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a962929-6fcb-4fed-bf5b-0dec57c23a18 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:33.397386 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a962929-6fcb-4fed-bf5b-0dec57c23a18 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:33.398851 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a962929-6fcb-4fed-bf5b-0dec57c23a18 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:33.411062 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 434/872] 10.222.0.62 () {56 vars in 1148 bytes} [Fri May 27 16:09:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:33.417410 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0152ac60-a39d-49a0-812e-7095aa2f7138 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:33.443734 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:33.521903 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0152ac60-a39d-49a0-812e-7095aa2f7138 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:33.524018 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da086bc-d227-4b6f-bc5e-e8a4fa097519 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:33.524306 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da086bc-d227-4b6f-bc5e-e8a4fa097519 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:33.524582 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da086bc-d227-4b6f-bc5e-e8a4fa097519 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:33.526091 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 435/873] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:09:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 16:09:33.530809 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff5eaf9-a012-4824-9789-79ec091fec63 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:33.531326 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff5eaf9-a012-4824-9789-79ec091fec63 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:33.531811 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff5eaf9-a012-4824-9789-79ec091fec63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:33.549476 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-4ff5eaf9-a012-4824-9789-79ec091fec63 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:09:33.551388 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-4ff5eaf9-a012-4824-9789-79ec091fec63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:09:33.565171 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95d905a-3923-4439-ad30-eb88a1a21820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:33.565826 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d905a-3923-4439-ad30-eb88a1a21820 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:33.566108 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d905a-3923-4439-ad30-eb88a1a21820 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:33.566414 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d905a-3923-4439-ad30-eb88a1a21820 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:33.567530 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95d905a-3923-4439-ad30-eb88a1a21820 None admin] RBAC: Adding query filter params (role.id=1d9076bd231c43809cb971b6360e0c28, scope.project.id=d48d95a12587479ca5714f6ebd60dd9f, user.id=eb50bf5f39b04ab689b55f46d3dd2640) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:33.567991 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95d905a-3923-4439-ad30-eb88a1a21820 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:33.570181 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95d905a-3923-4439-ad30-eb88a1a21820 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:33.579039 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 439/874] 10.222.0.62 () {56 vars in 1374 bytes} [Fri May 27 16:09:33 2022] GET /identity/v3/role_assignments?user.id=eb50bf5f39b04ab689b55f46d3dd2640&scope.project.id=d48d95a12587479ca5714f6ebd60dd9f&role.id=1d9076bd231c43809cb971b6360e0c28 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:33.655250 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 436/875] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:09:33 2022] POST /identity/v3/auth/tokens => generated 1261 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:09:33.678724 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95d905a-3923-4439-ad30-eb88a1a21820 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:33.758717 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:33.791432 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95d905a-3923-4439-ad30-eb88a1a21820 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:33.828818 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba57c32e-6a7f-479a-a110-ff1ce324fd3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:33.829494 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57c32e-6a7f-479a-a110-ff1ce324fd3e None admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:33.829777 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57c32e-6a7f-479a-a110-ff1ce324fd3e None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:33.830054 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57c32e-6a7f-479a-a110-ff1ce324fd3e None admin] PATH_INFO: `/v3/services` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:33.830821 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba57c32e-6a7f-479a-a110-ff1ce324fd3e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:33.832179 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba57c32e-6a7f-479a-a110-ff1ce324fd3e None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:33.944688 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 440/876] 10.222.0.62 () {60 vars in 1141 bytes} [Fri May 27 16:09:33 2022] POST /identity/v3/services => generated 251 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:09:34.274734 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f8c7f-ac0a-46bc-9728-fed75b74ce22 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:34.275750 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f8c7f-ac0a-46bc-9728-fed75b74ce22 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:34.276247 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f8c7f-ac0a-46bc-9728-fed75b74ce22 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:34.278063 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 437/877] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:09:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:09:34.283410 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a169b96-7067-4f8a-a0bc-7abed2146447 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:34.283925 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a169b96-7067-4f8a-a0bc-7abed2146447 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:34.284419 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a169b96-7067-4f8a-a0bc-7abed2146447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:34.302505 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-2a169b96-7067-4f8a-a0bc-7abed2146447 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:09:34.304074 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-2a169b96-7067-4f8a-a0bc-7abed2146447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:09:34.380759 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 441/878] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:09:34 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:09:34.403316 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67f8c7f-ac0a-46bc-9728-fed75b74ce22 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:34.451183 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:34.512554 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67f8c7f-ac0a-46bc-9728-fed75b74ce22 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:34.549127 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d5ad76-4576-4f6f-9c7c-4992cc219524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:34.550622 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5ad76-4576-4f6f-9c7c-4992cc219524 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:34.551123 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5ad76-4576-4f6f-9c7c-4992cc219524 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:34.551627 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5ad76-4576-4f6f-9c7c-4992cc219524 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:34.552672 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d5ad76-4576-4f6f-9c7c-4992cc219524 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:34.554279 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d5ad76-4576-4f6f-9c7c-4992cc219524 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:34.566957 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-55d5ad76-4576-4f6f-9c7c-4992cc219524 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 16:09:34.566957 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:34.566957 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 16:09:34.566957 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 16:09:34.566957 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 16:09:34.566957 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 16:09:34.566957 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 16:09:34.566957 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:09:34.566957 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 16:09:34.566957 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:34.566957 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 16:09:34.566957 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:34.566957 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:34.566957 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:34.566957 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:34.566957 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:34.568152 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:34.568152 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:34.568152 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:34.568152 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:34.568152 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:34.568152 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:34.568152 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:34.568152 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 16:09:34.568152 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 16:09:34.568152 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 16:09:34.568152 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 16:09:34.568152 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:34.568152 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:34.568152 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:34.568152 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:34.568152 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:34.569005 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:34.569005 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:34.569005 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:09:34.569005 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:34.569005 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:34.569005 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:34.569005 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:34.569005 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:34.569005 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:34.569005 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:34.569005 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:34.569005 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 16:09:34.569005 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:09:34.569005 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 16:09:34.569005 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:34.571856 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 438/879] 10.222.0.62 () {56 vars in 1132 bytes} [Fri May 27 16:09:34 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:34.578043 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a169b96-7067-4f8a-a0bc-7abed2146447 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:34.638720 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:34.681594 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a169b96-7067-4f8a-a0bc-7abed2146447 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:34.722800 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da377575-177e-4097-baf0-5e93e2d0a051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:34.723528 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da377575-177e-4097-baf0-5e93e2d0a051 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:34.724408 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da377575-177e-4097-baf0-5e93e2d0a051 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:34.724696 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da377575-177e-4097-baf0-5e93e2d0a051 None admin] PATH_INFO: `/v3/services` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:34.725418 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da377575-177e-4097-baf0-5e93e2d0a051 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:34.725726 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da377575-177e-4097-baf0-5e93e2d0a051 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:34.727165 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da377575-177e-4097-baf0-5e93e2d0a051 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:34.733137 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 442/880] 10.222.0.62 () {56 vars in 1126 bytes} [Fri May 27 16:09:34 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:34.738742 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d5ad76-4576-4f6f-9c7c-4992cc219524 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:34.850762 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d5ad76-4576-4f6f-9c7c-4992cc219524 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:34.854028 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:34.886644 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b26b46-53f9-46b4-aca6-e1bb8e7d2ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:34.887312 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b26b46-53f9-46b4-aca6-e1bb8e7d2ec0 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:34.887593 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b26b46-53f9-46b4-aca6-e1bb8e7d2ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:34.887868 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b26b46-53f9-46b4-aca6-e1bb8e7d2ec0 None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:34.888577 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b26b46-53f9-46b4-aca6-e1bb8e7d2ec0 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:34.888885 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b26b46-53f9-46b4-aca6-e1bb8e7d2ec0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:34.890277 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b26b46-53f9-46b4-aca6-e1bb8e7d2ec0 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:34.896202 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 439/881] 10.222.0.62 () {56 vars in 1126 bytes} [Fri May 27 16:09:34 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:34.902009 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da377575-177e-4097-baf0-5e93e2d0a051 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:34.948086 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a171b-b341-437b-9870-9477fc8116bd None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:34.948391 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a171b-b341-437b-9870-9477fc8116bd None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:34.948657 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a171b-b341-437b-9870-9477fc8116bd None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:34.950407 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 440/882] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:09:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 16:09:34.955395 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f206e-95f7-462f-b857-c38fbd6b785a None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:34.955688 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f206e-95f7-462f-b857-c38fbd6b785a None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:34.955969 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f206e-95f7-462f-b857-c38fbd6b785a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:34.973348 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-c04f206e-95f7-462f-b857-c38fbd6b785a None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:09:34.975316 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-c04f206e-95f7-462f-b857-c38fbd6b785a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:09:35.007547 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da377575-177e-4097-baf0-5e93e2d0a051 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:35.029076 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:35.044715 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d95e0-f88a-4b80-b04b-9912e8ad9cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:35.045499 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d95e0-f88a-4b80-b04b-9912e8ad9cf5 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:35.045783 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d95e0-f88a-4b80-b04b-9912e8ad9cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:35.046059 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d95e0-f88a-4b80-b04b-9912e8ad9cf5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:35.046889 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6d95e0-f88a-4b80-b04b-9912e8ad9cf5 None admin] RBAC: Adding query filter params (interface=public, service_id=f46738cbdcff42398a53f1aa948fc36e, region_id=RegionOne) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:35.047200 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6d95e0-f88a-4b80-b04b-9912e8ad9cf5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:35.053968 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6d95e0-f88a-4b80-b04b-9912e8ad9cf5 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:35.054415 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 441/883] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:09:34 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 16:09:35.057823 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 443/884] 10.222.0.62 () {56 vars in 1251 bytes} [Fri May 27 16:09:34 2022] GET /identity/v3/endpoints?service_id=f46738cbdcff42398a53f1aa948fc36e&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:35.062908 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04f206e-95f7-462f-b857-c38fbd6b785a None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:35.073012 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d95e0-f88a-4b80-b04b-9912e8ad9cf5 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:35.168529 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:35.172911 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04f206e-95f7-462f-b857-c38fbd6b785a None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:35.187420 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d95e0-f88a-4b80-b04b-9912e8ad9cf5 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:35.212204 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f727bc4-1f96-4616-8123-bf10e572ea7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:35.213242 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f727bc4-1f96-4616-8123-bf10e572ea7b None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:35.213740 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f727bc4-1f96-4616-8123-bf10e572ea7b None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:35.214214 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f727bc4-1f96-4616-8123-bf10e572ea7b None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:35.215130 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f727bc4-1f96-4616-8123-bf10e572ea7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:35.216810 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f727bc4-1f96-4616-8123-bf10e572ea7b None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:35.230276 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 442/885] 10.222.0.62 () {56 vars in 1087 bytes} [Fri May 27 16:09:35 2022] GET /identity/v3/services => generated 1268 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 16:09:35.231394 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa082add-5f02-484a-ab36-9b4be863f19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:35.232405 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa082add-5f02-484a-ab36-9b4be863f19f None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:35.232695 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa082add-5f02-484a-ab36-9b4be863f19f None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:35.233042 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa082add-5f02-484a-ab36-9b4be863f19f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:35.233715 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa082add-5f02-484a-ab36-9b4be863f19f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:35.235168 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa082add-5f02-484a-ab36-9b4be863f19f None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:35.248793 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-aa082add-5f02-484a-ab36-9b4be863f19f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 16:09:35.248793 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:35.248793 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 16:09:35.248793 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 16:09:35.248793 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 16:09:35.248793 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 16:09:35.248793 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 16:09:35.248793 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:09:35.248793 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 16:09:35.248793 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:35.248793 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 16:09:35.248793 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:35.248793 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:35.248793 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:35.248793 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:35.248793 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:35.248793 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:35.249860 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:35.249860 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:35.249860 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:35.249860 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:35.249860 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:35.249860 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:35.249860 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 16:09:35.249860 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 16:09:35.249860 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 16:09:35.249860 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 16:09:35.249860 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:35.249860 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:35.249860 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:35.249860 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:35.249860 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:35.249860 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:35.250722 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:35.250722 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:09:35.250722 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:35.250722 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:35.250722 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:35.250722 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:35.250722 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:35.250722 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:35.250722 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:35.250722 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:35.250722 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 16:09:35.250722 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:09:35.250722 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 16:09:35.250722 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:35.255487 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 444/886] 10.222.0.62 () {56 vars in 1126 bytes} [Fri May 27 16:09:35 2022] GET /identity/v3/services/object-store => generated 93 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:35.256898 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f727bc4-1f96-4616-8123-bf10e572ea7b None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:35.367255 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f727bc4-1f96-4616-8123-bf10e572ea7b None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:35.409873 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783c9f59-3980-4be5-ba28-d92a0cb3ad74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:35.410983 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c9f59-3980-4be5-ba28-d92a0cb3ad74 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:35.411506 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c9f59-3980-4be5-ba28-d92a0cb3ad74 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:35.411987 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c9f59-3980-4be5-ba28-d92a0cb3ad74 None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:35.412916 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783c9f59-3980-4be5-ba28-d92a0cb3ad74 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:35.413420 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783c9f59-3980-4be5-ba28-d92a0cb3ad74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:35.415164 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783c9f59-3980-4be5-ba28-d92a0cb3ad74 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:35.425971 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 443/887] 10.222.0.62 () {56 vars in 1122 bytes} [Fri May 27 16:09:35 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:35.427514 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa082add-5f02-484a-ab36-9b4be863f19f None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:35.486890 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:35.539955 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa082add-5f02-484a-ab36-9b4be863f19f None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:35.580296 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a05c9-e702-44c8-865b-ba1559709c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:35.581355 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a05c9-e702-44c8-865b-ba1559709c56 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:35.581853 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a05c9-e702-44c8-865b-ba1559709c56 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:35.582350 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a05c9-e702-44c8-865b-ba1559709c56 None admin] PATH_INFO: `/v3/services` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:35.583297 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354a05c9-e702-44c8-865b-ba1559709c56 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:35.583811 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354a05c9-e702-44c8-865b-ba1559709c56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:35.585366 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354a05c9-e702-44c8-865b-ba1559709c56 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:35.590720 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 445/888] 10.222.0.62 () {56 vars in 1122 bytes} [Fri May 27 16:09:35 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:35.909617 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da56dd0-98cd-40c6-8980-bee65f8f40f9 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:35.909947 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da56dd0-98cd-40c6-8980-bee65f8f40f9 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:35.910185 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da56dd0-98cd-40c6-8980-bee65f8f40f9 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:35.912035 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 444/889] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:09:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:09:35.917281 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1466935-7f5e-4b17-a458-34c5c83b05d7 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:35.917726 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1466935-7f5e-4b17-a458-34c5c83b05d7 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:35.917896 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1466935-7f5e-4b17-a458-34c5c83b05d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:35.935446 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-a1466935-7f5e-4b17-a458-34c5c83b05d7 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:09:35.936638 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-a1466935-7f5e-4b17-a458-34c5c83b05d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:09:36.009075 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 446/890] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:09:35 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:09:36.031775 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da56dd0-98cd-40c6-8980-bee65f8f40f9 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:36.064418 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:36.141674 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da56dd0-98cd-40c6-8980-bee65f8f40f9 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:36.178416 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b821c660-5d1a-474f-bdf3-9ddf1dd751ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:36.179351 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b821c660-5d1a-474f-bdf3-9ddf1dd751ee None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:36.179633 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b821c660-5d1a-474f-bdf3-9ddf1dd751ee None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:36.179902 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b821c660-5d1a-474f-bdf3-9ddf1dd751ee None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:36.190768 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b821c660-5d1a-474f-bdf3-9ddf1dd751ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:09:36.199241 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-b821c660-5d1a-474f-bdf3-9ddf1dd751ee None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 16:09:36.199241 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:36.199241 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:36.199241 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:36.199241 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:36.199241 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:36.199241 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:36.199241 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:36.199241 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:36.199241 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:36.199241 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:36.199241 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:36.199241 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:09:36.199241 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:09:36.199241 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:09:36.199241 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:09:36.200182 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:09:36.200182 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:09:36.200182 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:09:36.200182 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:09:36.200182 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:36.200182 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:36.200182 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:36.200182 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:36.200182 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:36.200182 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:36.200182 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:36.200182 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:09:36.200182 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:36.200182 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:36.200182 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:36.200182 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:36.201031 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:36.201031 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:36.201031 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:36.201031 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:36.201031 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:09:36.201031 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:09:36.201031 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:09:36.201031 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:09:36.201031 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:09:36.201031 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:09:36.201031 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 16:09:36.201031 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:36.201031 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 445/891] 10.222.0.62 () {56 vars in 1120 bytes} [Fri May 27 16:09:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:36.206570 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1466935-7f5e-4b17-a458-34c5c83b05d7 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:36.235573 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4186eff4-d705-4b02-8ee0-c0e23b6cfb80 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:36.235843 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4186eff4-d705-4b02-8ee0-c0e23b6cfb80 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:36.236127 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4186eff4-d705-4b02-8ee0-c0e23b6cfb80 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:36.238344 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 446/892] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:09:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:09:36.243257 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c86e6-e0d4-4433-9033-e88cb76cb0fc None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:36.243554 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c86e6-e0d4-4433-9033-e88cb76cb0fc None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:36.243830 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c86e6-e0d4-4433-9033-e88cb76cb0fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:36.257519 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:36.264622 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-e11c86e6-e0d4-4433-9033-e88cb76cb0fc None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:09:36.266082 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-e11c86e6-e0d4-4433-9033-e88cb76cb0fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:09:36.320719 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1466935-7f5e-4b17-a458-34c5c83b05d7 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:36.352905 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 447/893] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:09:36 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 16:09:36.361644 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd371e5-7969-4af7-8c21-43efd6186c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:36.362347 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd371e5-7969-4af7-8c21-43efd6186c78 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:36.362635 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd371e5-7969-4af7-8c21-43efd6186c78 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:36.362912 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd371e5-7969-4af7-8c21-43efd6186c78 None admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:36.363667 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd371e5-7969-4af7-8c21-43efd6186c78 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:36.363973 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd371e5-7969-4af7-8c21-43efd6186c78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:36.365593 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd371e5-7969-4af7-8c21-43efd6186c78 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:36.375357 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11c86e6-e0d4-4433-9033-e88cb76cb0fc None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:36.382551 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 447/894] 10.222.0.62 () {56 vars in 1115 bytes} [Fri May 27 16:09:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:36.383514 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd371e5-7969-4af7-8c21-43efd6186c78 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:36.395286 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:36.506724 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd371e5-7969-4af7-8c21-43efd6186c78 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:36.509946 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:36.510600 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11c86e6-e0d4-4433-9033-e88cb76cb0fc None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:36.542836 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b804669-a6fa-4bdb-8445-53e32a113b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:36.543784 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b804669-a6fa-4bdb-8445-53e32a113b4a None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:36.544169 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b804669-a6fa-4bdb-8445-53e32a113b4a None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:36.544549 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b804669-a6fa-4bdb-8445-53e32a113b4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:36.552264 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7991f9-2697-4729-a1ce-c9bb96ca6f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:36.554348 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7991f9-2697-4729-a1ce-c9bb96ca6f12 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:36.554629 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7991f9-2697-4729-a1ce-c9bb96ca6f12 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:36.554904 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7991f9-2697-4729-a1ce-c9bb96ca6f12 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:36.556074 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7991f9-2697-4729-a1ce-c9bb96ca6f12 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:36.557661 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b804669-a6fa-4bdb-8445-53e32a113b4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:36.557779 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7991f9-2697-4729-a1ce-c9bb96ca6f12 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:36.559505 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b804669-a6fa-4bdb-8445-53e32a113b4a None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:36.572218 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-5b7991f9-2697-4729-a1ce-c9bb96ca6f12 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 16:09:36.572218 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:36.572218 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 16:09:36.572218 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 16:09:36.572218 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 16:09:36.572218 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 16:09:36.572218 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 16:09:36.572218 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:09:36.572218 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 16:09:36.572218 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:36.572218 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 16:09:36.572218 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:36.572218 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:36.572218 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:36.572218 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:36.572218 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:36.572218 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:36.573987 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:36.573987 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:36.573987 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:36.573987 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:36.573987 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:36.573987 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:36.573987 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 16:09:36.573987 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 16:09:36.573987 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 16:09:36.573987 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 16:09:36.573987 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:36.573987 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:36.573987 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:36.573987 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:36.573987 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:36.573987 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:36.575122 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:36.575122 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:09:36.575122 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:36.575122 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:36.575122 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:36.575122 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:36.575122 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:36.575122 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:36.575122 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:36.575122 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:36.575122 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 16:09:36.575122 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:09:36.575122 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 16:09:36.575122 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:36.575122 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 448/895] 10.222.0.62 () {56 vars in 1114 bytes} [Fri May 27 16:09:36 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:09:36.582282 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7991f9-2697-4729-a1ce-c9bb96ca6f12 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:36.584355 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-9b804669-a6fa-4bdb-8445-53e32a113b4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:36.584355 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:36.584355 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:36.584355 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:36.584355 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:36.584355 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:36.584355 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:36.584355 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:36.584355 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:36.584355 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:36.584355 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:36.584355 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:36.584355 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:09:36.584355 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:09:36.584355 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:09:36.586187 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:09:36.586187 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:36.586187 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:36.586187 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:36.586187 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:36.586187 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:36.586187 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:36.586187 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:36.586187 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:09:36.586187 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:36.586187 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:36.586187 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:36.586187 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:36.586187 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:36.586187 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:36.586187 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:36.586187 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:36.588221 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:09:36.588221 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:09:36.588221 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:36.588221 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:36.588221 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 448/896] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:09:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:36.594269 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b804669-a6fa-4bdb-8445-53e32a113b4a None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:36.689594 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:36.701374 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b804669-a6fa-4bdb-8445-53e32a113b4a None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:36.715903 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7991f9-2697-4729-a1ce-c9bb96ca6f12 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:36.742762 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64feb5d-54fc-4d8a-a5df-26b4dea20bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:36.743436 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64feb5d-54fc-4d8a-a5df-26b4dea20bbd None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:36.743768 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64feb5d-54fc-4d8a-a5df-26b4dea20bbd None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:36.744050 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64feb5d-54fc-4d8a-a5df-26b4dea20bbd None admin] PATH_INFO: `/v3/domains` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:36.745347 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64feb5d-54fc-4d8a-a5df-26b4dea20bbd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:36.745733 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64feb5d-54fc-4d8a-a5df-26b4dea20bbd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:36.747903 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64feb5d-54fc-4d8a-a5df-26b4dea20bbd None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:36.761463 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed0b65b-743c-4362-a956-fc8e5a4d5a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:36.762381 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed0b65b-743c-4362-a956-fc8e5a4d5a91 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:36.762668 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed0b65b-743c-4362-a956-fc8e5a4d5a91 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:36.762943 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed0b65b-743c-4362-a956-fc8e5a4d5a91 None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:36.763651 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed0b65b-743c-4362-a956-fc8e5a4d5a91 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:36.763958 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed0b65b-743c-4362-a956-fc8e5a4d5a91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:36.765395 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed0b65b-743c-4362-a956-fc8e5a4d5a91 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:36.768613 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 449/897] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 16:09:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:36.770067 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64feb5d-54fc-4d8a-a5df-26b4dea20bbd None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:36.772541 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 449/898] 10.222.0.62 () {56 vars in 1114 bytes} [Fri May 27 16:09:36 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:36.779313 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed0b65b-743c-4362-a956-fc8e5a4d5a91 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:36.790371 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:36.876465 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64feb5d-54fc-4d8a-a5df-26b4dea20bbd None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:36.906725 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed0b65b-743c-4362-a956-fc8e5a4d5a91 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:36.912114 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac3f8eb-2ba5-4cfe-b5c4-02fbfdc18799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:36.913115 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac3f8eb-2ba5-4cfe-b5c4-02fbfdc18799 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:36.913541 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac3f8eb-2ba5-4cfe-b5c4-02fbfdc18799 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:36.913958 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac3f8eb-2ba5-4cfe-b5c4-02fbfdc18799 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:36.921898 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac3f8eb-2ba5-4cfe-b5c4-02fbfdc18799 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:36.923932 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac3f8eb-2ba5-4cfe-b5c4-02fbfdc18799 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:36.939766 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-0ac3f8eb-2ba5-4cfe-b5c4-02fbfdc18799 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 16:09:36.939766 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:36.939766 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:36.939766 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:36.939766 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:36.939766 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:36.939766 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:36.939766 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:36.939766 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:36.939766 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:36.939766 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:36.939766 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:36.939766 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 16:09:36.939766 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 16:09:36.939766 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 16:09:36.939766 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 16:09:36.940693 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:36.940693 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:36.940693 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 16:09:36.940693 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:09:36.940693 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 16:09:36.940693 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:09:36.940693 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:36.940693 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:36.940693 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:36.940693 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:36.940693 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:36.940693 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:09:36.940693 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:36.940693 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:36.940693 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:36.940693 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:36.940693 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:36.940693 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:36.941624 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:36.941624 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:36.941624 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 16:09:36.941624 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 16:09:36.941624 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 16:09:36.941624 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 16:09:36.941624 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 16:09:36.941624 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 16:09:36.941624 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 16:09:36.941624 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:36.944874 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 450/899] 10.222.0.62 () {56 vars in 1117 bytes} [Fri May 27 16:09:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:36.950142 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac3f8eb-2ba5-4cfe-b5c4-02fbfdc18799 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:36.951150 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f31ddcc-5b17-4a1b-92c9-353a09ce59c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:36.951818 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31ddcc-5b17-4a1b-92c9-353a09ce59c4 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:36.952098 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31ddcc-5b17-4a1b-92c9-353a09ce59c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:36.952369 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31ddcc-5b17-4a1b-92c9-353a09ce59c4 None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:36.953075 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f31ddcc-5b17-4a1b-92c9-353a09ce59c4 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:36.953378 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f31ddcc-5b17-4a1b-92c9-353a09ce59c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:36.954782 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f31ddcc-5b17-4a1b-92c9-353a09ce59c4 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:36.966101 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 450/900] 10.222.0.62 () {56 vars in 1114 bytes} [Fri May 27 16:09:36 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:36.967419 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f31ddcc-5b17-4a1b-92c9-353a09ce59c4 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:36.980848 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:37.039143 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:37.063738 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac3f8eb-2ba5-4cfe-b5c4-02fbfdc18799 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:37.081980 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f31ddcc-5b17-4a1b-92c9-353a09ce59c4 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:37.101366 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec279c3e-8644-42f0-8557-dabb254978a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:37.102063 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec279c3e-8644-42f0-8557-dabb254978a5 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:37.102608 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec279c3e-8644-42f0-8557-dabb254978a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:37.102718 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec279c3e-8644-42f0-8557-dabb254978a5 None admin] PATH_INFO: `/v3/users` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:37.103563 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec279c3e-8644-42f0-8557-dabb254978a5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:37.103874 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec279c3e-8644-42f0-8557-dabb254978a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:37.105427 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec279c3e-8644-42f0-8557-dabb254978a5 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:37.122071 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bb985f-0e27-4597-92fa-f7adff4cdadd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:37.123183 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb985f-0e27-4597-92fa-f7adff4cdadd None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:37.123675 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb985f-0e27-4597-92fa-f7adff4cdadd None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:37.124195 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb985f-0e27-4597-92fa-f7adff4cdadd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:37.129531 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bb985f-0e27-4597-92fa-f7adff4cdadd None admin] RBAC: Adding query filter params (interface=public, service_id=6f1e4d1aba5c4d68bfb8759e53c50e04, region_id=RegionOne) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:37.129694 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 451/901] 10.222.0.62 () {56 vars in 1149 bytes} [Fri May 27 16:09:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:09:37.129786 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bb985f-0e27-4597-92fa-f7adff4cdadd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:37.129786 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bb985f-0e27-4597-92fa-f7adff4cdadd None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:37.131210 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec279c3e-8644-42f0-8557-dabb254978a5 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:37.137778 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 451/902] 10.222.0.62 () {56 vars in 1251 bytes} [Fri May 27 16:09:36 2022] GET /identity/v3/endpoints?service_id=6f1e4d1aba5c4d68bfb8759e53c50e04&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:09:37.143386 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bb985f-0e27-4597-92fa-f7adff4cdadd None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:37.223190 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:37.238004 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec279c3e-8644-42f0-8557-dabb254978a5 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:37.258614 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bb985f-0e27-4597-92fa-f7adff4cdadd None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:37.275417 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c2040-3951-4a2b-a276-f70afc5adacc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:37.276079 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c2040-3951-4a2b-a276-f70afc5adacc None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:37.276341 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c2040-3951-4a2b-a276-f70afc5adacc None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:37.276620 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c2040-3951-4a2b-a276-f70afc5adacc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:37.279569 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:37.298832 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2552279-0a73-4cdd-af0b-921a663e59ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:37.301558 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2552279-0a73-4cdd-af0b-921a663e59ed None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:37.302669 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2552279-0a73-4cdd-af0b-921a663e59ed None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:37.303172 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2552279-0a73-4cdd-af0b-921a663e59ed None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:37.304229 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2552279-0a73-4cdd-af0b-921a663e59ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:37.305966 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2552279-0a73-4cdd-af0b-921a663e59ed None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:37.320179 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 452/903] 10.222.0.62 () {56 vars in 1087 bytes} [Fri May 27 16:09:37 2022] GET /identity/v3/services => generated 1268 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 16:09:37.353600 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060c2040-3951-4a2b-a276-f70afc5adacc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:37.355249 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060c2040-3951-4a2b-a276-f70afc5adacc None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:37.471804 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 452/904] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 16:09:37 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 27 16:09:37.478188 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2552279-0a73-4cdd-af0b-921a663e59ed None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:37.570295 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c7fbf-7bf6-49db-8cf2-749641187622 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:37.570600 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c7fbf-7bf6-49db-8cf2-749641187622 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:37.570913 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c7fbf-7bf6-49db-8cf2-749641187622 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:37.572465 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 453/905] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:09:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:09:37.578718 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df098053-bc53-4c56-9f86-808c37627ad7 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:37.579009 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df098053-bc53-4c56-9f86-808c37627ad7 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:37.579294 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df098053-bc53-4c56-9f86-808c37627ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:37.590780 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2552279-0a73-4cdd-af0b-921a663e59ed None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:37.600366 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-df098053-bc53-4c56-9f86-808c37627ad7 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:09:37.602071 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-df098053-bc53-4c56-9f86-808c37627ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:09:37.631486 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb97e912-d66d-44ee-8f06-bdc178fd24a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:37.632862 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb97e912-d66d-44ee-8f06-bdc178fd24a8 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:37.633150 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb97e912-d66d-44ee-8f06-bdc178fd24a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:37.633424 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb97e912-d66d-44ee-8f06-bdc178fd24a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:37.635078 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:37.636804 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:37.649727 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb97e912-d66d-44ee-8f06-bdc178fd24a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:37.651302 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb97e912-d66d-44ee-8f06-bdc178fd24a8 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:37.675643 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-cb97e912-d66d-44ee-8f06-bdc178fd24a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:37.675643 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:37.675643 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:37.675643 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:37.675643 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:37.675643 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:37.675643 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:37.675643 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:37.675643 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:37.675643 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:37.675643 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:37.675643 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:37.675643 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:09:37.675643 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:09:37.675643 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:09:37.676873 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:09:37.676873 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:37.676873 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:37.676873 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:37.676873 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:37.676873 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:37.676873 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:37.676873 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:37.676873 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:09:37.676873 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:37.676873 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:37.676873 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:37.676873 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:37.676873 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:37.676873 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:37.676873 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:37.676873 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:37.678016 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:09:37.678016 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:09:37.678016 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:37.678016 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:37.678016 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 453/906] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:09:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:37.686373 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb97e912-d66d-44ee-8f06-bdc178fd24a8 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:37.693800 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 454/907] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:09:37 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 16:09:37.716491 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df098053-bc53-4c56-9f86-808c37627ad7 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:37.808317 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb97e912-d66d-44ee-8f06-bdc178fd24a8 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:37.841538 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df098053-bc53-4c56-9f86-808c37627ad7 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:37.843759 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fc763a-dca0-4cdf-abb4-71fc4b086a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:37.844499 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc763a-dca0-4cdf-abb4-71fc4b086a18 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:37.844786 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc763a-dca0-4cdf-abb4-71fc4b086a18 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:37.845113 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc763a-dca0-4cdf-abb4-71fc4b086a18 None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:37.845855 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fc763a-dca0-4cdf-abb4-71fc4b086a18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:37.846166 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fc763a-dca0-4cdf-abb4-71fc4b086a18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:37.847574 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fc763a-dca0-4cdf-abb4-71fc4b086a18 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:37.866520 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 454/908] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 16:09:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:09:37.867984 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf03a1-de7b-4b4e-b9d0-9ab6bfa77326 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:37.868279 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf03a1-de7b-4b4e-b9d0-9ab6bfa77326 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:37.868560 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf03a1-de7b-4b4e-b9d0-9ab6bfa77326 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:37.870015 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 455/909] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:09:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:09:37.878270 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cf03a1-de7b-4b4e-b9d0-9ab6bfa77326 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:37.883368 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdd1cd3-14d6-49ab-94aa-5e417dbcd1e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:37.884603 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd1cd3-14d6-49ab-94aa-5e417dbcd1e1 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:37.884884 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd1cd3-14d6-49ab-94aa-5e417dbcd1e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:37.885162 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd1cd3-14d6-49ab-94aa-5e417dbcd1e1 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:37.886170 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdd1cd3-14d6-49ab-94aa-5e417dbcd1e1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:37.887898 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdd1cd3-14d6-49ab-94aa-5e417dbcd1e1 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:37.900374 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-7fdd1cd3-14d6-49ab-94aa-5e417dbcd1e1 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 16:09:37.900374 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:37.900374 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 16:09:37.900374 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 16:09:37.900374 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 16:09:37.900374 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 16:09:37.900374 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 16:09:37.900374 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:09:37.900374 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 16:09:37.900374 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:37.900374 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 16:09:37.900374 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:37.900374 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:37.900374 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:37.900374 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:37.900374 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:37.901487 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:37.901487 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:37.901487 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:37.901487 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:37.901487 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:37.901487 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:37.901487 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:37.901487 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 16:09:37.901487 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 16:09:37.901487 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 16:09:37.901487 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 16:09:37.901487 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:37.901487 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:37.901487 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:37.901487 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:37.901487 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:37.902512 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:37.902512 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:37.902512 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:09:37.902512 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:37.902512 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:37.902512 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:37.902512 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:37.902512 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:37.902512 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:37.902512 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:37.902512 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:37.902512 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 16:09:37.902512 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:09:37.902512 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 16:09:37.902512 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:37.902512 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 455/910] 10.222.0.62 () {56 vars in 1132 bytes} [Fri May 27 16:09:37 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:09:37.903562 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcfcc93-058b-4bee-a884-39ba32289c0f None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:37.903562 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcfcc93-058b-4bee-a884-39ba32289c0f None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:37.903562 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcfcc93-058b-4bee-a884-39ba32289c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:37.921936 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-5dcfcc93-058b-4bee-a884-39ba32289c0f None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:09:37.923184 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-5dcfcc93-058b-4bee-a884-39ba32289c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:09:37.931892 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:37.949612 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:37.983610 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cf03a1-de7b-4b4e-b9d0-9ab6bfa77326 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:37.993856 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 456/911] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:09:37 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:09:37.995035 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcfcc93-058b-4bee-a884-39ba32289c0f None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:38.031138 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ea270c-03d4-447a-8414-d7539c870d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:38.031939 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea270c-03d4-447a-8414-d7539c870d82 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:38.032228 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea270c-03d4-447a-8414-d7539c870d82 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:38.032524 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea270c-03d4-447a-8414-d7539c870d82 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:38.040142 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ea270c-03d4-447a-8414-d7539c870d82 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:38.041592 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ea270c-03d4-447a-8414-d7539c870d82 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:38.056792 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-b0ea270c-03d4-447a-8414-d7539c870d82 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:09:38.056792 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:38.056792 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:38.056792 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:38.056792 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:38.056792 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:38.056792 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:38.056792 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:38.056792 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:38.056792 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:38.056792 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:38.056792 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:38.056792 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 16:09:38.056792 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 16:09:38.056792 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 16:09:38.057676 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 16:09:38.057676 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:38.057676 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:38.057676 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:38.057676 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:38.057676 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:38.057676 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:38.057676 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:38.057676 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:09:38.057676 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:38.057676 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:38.057676 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:38.057676 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:38.057676 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:38.057676 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:38.057676 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:38.057676 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:38.059347 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 16:09:38.059347 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 16:09:38.059347 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 16:09:38.059347 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 16:09:38.059347 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 16:09:38.059347 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 16:09:38.059347 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:09:38.059347 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:38.059347 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 456/912] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 16:09:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:09:38.063059 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ea270c-03d4-447a-8414-d7539c870d82 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:38.103928 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcfcc93-058b-4bee-a884-39ba32289c0f None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:38.138866 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7322c257-0078-4ef6-af8f-aeae0f7e5235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:38.139531 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322c257-0078-4ef6-af8f-aeae0f7e5235 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:38.139822 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322c257-0078-4ef6-af8f-aeae0f7e5235 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:38.140095 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322c257-0078-4ef6-af8f-aeae0f7e5235 None admin] PATH_INFO: `/v3/services` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:38.140801 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7322c257-0078-4ef6-af8f-aeae0f7e5235 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:38.141110 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7322c257-0078-4ef6-af8f-aeae0f7e5235 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:38.142505 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7322c257-0078-4ef6-af8f-aeae0f7e5235 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:38.152122 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 457/913] 10.222.0.62 () {56 vars in 1126 bytes} [Fri May 27 16:09:37 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:38.152976 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7322c257-0078-4ef6-af8f-aeae0f7e5235 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:38.171037 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ea270c-03d4-447a-8414-d7539c870d82 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:38.178821 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:38.181195 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:38.206115 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6edbce1-ddc2-4186-8e61-db59c83e9ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:38.206811 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6edbce1-ddc2-4186-8e61-db59c83e9ab7 None admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:38.207099 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6edbce1-ddc2-4186-8e61-db59c83e9ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:38.207379 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6edbce1-ddc2-4186-8e61-db59c83e9ab7 None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:38.208149 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6edbce1-ddc2-4186-8e61-db59c83e9ab7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:38.209518 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6edbce1-ddc2-4186-8e61-db59c83e9ab7 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:38.255712 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7322c257-0078-4ef6-af8f-aeae0f7e5235 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:38.289350 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e12236d-1aec-4953-88a6-a83710a75cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:38.290001 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e12236d-1aec-4953-88a6-a83710a75cd6 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:38.290310 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e12236d-1aec-4953-88a6-a83710a75cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:38.290591 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e12236d-1aec-4953-88a6-a83710a75cd6 None admin] PATH_INFO: `/v3/projects` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:38.291368 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e12236d-1aec-4953-88a6-a83710a75cd6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:38.291674 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e12236d-1aec-4953-88a6-a83710a75cd6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:38.293087 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e12236d-1aec-4953-88a6-a83710a75cd6 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:38.305020 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 458/914] 10.222.0.62 () {56 vars in 1148 bytes} [Fri May 27 16:09:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:38.305871 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e12236d-1aec-4953-88a6-a83710a75cd6 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:38.336166 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 457/915] 10.222.0.62 () {60 vars in 1141 bytes} [Fri May 27 16:09:38 2022] POST /identity/v3/services => generated 241 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:09:38.336166 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6edbce1-ddc2-4186-8e61-db59c83e9ab7 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:38.414370 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:38.436773 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e12236d-1aec-4953-88a6-a83710a75cd6 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:38.488218 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f902f16-52f8-4ae7-9dd3-0ae68bd42658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:38.489247 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f902f16-52f8-4ae7-9dd3-0ae68bd42658 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:38.489725 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f902f16-52f8-4ae7-9dd3-0ae68bd42658 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:38.490155 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f902f16-52f8-4ae7-9dd3-0ae68bd42658 None admin] PATH_INFO: `/v3/services` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:38.491090 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f902f16-52f8-4ae7-9dd3-0ae68bd42658 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:38.491624 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f902f16-52f8-4ae7-9dd3-0ae68bd42658 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:38.493569 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f902f16-52f8-4ae7-9dd3-0ae68bd42658 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:38.493752 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6edbce1-ddc2-4186-8e61-db59c83e9ab7 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:38.501433 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 459/916] 10.222.0.62 () {56 vars in 1126 bytes} [Fri May 27 16:09:38 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:38.515526 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f902f16-52f8-4ae7-9dd3-0ae68bd42658 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:38.537969 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc38324-5cd7-44e4-80ae-ac52e055a171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:38.538668 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc38324-5cd7-44e4-80ae-ac52e055a171 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:38.538959 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc38324-5cd7-44e4-80ae-ac52e055a171 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:38.539245 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc38324-5cd7-44e4-80ae-ac52e055a171 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:38.540082 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc38324-5cd7-44e4-80ae-ac52e055a171 None admin] RBAC: Adding query filter params (role.id=769bfee541f54e48ab47d4056838a1e5, scope.project.id=d48d95a12587479ca5714f6ebd60dd9f, user.id=eb50bf5f39b04ab689b55f46d3dd2640) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:38.540400 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc38324-5cd7-44e4-80ae-ac52e055a171 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:38.541842 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc38324-5cd7-44e4-80ae-ac52e055a171 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:38.550091 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 458/917] 10.222.0.62 () {56 vars in 1374 bytes} [Fri May 27 16:09:38 2022] GET /identity/v3/role_assignments?user.id=eb50bf5f39b04ab689b55f46d3dd2640&scope.project.id=d48d95a12587479ca5714f6ebd60dd9f&role.id=769bfee541f54e48ab47d4056838a1e5 => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:38.647133 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f902f16-52f8-4ae7-9dd3-0ae68bd42658 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:38.688268 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb51aaf9-3341-4711-934b-cdf51fd3ab95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:38.688953 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb51aaf9-3341-4711-934b-cdf51fd3ab95 None admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:38.689284 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb51aaf9-3341-4711-934b-cdf51fd3ab95 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:38.689568 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb51aaf9-3341-4711-934b-cdf51fd3ab95 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:38.690349 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb51aaf9-3341-4711-934b-cdf51fd3ab95 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:38.691820 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb51aaf9-3341-4711-934b-cdf51fd3ab95 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:38.748921 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:38.755512 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 460/918] 10.222.0.62 () {60 vars in 1144 bytes} [Fri May 27 16:09:38 2022] POST /identity/v3/endpoints => generated 347 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:09:39.616061 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e774c-01b5-4b9c-8cde-3904a5a490b5 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:39.616581 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e774c-01b5-4b9c-8cde-3904a5a490b5 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:39.616690 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e774c-01b5-4b9c-8cde-3904a5a490b5 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:39.618108 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 459/919] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:09:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:09:39.623591 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c7afcc-8557-4b72-959d-a8d090fe3c2b None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:39.624401 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c7afcc-8557-4b72-959d-a8d090fe3c2b None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:39.624901 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c7afcc-8557-4b72-959d-a8d090fe3c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:39.641942 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-33c7afcc-8557-4b72-959d-a8d090fe3c2b None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:09:39.643443 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-33c7afcc-8557-4b72-959d-a8d090fe3c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:09:39.721578 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 461/920] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:09:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:09:39.744794 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610e774c-01b5-4b9c-8cde-3904a5a490b5 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:39.775461 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:39.855349 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610e774c-01b5-4b9c-8cde-3904a5a490b5 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:39.891329 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1c6409-a5d1-4bcb-a026-4e5dba8a6b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:39.892131 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c6409-a5d1-4bcb-a026-4e5dba8a6b47 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:39.892410 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c6409-a5d1-4bcb-a026-4e5dba8a6b47 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:39.892788 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c6409-a5d1-4bcb-a026-4e5dba8a6b47 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:39.893441 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1c6409-a5d1-4bcb-a026-4e5dba8a6b47 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:39.894836 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1c6409-a5d1-4bcb-a026-4e5dba8a6b47 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:39.906677 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-2a1c6409-a5d1-4bcb-a026-4e5dba8a6b47 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 16:09:39.906677 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:39.906677 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 16:09:39.906677 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 16:09:39.906677 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 16:09:39.906677 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 16:09:39.906677 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 16:09:39.906677 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:09:39.906677 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 16:09:39.906677 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:39.906677 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 16:09:39.906677 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:39.906677 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:39.906677 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:39.906677 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:39.906677 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:39.906677 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:39.907689 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:39.907689 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:39.907689 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:39.907689 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:39.907689 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:39.907689 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:39.907689 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 16:09:39.907689 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 16:09:39.907689 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 16:09:39.907689 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 16:09:39.907689 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:39.907689 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:39.907689 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:39.907689 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:39.907689 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:39.907689 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:39.908520 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:39.908520 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:09:39.908520 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:39.908520 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:39.908520 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:39.908520 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:39.908520 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:39.908520 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:39.908520 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:39.908520 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:39.908520 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 16:09:39.908520 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:09:39.908520 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 16:09:39.908520 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:39.908520 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 460/921] 10.222.0.62 () {56 vars in 1114 bytes} [Fri May 27 16:09:39 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:39.916063 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c7afcc-8557-4b72-959d-a8d090fe3c2b None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:40.020090 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c7afcc-8557-4b72-959d-a8d090fe3c2b None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:40.044371 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:40.056330 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab506c8d-de27-484d-945c-486df476d669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:40.057350 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab506c8d-de27-484d-945c-486df476d669 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:40.057833 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab506c8d-de27-484d-945c-486df476d669 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:40.058351 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab506c8d-de27-484d-945c-486df476d669 None admin] PATH_INFO: `/v3/services` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:40.059255 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab506c8d-de27-484d-945c-486df476d669 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:40.059760 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab506c8d-de27-484d-945c-486df476d669 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:40.061326 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab506c8d-de27-484d-945c-486df476d669 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:40.066669 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 462/922] 10.222.0.62 () {56 vars in 1114 bytes} [Fri May 27 16:09:39 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:40.073630 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1c6409-a5d1-4bcb-a026-4e5dba8a6b47 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:40.172391 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:40.182150 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1c6409-a5d1-4bcb-a026-4e5dba8a6b47 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:40.217077 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59975ce4-f311-404d-876e-df15b5128f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:40.217745 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59975ce4-f311-404d-876e-df15b5128f81 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:40.218060 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59975ce4-f311-404d-876e-df15b5128f81 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:40.218322 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59975ce4-f311-404d-876e-df15b5128f81 None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:40.219027 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59975ce4-f311-404d-876e-df15b5128f81 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:40.219336 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59975ce4-f311-404d-876e-df15b5128f81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:40.220751 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59975ce4-f311-404d-876e-df15b5128f81 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:40.228013 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 461/923] 10.222.0.62 () {56 vars in 1114 bytes} [Fri May 27 16:09:40 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:40.233415 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab506c8d-de27-484d-945c-486df476d669 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:40.341089 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab506c8d-de27-484d-945c-486df476d669 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:40.377080 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c562cd3b-e862-4c6c-943d-0582fea79153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:40.377797 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562cd3b-e862-4c6c-943d-0582fea79153 None admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:40.378086 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562cd3b-e862-4c6c-943d-0582fea79153 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:40.378390 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562cd3b-e862-4c6c-943d-0582fea79153 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:40.379144 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c562cd3b-e862-4c6c-943d-0582fea79153 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:40.381062 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c562cd3b-e862-4c6c-943d-0582fea79153 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:40.486093 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 463/924] 10.222.0.62 () {60 vars in 1144 bytes} [Fri May 27 16:09:40 2022] POST /identity/v3/endpoints => generated 346 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:09:40.655288 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5262b303-d265-4270-9bca-a05de0c8c061 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:40.655836 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5262b303-d265-4270-9bca-a05de0c8c061 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:40.655836 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5262b303-d265-4270-9bca-a05de0c8c061 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:40.657490 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 462/925] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:09:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:09:40.663983 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6abc62-73aa-4e59-bedd-e3d6c85a50c2 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:40.664496 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6abc62-73aa-4e59-bedd-e3d6c85a50c2 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:40.664591 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6abc62-73aa-4e59-bedd-e3d6c85a50c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:40.683183 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-dc6abc62-73aa-4e59-bedd-e3d6c85a50c2 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:09:40.684792 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-dc6abc62-73aa-4e59-bedd-e3d6c85a50c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:09:40.732049 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:40.765993 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 464/926] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:09:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:09:40.791604 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5262b303-d265-4270-9bca-a05de0c8c061 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:40.881658 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b9bd56-5394-4b08-99cf-4852986e81f3 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:40.881952 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b9bd56-5394-4b08-99cf-4852986e81f3 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:40.882238 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b9bd56-5394-4b08-99cf-4852986e81f3 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:40.883892 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 465/927] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:09:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:09:40.888936 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd4dbf8-7bc3-4886-ba15-d44a855b403e None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:40.889233 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd4dbf8-7bc3-4886-ba15-d44a855b403e None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:40.889520 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd4dbf8-7bc3-4886-ba15-d44a855b403e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:40.907741 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5262b303-d265-4270-9bca-a05de0c8c061 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:40.908285 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-8cd4dbf8-7bc3-4886-ba15-d44a855b403e None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:09:40.909529 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-8cd4dbf8-7bc3-4886-ba15-d44a855b403e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:09:40.948852 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3599f0bc-8f54-4ebd-972c-91c51e0c468f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:40.950104 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599f0bc-8f54-4ebd-972c-91c51e0c468f None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:40.950655 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599f0bc-8f54-4ebd-972c-91c51e0c468f None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:40.951128 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599f0bc-8f54-4ebd-972c-91c51e0c468f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:40.951993 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3599f0bc-8f54-4ebd-972c-91c51e0c468f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:40.953577 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3599f0bc-8f54-4ebd-972c-91c51e0c468f None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:40.967580 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-3599f0bc-8f54-4ebd-972c-91c51e0c468f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 16:09:40.967580 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:40.967580 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 16:09:40.967580 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 16:09:40.967580 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 16:09:40.967580 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 16:09:40.967580 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 16:09:40.967580 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:09:40.967580 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 16:09:40.967580 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:40.967580 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 16:09:40.967580 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:40.967580 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:40.967580 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:40.967580 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:40.967580 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:40.967580 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:40.968602 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:40.968602 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:40.968602 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:40.968602 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:40.968602 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:40.968602 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:40.968602 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 16:09:40.968602 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 16:09:40.968602 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 16:09:40.968602 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 16:09:40.968602 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:40.968602 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:40.968602 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:40.968602 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:40.968602 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:40.968602 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:40.969438 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:40.969438 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:09:40.969438 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:40.969438 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:40.969438 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:40.969438 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:40.969438 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:40.969438 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:40.969438 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:40.969438 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:40.969438 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 16:09:40.969438 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:09:40.969438 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 16:09:40.969438 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:40.972370 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 463/928] 10.222.0.62 () {56 vars in 1126 bytes} [Fri May 27 16:09:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:40.978936 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3599f0bc-8f54-4ebd-972c-91c51e0c468f None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:40.998268 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 466/929] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:09:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 16:09:41.010697 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:41.016360 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd4dbf8-7bc3-4886-ba15-d44a855b403e None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:41.087954 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3599f0bc-8f54-4ebd-972c-91c51e0c468f None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:41.119758 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:41.122878 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd4dbf8-7bc3-4886-ba15-d44a855b403e None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:41.123977 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619fb002-ed81-4c3b-8252-c1b6a8c01983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:41.124819 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619fb002-ed81-4c3b-8252-c1b6a8c01983 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:41.125880 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619fb002-ed81-4c3b-8252-c1b6a8c01983 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:41.126168 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619fb002-ed81-4c3b-8252-c1b6a8c01983 None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:41.126945 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619fb002-ed81-4c3b-8252-c1b6a8c01983 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:41.127256 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619fb002-ed81-4c3b-8252-c1b6a8c01983 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:41.128672 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619fb002-ed81-4c3b-8252-c1b6a8c01983 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:41.142020 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 464/930] 10.222.0.62 () {56 vars in 1122 bytes} [Fri May 27 16:09:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:41.142020 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1695e-4cb5-4eed-b5c7-545929696722 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:41.142020 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1695e-4cb5-4eed-b5c7-545929696722 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:41.142020 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1695e-4cb5-4eed-b5c7-545929696722 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:41.142020 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 465/931] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:09:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:09:41.142020 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec1695e-4cb5-4eed-b5c7-545929696722 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:41.159742 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80df97ad-c45e-4755-ad81-2cad94b0daa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:41.160549 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df97ad-c45e-4755-ad81-2cad94b0daa9 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:41.161334 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df97ad-c45e-4755-ad81-2cad94b0daa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:41.161753 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df97ad-c45e-4755-ad81-2cad94b0daa9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:41.172197 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80df97ad-c45e-4755-ad81-2cad94b0daa9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:09:41.181219 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-80df97ad-c45e-4755-ad81-2cad94b0daa9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 16:09:41.181219 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:41.181219 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:41.181219 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:41.181219 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:41.181219 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:41.181219 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:41.181219 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:41.181219 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:41.181219 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:41.181219 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:41.181219 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:41.181219 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:09:41.181219 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:09:41.181219 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:09:41.181219 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:09:41.183245 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:09:41.183245 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:09:41.183245 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:09:41.183245 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:09:41.183245 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:41.183245 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:41.183245 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:41.183245 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:41.183245 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:41.183245 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:41.183245 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:41.183245 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:09:41.183245 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:41.183245 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:41.183245 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:41.183245 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:41.184089 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:41.184089 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:41.184089 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:41.184089 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:41.184089 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:09:41.184089 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:09:41.184089 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:09:41.184089 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:09:41.184089 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:09:41.184089 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:09:41.184089 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 16:09:41.184089 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:41.187253 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 467/932] 10.222.0.62 () {56 vars in 1120 bytes} [Fri May 27 16:09:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:09:41.188394 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6825e-96e2-4d67-af5b-9609c67ea144 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:41.188688 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6825e-96e2-4d67-af5b-9609c67ea144 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:41.188967 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6825e-96e2-4d67-af5b-9609c67ea144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:41.205455 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-a1b6825e-96e2-4d67-af5b-9609c67ea144 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:09:41.206658 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-a1b6825e-96e2-4d67-af5b-9609c67ea144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:09:41.240902 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:41.258207 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec1695e-4cb5-4eed-b5c7-545929696722 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:41.286608 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 468/933] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:09:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:09:41.286608 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b6825e-96e2-4d67-af5b-9609c67ea144 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:41.297929 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fcd550-e7a7-426e-8b63-62fdacb4c01a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:41.298942 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fcd550-e7a7-426e-8b63-62fdacb4c01a None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:41.299398 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fcd550-e7a7-426e-8b63-62fdacb4c01a None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:41.300116 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fcd550-e7a7-426e-8b63-62fdacb4c01a None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:41.301022 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fcd550-e7a7-426e-8b63-62fdacb4c01a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:41.301528 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fcd550-e7a7-426e-8b63-62fdacb4c01a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:41.303185 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fcd550-e7a7-426e-8b63-62fdacb4c01a None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:41.309017 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 466/934] 10.222.0.62 () {56 vars in 1122 bytes} [Fri May 27 16:09:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:09:41.309995 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fcd550-e7a7-426e-8b63-62fdacb4c01a None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:41.398598 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:41.408409 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b6825e-96e2-4d67-af5b-9609c67ea144 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:41.421489 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fcd550-e7a7-426e-8b63-62fdacb4c01a None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:41.446575 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecbabeb-2f87-412d-a1a7-a53c2758e857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:41.447252 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecbabeb-2f87-412d-a1a7-a53c2758e857 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:41.447541 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecbabeb-2f87-412d-a1a7-a53c2758e857 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:41.447826 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecbabeb-2f87-412d-a1a7-a53c2758e857 None admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:41.448576 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecbabeb-2f87-412d-a1a7-a53c2758e857 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:41.448887 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecbabeb-2f87-412d-a1a7-a53c2758e857 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:41.450271 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecbabeb-2f87-412d-a1a7-a53c2758e857 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:41.458764 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 469/935] 10.222.0.62 () {56 vars in 1115 bytes} [Fri May 27 16:09:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:41.459551 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecbabeb-2f87-412d-a1a7-a53c2758e857 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:41.465138 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f561fe8f-af5f-476f-a92c-ad48f515f784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:41.466162 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561fe8f-af5f-476f-a92c-ad48f515f784 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:41.466617 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561fe8f-af5f-476f-a92c-ad48f515f784 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:41.467051 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561fe8f-af5f-476f-a92c-ad48f515f784 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:41.467867 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f561fe8f-af5f-476f-a92c-ad48f515f784 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:41.469798 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f561fe8f-af5f-476f-a92c-ad48f515f784 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:41.486025 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-f561fe8f-af5f-476f-a92c-ad48f515f784 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 27 16:09:41.486025 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:41.486025 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 16:09:41.486025 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 16:09:41.486025 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 16:09:41.486025 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 16:09:41.486025 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 16:09:41.486025 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:09:41.486025 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 27 16:09:41.486025 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:41.486025 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 16:09:41.486025 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:41.486025 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:41.486025 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:41.486025 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:41.486025 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:41.486025 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:41.487291 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:41.487291 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:41.487291 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:41.487291 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:41.487291 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:41.487291 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:41.487291 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 16:09:41.487291 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 16:09:41.487291 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 16:09:41.487291 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 16:09:41.487291 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:41.487291 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:41.487291 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:41.487291 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:41.487291 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:41.487291 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:41.488157 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:41.488157 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:09:41.488157 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:41.488157 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:41.488157 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:41.488157 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:41.488157 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:41.488157 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:41.488157 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:41.488157 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:41.488157 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 16:09:41.488157 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:09:41.488157 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 27 16:09:41.488157 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:41.488952 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 467/936] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 16:09:41 2022] GET /identity/v3/services/compute => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:41.489027 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f561fe8f-af5f-476f-a92c-ad48f515f784 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:41.506873 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:41.566659 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecbabeb-2f87-412d-a1a7-a53c2758e857 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:41.600826 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f561fe8f-af5f-476f-a92c-ad48f515f784 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:41.601094 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43264138-7c61-44ce-b9e6-91abea16bb7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:41.601761 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43264138-7c61-44ce-b9e6-91abea16bb7f None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:41.602050 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43264138-7c61-44ce-b9e6-91abea16bb7f None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:41.602361 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43264138-7c61-44ce-b9e6-91abea16bb7f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:41.603158 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43264138-7c61-44ce-b9e6-91abea16bb7f None admin] RBAC: Adding query filter params (interface=public, service_id=b78656dc9bf74c9bae45c51459fef5f0, region_id=RegionOne) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:41.603475 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43264138-7c61-44ce-b9e6-91abea16bb7f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:41.604847 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43264138-7c61-44ce-b9e6-91abea16bb7f None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:41.609902 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 470/937] 10.222.0.62 () {56 vars in 1251 bytes} [Fri May 27 16:09:41 2022] GET /identity/v3/endpoints?service_id=b78656dc9bf74c9bae45c51459fef5f0&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:41.610722 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43264138-7c61-44ce-b9e6-91abea16bb7f None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:41.635473 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:41.646987 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e75de7-1829-4f06-9d64-7b33dd1514b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:41.647792 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e75de7-1829-4f06-9d64-7b33dd1514b8 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:41.648239 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e75de7-1829-4f06-9d64-7b33dd1514b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:41.648345 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e75de7-1829-4f06-9d64-7b33dd1514b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:41.659897 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e75de7-1829-4f06-9d64-7b33dd1514b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:41.662011 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e75de7-1829-4f06-9d64-7b33dd1514b8 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:41.682760 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-e8e75de7-1829-4f06-9d64-7b33dd1514b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:41.682760 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:41.682760 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:41.682760 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:41.682760 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:41.682760 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:41.682760 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:41.682760 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:41.682760 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:41.682760 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:41.682760 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:41.682760 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:41.682760 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:09:41.682760 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:09:41.682760 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:09:41.683720 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:09:41.683720 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:41.683720 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:41.683720 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:41.683720 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:41.683720 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:41.683720 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:41.683720 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:41.683720 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:09:41.683720 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:41.683720 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:41.683720 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:41.683720 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:41.683720 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:41.683720 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:41.683720 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:41.683720 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:41.684620 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:09:41.684620 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:09:41.684620 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:41.684620 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:41.684620 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 468/938] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:09:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:41.684895 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e75de7-1829-4f06-9d64-7b33dd1514b8 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:41.732450 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43264138-7c61-44ce-b9e6-91abea16bb7f None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:41.750442 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:41.769678 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99ddbe7-6f41-4c5e-b53b-a2f637778f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:41.770434 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ddbe7-6f41-4c5e-b53b-a2f637778f3c None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:41.770727 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ddbe7-6f41-4c5e-b53b-a2f637778f3c None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:41.771248 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ddbe7-6f41-4c5e-b53b-a2f637778f3c None admin] PATH_INFO: `/v3/services` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:41.771712 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99ddbe7-6f41-4c5e-b53b-a2f637778f3c None admin] RBAC: Adding query filter params (name=compute) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:41.772023 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99ddbe7-6f41-4c5e-b53b-a2f637778f3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:41.773391 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99ddbe7-6f41-4c5e-b53b-a2f637778f3c None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:41.778857 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 471/939] 10.222.0.62 () {56 vars in 1112 bytes} [Fri May 27 16:09:41 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:41.779786 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99ddbe7-6f41-4c5e-b53b-a2f637778f3c None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:41.795720 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e75de7-1829-4f06-9d64-7b33dd1514b8 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:41.831092 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6654abe-c5ea-490e-b2d2-1244f4506209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:41.831759 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6654abe-c5ea-490e-b2d2-1244f4506209 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:41.832053 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6654abe-c5ea-490e-b2d2-1244f4506209 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:41.832331 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6654abe-c5ea-490e-b2d2-1244f4506209 None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:41.833128 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6654abe-c5ea-490e-b2d2-1244f4506209 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:41.834454 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6654abe-c5ea-490e-b2d2-1244f4506209 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:41.842094 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 469/940] 10.222.0.62 () {56 vars in 1087 bytes} [Fri May 27 16:09:41 2022] GET /identity/v3/services => generated 1497 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:09:41.842094 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6654abe-c5ea-490e-b2d2-1244f4506209 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:41.880526 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:41.901561 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99ddbe7-6f41-4c5e-b53b-a2f637778f3c None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:41.942175 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e12783-697e-42a4-a04d-d531029047d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:41.943098 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e12783-697e-42a4-a04d-d531029047d6 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:41.943241 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e12783-697e-42a4-a04d-d531029047d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:41.943408 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e12783-697e-42a4-a04d-d531029047d6 None admin] PATH_INFO: `/v3/domains` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:41.944156 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e12783-697e-42a4-a04d-d531029047d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:41.944467 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e12783-697e-42a4-a04d-d531029047d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:41.945874 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e12783-697e-42a4-a04d-d531029047d6 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:41.963071 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 472/941] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 16:09:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:41.964748 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e12783-697e-42a4-a04d-d531029047d6 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:42.002064 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6654abe-c5ea-490e-b2d2-1244f4506209 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:42.038042 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:42.051475 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac684f-f923-42e1-b0b9-cf13f7202787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:42.052617 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac684f-f923-42e1-b0b9-cf13f7202787 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:42.056710 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac684f-f923-42e1-b0b9-cf13f7202787 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:42.056710 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac684f-f923-42e1-b0b9-cf13f7202787 None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:42.056710 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ac684f-f923-42e1-b0b9-cf13f7202787 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:42.056710 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ac684f-f923-42e1-b0b9-cf13f7202787 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:42.056710 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ac684f-f923-42e1-b0b9-cf13f7202787 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:42.062048 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 470/942] 10.222.0.62 () {56 vars in 1112 bytes} [Fri May 27 16:09:41 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:42.108319 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e12783-697e-42a4-a04d-d531029047d6 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:42.149246 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb7a1fd-6b89-42b4-b1f0-450afc93b919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:42.150085 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb7a1fd-6b89-42b4-b1f0-450afc93b919 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:42.150407 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb7a1fd-6b89-42b4-b1f0-450afc93b919 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:42.150688 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb7a1fd-6b89-42b4-b1f0-450afc93b919 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:42.159901 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb7a1fd-6b89-42b4-b1f0-450afc93b919 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:42.161445 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb7a1fd-6b89-42b4-b1f0-450afc93b919 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:42.164794 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:42.180284 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-edb7a1fd-6b89-42b4-b1f0-450afc93b919 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 16:09:42.180284 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:42.180284 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:42.180284 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:42.180284 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:42.180284 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:42.180284 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:42.180284 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:42.180284 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:42.180284 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:42.180284 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:42.180284 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:42.180284 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 16:09:42.180284 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 16:09:42.180284 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 16:09:42.180284 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 16:09:42.181325 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:42.181325 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:42.181325 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 16:09:42.181325 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:09:42.181325 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 16:09:42.181325 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:09:42.181325 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:42.181325 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:42.181325 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:42.181325 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:42.181325 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:42.181325 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:09:42.181325 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:42.181325 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:42.181325 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:42.181325 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:42.181325 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:42.181325 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:42.182328 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:42.182328 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:42.182328 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 16:09:42.182328 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 16:09:42.182328 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 16:09:42.182328 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 16:09:42.182328 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 16:09:42.182328 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 16:09:42.182328 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 16:09:42.182328 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:42.182328 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 473/943] 10.222.0.62 () {56 vars in 1117 bytes} [Fri May 27 16:09:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:42.189198 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac684f-f923-42e1-b0b9-cf13f7202787 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:42.303936 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac684f-f923-42e1-b0b9-cf13f7202787 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:42.340591 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071c1711-776e-4b05-b6ce-de0ca9384d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:42.341691 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c1711-776e-4b05-b6ce-de0ca9384d09 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:42.342193 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c1711-776e-4b05-b6ce-de0ca9384d09 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:42.342704 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c1711-776e-4b05-b6ce-de0ca9384d09 None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:42.343744 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071c1711-776e-4b05-b6ce-de0ca9384d09 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:42.344259 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071c1711-776e-4b05-b6ce-de0ca9384d09 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:42.345944 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071c1711-776e-4b05-b6ce-de0ca9384d09 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:42.365527 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 471/944] 10.222.0.62 () {56 vars in 1149 bytes} [Fri May 27 16:09:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:42.371439 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb7a1fd-6b89-42b4-b1f0-450afc93b919 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:42.480605 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb7a1fd-6b89-42b4-b1f0-450afc93b919 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:42.516031 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529f7a55-d315-4b8a-b4ef-5de7478da76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:42.516831 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529f7a55-d315-4b8a-b4ef-5de7478da76a None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:42.517115 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529f7a55-d315-4b8a-b4ef-5de7478da76a None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:42.517395 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529f7a55-d315-4b8a-b4ef-5de7478da76a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:42.529215 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529f7a55-d315-4b8a-b4ef-5de7478da76a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:42.530696 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529f7a55-d315-4b8a-b4ef-5de7478da76a None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:42.549396 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-529f7a55-d315-4b8a-b4ef-5de7478da76a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:42.549396 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:42.549396 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:42.549396 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:42.549396 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:42.549396 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:42.549396 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:42.549396 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:42.549396 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:42.549396 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:42.549396 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:42.549396 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:42.549396 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:09:42.549396 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:09:42.549396 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:09:42.550670 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:09:42.550670 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:42.550670 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:42.550670 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:42.550670 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:42.550670 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:42.550670 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:42.550670 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:42.550670 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:09:42.550670 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:42.550670 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:42.550670 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:42.550670 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:42.550670 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:42.550670 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:42.550670 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:42.550670 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:42.551636 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:09:42.551636 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:09:42.551636 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:42.551636 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:42.551636 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 474/945] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:09:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:42.557952 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071c1711-776e-4b05-b6ce-de0ca9384d09 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:42.615679 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:42.671486 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071c1711-776e-4b05-b6ce-de0ca9384d09 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:42.707510 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3511ed6b-a7e9-4a4e-9aae-1dadd73187da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:42.708735 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511ed6b-a7e9-4a4e-9aae-1dadd73187da None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:42.709025 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511ed6b-a7e9-4a4e-9aae-1dadd73187da None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:42.709309 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511ed6b-a7e9-4a4e-9aae-1dadd73187da None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:42.710044 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3511ed6b-a7e9-4a4e-9aae-1dadd73187da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:42.710384 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3511ed6b-a7e9-4a4e-9aae-1dadd73187da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:42.711765 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3511ed6b-a7e9-4a4e-9aae-1dadd73187da None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:42.724013 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 472/946] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 16:09:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:42.729384 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529f7a55-d315-4b8a-b4ef-5de7478da76a None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:42.782213 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de102a9-0616-4732-aa18-60ff12b9482c None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:42.782553 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de102a9-0616-4732-aa18-60ff12b9482c None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:42.782821 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de102a9-0616-4732-aa18-60ff12b9482c None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:42.784427 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 473/947] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:09:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 16:09:42.785537 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:42.789518 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2a24d6-b5a2-40eb-acf3-9a97be88c13c None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:42.789808 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2a24d6-b5a2-40eb-acf3-9a97be88c13c None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:42.790091 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2a24d6-b5a2-40eb-acf3-9a97be88c13c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:42.807306 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-7a2a24d6-b5a2-40eb-acf3-9a97be88c13c None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:09:42.808476 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-7a2a24d6-b5a2-40eb-acf3-9a97be88c13c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:09:42.856790 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529f7a55-d315-4b8a-b4ef-5de7478da76a None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:42.894541 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 474/948] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:09:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 16:09:42.904216 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ff5a66-9ec5-4bb4-9c88-4a1dd9787b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:42.905140 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff5a66-9ec5-4bb4-9c88-4a1dd9787b56 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:42.905527 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff5a66-9ec5-4bb4-9c88-4a1dd9787b56 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:42.905912 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff5a66-9ec5-4bb4-9c88-4a1dd9787b56 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:42.913692 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ff5a66-9ec5-4bb4-9c88-4a1dd9787b56 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:42.915385 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ff5a66-9ec5-4bb4-9c88-4a1dd9787b56 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:42.915726 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2a24d6-b5a2-40eb-acf3-9a97be88c13c None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:42.935097 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-03ff5a66-9ec5-4bb4-9c88-4a1dd9787b56 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:09:42.935097 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:42.935097 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:42.935097 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:42.935097 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:42.935097 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:42.935097 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:42.935097 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:42.935097 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:42.935097 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:42.935097 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:42.935097 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:42.935097 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 16:09:42.935097 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 16:09:42.935097 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 16:09:42.936239 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 16:09:42.936239 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:42.936239 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:42.936239 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:42.936239 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:42.936239 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:42.936239 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:42.936239 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:42.936239 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:09:42.936239 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:42.936239 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:42.936239 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:42.936239 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:42.936239 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:42.936239 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:42.936239 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:42.936239 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:42.937152 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 16:09:42.937152 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 16:09:42.937152 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 16:09:42.937152 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 16:09:42.937152 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 16:09:42.937152 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 16:09:42.937152 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:09:42.937152 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:42.937878 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 475/949] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 16:09:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:42.943612 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ff5a66-9ec5-4bb4-9c88-4a1dd9787b56 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:42.969428 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:43.032348 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2a24d6-b5a2-40eb-acf3-9a97be88c13c None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:43.068786 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ce4f5-168c-4527-9064-a44f2c53642d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:43.069524 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ce4f5-168c-4527-9064-a44f2c53642d None admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:43.069804 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ce4f5-168c-4527-9064-a44f2c53642d None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:43.070113 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ce4f5-168c-4527-9064-a44f2c53642d None admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:43.070841 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2ce4f5-168c-4527-9064-a44f2c53642d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:43.072255 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2ce4f5-168c-4527-9064-a44f2c53642d None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:43.073606 dv-cinder-840493-2-smb devstack@keystone.service[80289]: WARNING keystone.server.flask.common [None req-ac2ce4f5-168c-4527-9064-a44f2c53642d None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 27 16:09:43.081862 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ff5a66-9ec5-4bb4-9c88-4a1dd9787b56 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:43.099911 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:43.118688 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.sql.core [None req-ac2ce4f5-168c-4527-9064-a44f2c53642d None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 27 16:09:43.118688 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 27 16:09:43.118688 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [parameters: {'id': '61065e5099c24446882223e9d22f1daa', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 27 16:09:43.118688 dv-cinder-840493-2-smb devstack@keystone.service[80289]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80289) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 27 16:09:43.121398 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16588d4f-3df2-4204-9559-cd4868ca5153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:43.122230 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16588d4f-3df2-4204-9559-cd4868ca5153 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:43.122677 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16588d4f-3df2-4204-9559-cd4868ca5153 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:43.123105 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16588d4f-3df2-4204-9559-cd4868ca5153 None admin] PATH_INFO: `/v3/projects` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:43.124046 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16588d4f-3df2-4204-9559-cd4868ca5153 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:43.127391 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16588d4f-3df2-4204-9559-cd4868ca5153 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:43.127391 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16588d4f-3df2-4204-9559-cd4868ca5153 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:43.139467 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 476/950] 10.222.0.62 () {56 vars in 1148 bytes} [Fri May 27 16:09:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:43.139959 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-ac2ce4f5-168c-4527-9064-a44f2c53642d None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 61065e5099c24446882223e9d22f1daa.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 61065e5099c24446882223e9d22f1daa. May 27 16:09:43.139959 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:43.139959 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 27 16:09:43.139959 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application self.dialect.do_execute( May 27 16:09:43.139959 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 27 16:09:43.139959 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 27 16:09:43.139959 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 27 16:09:43.139959 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application result = self._query(query) May 27 16:09:43.139959 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 27 16:09:43.139959 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application conn.query(q) May 27 16:09:43.139959 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 27 16:09:43.139959 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 27 16:09:43.139959 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 27 16:09:43.140768 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application result.read() May 27 16:09:43.140768 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 27 16:09:43.140768 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 27 16:09:43.140768 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 27 16:09:43.140768 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application packet.raise_for_error() May 27 16:09:43.140768 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 27 16:09:43.140768 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 27 16:09:43.140768 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 27 16:09:43.140768 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 27 16:09:43.140768 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 27 16:09:43.140768 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:43.140768 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 27 16:09:43.140768 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:43.140768 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:43.140768 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 27 16:09:43.140768 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 27 16:09:43.140768 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 27 16:09:43.140768 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return project_ref.to_dict() May 27 16:09:43.141751 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 27 16:09:43.141751 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application next(self.gen) May 27 16:09:43.141751 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 27 16:09:43.141751 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application yield resource May 27 16:09:43.141751 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 27 16:09:43.141751 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application next(self.gen) May 27 16:09:43.141751 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 27 16:09:43.141751 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application self.session.rollback() May 27 16:09:43.141751 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 27 16:09:43.141751 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application self.force_reraise() May 27 16:09:43.141751 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 27 16:09:43.141751 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise self.value May 27 16:09:43.141751 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 27 16:09:43.141751 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 27 16:09:43.141751 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 27 16:09:43.141751 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application session.commit() May 27 16:09:43.141751 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 27 16:09:43.142723 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 27 16:09:43.142723 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 27 16:09:43.142723 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application self._prepare_impl() May 27 16:09:43.142723 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 27 16:09:43.142723 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application self.session.flush() May 27 16:09:43.142723 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 27 16:09:43.142723 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application self._flush(objects) May 27 16:09:43.142723 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 27 16:09:43.142723 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 27 16:09:43.142723 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 27 16:09:43.142723 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application compat.raise_( May 27 16:09:43.142723 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 27 16:09:43.142723 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception May 27 16:09:43.142723 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 27 16:09:43.142723 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application flush_context.execute() May 27 16:09:43.142723 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 27 16:09:43.142723 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rec.execute(self) May 27 16:09:43.143633 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 27 16:09:43.143633 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 27 16:09:43.143633 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 27 16:09:43.143633 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application _emit_insert_statements( May 27 16:09:43.143633 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 27 16:09:43.143633 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application c = connection._execute_20( May 27 16:09:43.143633 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 27 16:09:43.143633 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 27 16:09:43.143633 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 27 16:09:43.143633 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 27 16:09:43.143633 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 27 16:09:43.143633 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ret = self._execute_context( May 27 16:09:43.143633 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 27 16:09:43.143633 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 27 16:09:43.143633 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 27 16:09:43.144456 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 27 16:09:43.144456 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 27 16:09:43.144456 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception May 27 16:09:43.144456 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 27 16:09:43.144456 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application self.dialect.do_execute( May 27 16:09:43.144456 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 27 16:09:43.144456 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 27 16:09:43.144456 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 27 16:09:43.144456 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application result = self._query(query) May 27 16:09:43.144456 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 27 16:09:43.144456 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application conn.query(q) May 27 16:09:43.144456 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 27 16:09:43.144456 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 27 16:09:43.144456 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 27 16:09:43.144456 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application result.read() May 27 16:09:43.144456 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 27 16:09:43.144456 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 27 16:09:43.145907 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 27 16:09:43.145907 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application packet.raise_for_error() May 27 16:09:43.145907 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 27 16:09:43.145907 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 27 16:09:43.145907 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 27 16:09:43.145907 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 27 16:09:43.145907 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 27 16:09:43.145907 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 27 16:09:43.145907 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [parameters: {'id': '61065e5099c24446882223e9d22f1daa', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 27 16:09:43.145907 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 27 16:09:43.145907 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:43.145907 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 16:09:43.145907 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:43.145907 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:43.145907 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 27 16:09:43.148584 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 27 16:09:43.148584 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 27 16:09:43.148584 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 27 16:09:43.148584 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 27 16:09:43.148584 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:43.148584 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 16:09:43.148584 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:43.148584 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:43.148584 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:43.148584 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:43.148584 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:43.148584 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:43.148584 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:43.148584 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:43.148584 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:43.148584 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:43.148584 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:43.151157 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:43.151157 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 27 16:09:43.151157 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 27 16:09:43.151157 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:43.151157 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:43.151157 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 27 16:09:43.151157 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.Conflict( May 27 16:09:43.151157 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 61065e5099c24446882223e9d22f1daa. May 27 16:09:43.151157 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:43.151157 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 475/951] 10.222.0.62 () {60 vars in 1140 bytes} [Fri May 27 16:09:42 2022] POST /identity/v3/projects => generated 262 bytes in 226 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:43.152501 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16588d4f-3df2-4204-9559-cd4868ca5153 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:43.152652 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ce4f5-168c-4527-9064-a44f2c53642d None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:43.261433 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ce4f5-168c-4527-9064-a44f2c53642d None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:43.262602 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16588d4f-3df2-4204-9559-cd4868ca5153 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:43.295095 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:43.300635 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80356892-f660-4926-b857-109cf85d937d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:43.301114 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5183ba74-4b7b-4b6e-b117-319c20e413b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:43.302572 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80356892-f660-4926-b857-109cf85d937d None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:43.302686 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183ba74-4b7b-4b6e-b117-319c20e413b8 None admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:43.302935 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183ba74-4b7b-4b6e-b117-319c20e413b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:43.303213 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183ba74-4b7b-4b6e-b117-319c20e413b8 None admin] PATH_INFO: `/v3/projects/d48d95a12587479ca5714f6ebd60dd9f/users/eb50bf5f39b04ab689b55f46d3dd2640/roles/769bfee541f54e48ab47d4056838a1e5` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:43.303600 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80356892-f660-4926-b857-109cf85d937d None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:43.304148 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80356892-f660-4926-b857-109cf85d937d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:43.305666 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5183ba74-4b7b-4b6e-b117-319c20e413b8 None admin] RBAC: Authorizing `identity:create_grant(project_id=d48d95a12587479ca5714f6ebd60dd9f, user_id=eb50bf5f39b04ab689b55f46d3dd2640, role_id=769bfee541f54e48ab47d4056838a1e5)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:43.307157 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5183ba74-4b7b-4b6e-b117-319c20e413b8 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:43.313319 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80356892-f660-4926-b857-109cf85d937d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:43.315372 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80356892-f660-4926-b857-109cf85d937d None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:43.331821 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-80356892-f660-4926-b857-109cf85d937d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:09:43.331821 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:43.331821 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:43.331821 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:43.331821 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:43.331821 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:43.331821 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:43.331821 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:43.331821 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:43.331821 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:43.331821 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:43.331821 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:43.331821 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 16:09:43.331821 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 16:09:43.331821 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 16:09:43.333254 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 16:09:43.333254 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:43.333254 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:43.333254 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:43.333254 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:43.333254 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:43.333254 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:43.333254 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:43.333254 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:09:43.333254 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:43.333254 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:43.333254 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:43.333254 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:43.333254 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:43.333254 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:43.333254 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:43.333254 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:43.334226 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 16:09:43.334226 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 16:09:43.334226 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 16:09:43.334226 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 16:09:43.334226 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 16:09:43.334226 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 16:09:43.334226 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:09:43.334226 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:43.335127 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 476/952] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 16:09:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:09:43.340157 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80356892-f660-4926-b857-109cf85d937d None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:43.403222 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 477/953] 10.222.0.62 () {58 vars in 1439 bytes} [Fri May 27 16:09:43 2022] PUT /identity/v3/projects/d48d95a12587479ca5714f6ebd60dd9f/users/eb50bf5f39b04ab689b55f46d3dd2640/roles/769bfee541f54e48ab47d4056838a1e5 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:09:43.457369 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80356892-f660-4926-b857-109cf85d937d None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:43.496513 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88b0959-fd36-4940-8cb8-19363b564dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:43.497560 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b0959-fd36-4940-8cb8-19363b564dbe None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:43.498073 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b0959-fd36-4940-8cb8-19363b564dbe None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:43.498586 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b0959-fd36-4940-8cb8-19363b564dbe None admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:43.499596 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88b0959-fd36-4940-8cb8-19363b564dbe None admin] RBAC: Adding query filter params (name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:43.500107 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88b0959-fd36-4940-8cb8-19363b564dbe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:43.501777 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88b0959-fd36-4940-8cb8-19363b564dbe None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:43.524949 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 477/954] 10.222.0.62 () {56 vars in 1112 bytes} [Fri May 27 16:09:43 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:09:44.166082 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff8b9d6-f45c-4a7d-bb18-c571037bd27d None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:44.166647 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff8b9d6-f45c-4a7d-bb18-c571037bd27d None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:44.166834 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff8b9d6-f45c-4a7d-bb18-c571037bd27d None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:44.168558 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 478/955] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:09:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:09:44.174972 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a5983-0cc2-4164-a284-32f466e47386 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:44.180795 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a5983-0cc2-4164-a284-32f466e47386 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:44.180795 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a5983-0cc2-4164-a284-32f466e47386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:44.196319 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-0d1a5983-0cc2-4164-a284-32f466e47386 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:09:44.198381 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-0d1a5983-0cc2-4164-a284-32f466e47386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:09:44.212137 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:44.271186 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 478/956] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:09:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:09:44.293707 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff8b9d6-f45c-4a7d-bb18-c571037bd27d None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:44.327792 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:44.373675 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d6d0a4-e8f7-4f1d-86bc-6f315952741d None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:44.374002 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d6d0a4-e8f7-4f1d-86bc-6f315952741d None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:44.374273 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d6d0a4-e8f7-4f1d-86bc-6f315952741d None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:44.375909 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 479/957] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:09:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 16:09:44.381576 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eaab6d-e092-4cc6-8217-8e503a1a0874 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:44.382141 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eaab6d-e092-4cc6-8217-8e503a1a0874 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:44.382655 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eaab6d-e092-4cc6-8217-8e503a1a0874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:44.400658 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-f3eaab6d-e092-4cc6-8217-8e503a1a0874 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:09:44.402145 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-f3eaab6d-e092-4cc6-8217-8e503a1a0874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:09:44.404438 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff8b9d6-f45c-4a7d-bb18-c571037bd27d None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:44.442497 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546b972e-79c3-42e6-956c-a08b24eb1764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:44.443230 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b972e-79c3-42e6-956c-a08b24eb1764 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:44.443519 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b972e-79c3-42e6-956c-a08b24eb1764 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:44.443801 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b972e-79c3-42e6-956c-a08b24eb1764 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:44.444461 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546b972e-79c3-42e6-956c-a08b24eb1764 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:44.445841 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546b972e-79c3-42e6-956c-a08b24eb1764 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:44.459952 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-546b972e-79c3-42e6-956c-a08b24eb1764 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 16:09:44.459952 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:44.459952 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 16:09:44.459952 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 16:09:44.459952 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 16:09:44.459952 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 16:09:44.459952 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 16:09:44.459952 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:09:44.459952 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 16:09:44.459952 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:44.459952 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 16:09:44.459952 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:44.459952 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:44.459952 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:44.459952 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:44.459952 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:44.459952 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:44.461032 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:44.461032 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:44.461032 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:44.461032 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:44.461032 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:44.461032 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:44.461032 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 16:09:44.461032 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 16:09:44.461032 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 16:09:44.461032 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 16:09:44.461032 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:44.461032 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:44.461032 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:44.461032 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:44.461032 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:44.461032 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:44.461892 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:44.461892 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:09:44.461892 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:44.461892 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:44.461892 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:44.461892 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:44.461892 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:44.461892 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:44.461892 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:44.461892 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:44.461892 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 16:09:44.461892 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:09:44.461892 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 16:09:44.461892 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:44.461892 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 479/958] 10.222.0.62 () {56 vars in 1126 bytes} [Fri May 27 16:09:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:44.467093 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546b972e-79c3-42e6-956c-a08b24eb1764 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:44.482129 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 480/959] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:09:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:09:44.503493 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eaab6d-e092-4cc6-8217-8e503a1a0874 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:44.579928 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:44.586878 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546b972e-79c3-42e6-956c-a08b24eb1764 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:44.599341 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:44.623135 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eaab6d-e092-4cc6-8217-8e503a1a0874 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:44.625481 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea54d9bb-cf53-4769-a699-2125df2505d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:44.626450 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54d9bb-cf53-4769-a699-2125df2505d3 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:44.626967 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54d9bb-cf53-4769-a699-2125df2505d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:44.627438 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54d9bb-cf53-4769-a699-2125df2505d3 None admin] PATH_INFO: `/v3/services` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:44.628346 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea54d9bb-cf53-4769-a699-2125df2505d3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:44.628848 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea54d9bb-cf53-4769-a699-2125df2505d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:44.631050 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea54d9bb-cf53-4769-a699-2125df2505d3 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:44.636876 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 480/960] 10.222.0.62 () {56 vars in 1122 bytes} [Fri May 27 16:09:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:09:44.642301 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea54d9bb-cf53-4769-a699-2125df2505d3 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:44.671336 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e1a58-ff8f-44d5-ab24-eefa71770a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:44.672163 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e1a58-ff8f-44d5-ab24-eefa71770a96 None admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:44.672447 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e1a58-ff8f-44d5-ab24-eefa71770a96 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:44.672803 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e1a58-ff8f-44d5-ab24-eefa71770a96 None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:44.673514 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472e1a58-ff8f-44d5-ab24-eefa71770a96 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:44.675442 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472e1a58-ff8f-44d5-ab24-eefa71770a96 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:44.758279 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 481/961] 10.222.0.62 () {60 vars in 1141 bytes} [Fri May 27 16:09:44 2022] POST /identity/v3/services => generated 242 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:09:44.760717 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea54d9bb-cf53-4769-a699-2125df2505d3 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:44.817838 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5456bae7-216e-4f70-9e26-05cbb0114cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:44.818764 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456bae7-216e-4f70-9e26-05cbb0114cb8 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:44.819055 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456bae7-216e-4f70-9e26-05cbb0114cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:44.819375 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456bae7-216e-4f70-9e26-05cbb0114cb8 None admin] PATH_INFO: `/v3/services` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:44.820196 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5456bae7-216e-4f70-9e26-05cbb0114cb8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:44.820512 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5456bae7-216e-4f70-9e26-05cbb0114cb8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:44.821985 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5456bae7-216e-4f70-9e26-05cbb0114cb8 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:44.832552 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 481/962] 10.222.0.62 () {56 vars in 1122 bytes} [Fri May 27 16:09:44 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:09:44.835259 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e1a58-ff8f-44d5-ab24-eefa71770a96 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:44.950279 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e1a58-ff8f-44d5-ab24-eefa71770a96 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:44.988305 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd8fe9-af9d-4172-9583-487a390584d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:44.989867 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd8fe9-af9d-4172-9583-487a390584d4 None admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:44.990442 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd8fe9-af9d-4172-9583-487a390584d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:44.990920 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd8fe9-af9d-4172-9583-487a390584d4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:44.991904 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cd8fe9-af9d-4172-9583-487a390584d4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:44.993551 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cd8fe9-af9d-4172-9583-487a390584d4 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:44.998739 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:45.075721 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 482/963] 10.222.0.62 () {60 vars in 1144 bytes} [Fri May 27 16:09:44 2022] POST /identity/v3/endpoints => generated 349 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:09:45.773617 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0e2a1d-d815-4d50-ba36-ec1adffbc182 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:45.774136 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0e2a1d-d815-4d50-ba36-ec1adffbc182 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:45.774275 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0e2a1d-d815-4d50-ba36-ec1adffbc182 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:45.775693 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 482/964] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:09:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:09:45.782959 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e62db-0e49-49db-86d3-4b8217d77e96 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:45.782959 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e62db-0e49-49db-86d3-4b8217d77e96 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:45.782959 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e62db-0e49-49db-86d3-4b8217d77e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:45.800398 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-a30e62db-0e49-49db-86d3-4b8217d77e96 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:09:45.802542 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-a30e62db-0e49-49db-86d3-4b8217d77e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:09:45.883031 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 483/965] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:09:45 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:09:45.895735 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fac537-aeb9-494f-b533-e314aae4de62 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:45.896028 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fac537-aeb9-494f-b533-e314aae4de62 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:45.896317 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fac537-aeb9-494f-b533-e314aae4de62 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:45.897937 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 483/966] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:09:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:09:45.903117 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31bcc7-ac14-4427-a2fd-ea268c78cd1c None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:45.903633 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31bcc7-ac14-4427-a2fd-ea268c78cd1c None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:45.904135 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31bcc7-ac14-4427-a2fd-ea268c78cd1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:45.908514 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fac537-aeb9-494f-b533-e314aae4de62 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:45.921846 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-7f31bcc7-ac14-4427-a2fd-ea268c78cd1c None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:09:45.923368 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-7f31bcc7-ac14-4427-a2fd-ea268c78cd1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:09:45.932054 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:46.001823 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 484/967] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:09:45 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:09:46.019047 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f31bcc7-ac14-4427-a2fd-ea268c78cd1c None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:46.028289 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fac537-aeb9-494f-b533-e314aae4de62 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:46.070125 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f15aa8f-e3a5-4207-8ec1-1ff04b88f09a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:46.071378 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f15aa8f-e3a5-4207-8ec1-1ff04b88f09a None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:46.071921 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f15aa8f-e3a5-4207-8ec1-1ff04b88f09a None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:46.072415 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f15aa8f-e3a5-4207-8ec1-1ff04b88f09a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:46.085010 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f15aa8f-e3a5-4207-8ec1-1ff04b88f09a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:09:46.090645 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:46.094167 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-7f15aa8f-e3a5-4207-8ec1-1ff04b88f09a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 16:09:46.094167 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:46.094167 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:46.094167 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:46.094167 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:46.094167 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:46.094167 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:46.094167 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:46.094167 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:46.094167 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:46.094167 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:46.094167 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:46.094167 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:09:46.094167 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:09:46.094167 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:09:46.094167 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:09:46.095241 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:09:46.095241 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:09:46.095241 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:09:46.095241 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:09:46.095241 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:46.095241 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:46.095241 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:46.095241 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:46.095241 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:46.095241 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:46.095241 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:46.095241 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:09:46.095241 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:46.095241 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:46.095241 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:46.095241 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:46.096108 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:46.096108 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:46.096108 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:46.096108 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:46.096108 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:09:46.096108 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:09:46.096108 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:09:46.096108 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:09:46.096108 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:09:46.096108 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:09:46.096108 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 16:09:46.096108 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:46.099446 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 484/968] 10.222.0.62 () {56 vars in 1120 bytes} [Fri May 27 16:09:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:09:46.110507 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f15aa8f-e3a5-4207-8ec1-1ff04b88f09a None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:46.140608 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f31bcc7-ac14-4427-a2fd-ea268c78cd1c None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:46.177472 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5f8a2d-d35e-4b85-b54d-f985a9106224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:46.178146 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f8a2d-d35e-4b85-b54d-f985a9106224 None admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:46.180957 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f8a2d-d35e-4b85-b54d-f985a9106224 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:46.180957 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f8a2d-d35e-4b85-b54d-f985a9106224 None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:46.180957 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5f8a2d-d35e-4b85-b54d-f985a9106224 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:46.180957 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5f8a2d-d35e-4b85-b54d-f985a9106224 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:46.200964 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:46.220941 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f15aa8f-e3a5-4207-8ec1-1ff04b88f09a None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:46.257995 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64199ea5-c64e-4d39-a2b1-222300a87d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:46.258995 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64199ea5-c64e-4d39-a2b1-222300a87d03 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:46.259466 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64199ea5-c64e-4d39-a2b1-222300a87d03 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:46.260018 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64199ea5-c64e-4d39-a2b1-222300a87d03 None admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:46.260988 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64199ea5-c64e-4d39-a2b1-222300a87d03 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:46.261464 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64199ea5-c64e-4d39-a2b1-222300a87d03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:46.263045 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64199ea5-c64e-4d39-a2b1-222300a87d03 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:46.276477 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 485/969] 10.222.0.62 () {56 vars in 1115 bytes} [Fri May 27 16:09:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:46.277956 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64199ea5-c64e-4d39-a2b1-222300a87d03 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:46.295052 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.sql.core [None req-8d5f8a2d-d35e-4b85-b54d-f985a9106224 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 27 16:09:46.295052 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 27 16:09:46.295052 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [parameters: {'user_id': '9c9be2b3e3d6459bbc0553edbee4b21f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 27 16:09:46.295052 dv-cinder-840493-2-smb devstack@keystone.service[80289]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80289) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 27 16:09:46.298283 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-8d5f8a2d-d35e-4b85-b54d-f985a9106224 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 27 16:09:46.298283 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:46.298283 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 27 16:09:46.298283 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application self.dialect.do_execute( May 27 16:09:46.298283 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 27 16:09:46.298283 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 27 16:09:46.298283 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 27 16:09:46.298283 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application result = self._query(query) May 27 16:09:46.298283 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 27 16:09:46.298283 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application conn.query(q) May 27 16:09:46.298283 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 27 16:09:46.298283 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 27 16:09:46.298283 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 27 16:09:46.298283 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application result.read() May 27 16:09:46.298283 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 27 16:09:46.299271 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 27 16:09:46.299271 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 27 16:09:46.299271 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application packet.raise_for_error() May 27 16:09:46.299271 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 27 16:09:46.299271 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 27 16:09:46.299271 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 27 16:09:46.299271 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 27 16:09:46.299271 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 27 16:09:46.299271 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:46.299271 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 27 16:09:46.299271 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:46.299271 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:46.299271 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 27 16:09:46.299271 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 27 16:09:46.299271 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 27 16:09:46.299271 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 27 16:09:46.299271 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 27 16:09:46.299271 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application next(self.gen) May 27 16:09:46.300610 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 27 16:09:46.300610 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application yield resource May 27 16:09:46.300610 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 27 16:09:46.300610 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application next(self.gen) May 27 16:09:46.300610 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 27 16:09:46.300610 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application self.session.rollback() May 27 16:09:46.300610 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 27 16:09:46.300610 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application self.force_reraise() May 27 16:09:46.300610 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 27 16:09:46.300610 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise self.value May 27 16:09:46.300610 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 27 16:09:46.300610 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 27 16:09:46.300610 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 27 16:09:46.300610 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application session.commit() May 27 16:09:46.300610 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 27 16:09:46.300610 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 27 16:09:46.300610 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 27 16:09:46.301545 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application self._prepare_impl() May 27 16:09:46.301545 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 27 16:09:46.301545 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application self.session.flush() May 27 16:09:46.301545 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 27 16:09:46.301545 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application self._flush(objects) May 27 16:09:46.301545 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 27 16:09:46.301545 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 27 16:09:46.301545 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 27 16:09:46.301545 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application compat.raise_( May 27 16:09:46.301545 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 27 16:09:46.301545 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception May 27 16:09:46.301545 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 27 16:09:46.301545 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application flush_context.execute() May 27 16:09:46.301545 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 27 16:09:46.301545 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rec.execute(self) May 27 16:09:46.301545 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 27 16:09:46.301545 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 27 16:09:46.303865 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 27 16:09:46.303865 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application _emit_insert_statements( May 27 16:09:46.303865 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 27 16:09:46.303865 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application result = connection._execute_20( May 27 16:09:46.303865 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 27 16:09:46.303865 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 27 16:09:46.303865 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 27 16:09:46.303865 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 27 16:09:46.303865 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 27 16:09:46.303865 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ret = self._execute_context( May 27 16:09:46.303865 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 27 16:09:46.303865 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 27 16:09:46.303865 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 27 16:09:46.303865 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 27 16:09:46.303865 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 27 16:09:46.303865 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception May 27 16:09:46.306327 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 27 16:09:46.306327 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application self.dialect.do_execute( May 27 16:09:46.306327 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 27 16:09:46.306327 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 27 16:09:46.306327 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 27 16:09:46.306327 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application result = self._query(query) May 27 16:09:46.306327 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 27 16:09:46.306327 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application conn.query(q) May 27 16:09:46.306327 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 27 16:09:46.306327 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 27 16:09:46.306327 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 27 16:09:46.306327 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application result.read() May 27 16:09:46.306327 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 27 16:09:46.306327 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 27 16:09:46.306327 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 27 16:09:46.306327 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application packet.raise_for_error() May 27 16:09:46.308513 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 27 16:09:46.308513 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 27 16:09:46.308513 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 27 16:09:46.308513 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 27 16:09:46.308513 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 27 16:09:46.308513 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 27 16:09:46.308513 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [parameters: {'user_id': '9c9be2b3e3d6459bbc0553edbee4b21f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 27 16:09:46.308513 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 27 16:09:46.308513 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:46.308513 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 16:09:46.308513 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:46.308513 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:46.308513 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:46.308513 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:46.308513 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:46.310504 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:46.310504 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:46.310504 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:46.310504 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:46.310504 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:46.310504 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:46.310504 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:46.310504 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 27 16:09:46.310504 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 27 16:09:46.310504 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:46.310504 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:46.310504 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 16:09:46.310504 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:09:46.310504 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 16:09:46.310504 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:09:46.310504 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 27 16:09:46.310504 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 27 16:09:46.313297 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 27 16:09:46.313297 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 27 16:09:46.313297 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 27 16:09:46.313297 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 27 16:09:46.313297 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 27 16:09:46.313297 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:46.313297 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 485/970] 10.222.0.62 () {60 vars in 1131 bytes} [Fri May 27 16:09:46 2022] POST /identity/v3/users => generated 160 bytes in 281 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 27 16:09:46.313297 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5f8a2d-d35e-4b85-b54d-f985a9106224 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:46.413283 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64199ea5-c64e-4d39-a2b1-222300a87d03 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:46.462130 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5f8a2d-d35e-4b85-b54d-f985a9106224 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:46.465016 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e16f1-51dd-4921-87b1-ad6593a69cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:46.466779 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e16f1-51dd-4921-87b1-ad6593a69cdc None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:46.470565 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e16f1-51dd-4921-87b1-ad6593a69cdc None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:46.471693 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e16f1-51dd-4921-87b1-ad6593a69cdc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:46.475988 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:46.488559 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805e16f1-51dd-4921-87b1-ad6593a69cdc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:46.491013 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805e16f1-51dd-4921-87b1-ad6593a69cdc None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:46.494147 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:46.505423 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a74eeb-f36d-43b1-8efd-44d58d015b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:46.506925 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a74eeb-f36d-43b1-8efd-44d58d015b56 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:46.507320 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a74eeb-f36d-43b1-8efd-44d58d015b56 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:46.507712 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a74eeb-f36d-43b1-8efd-44d58d015b56 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:46.515088 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-805e16f1-51dd-4921-87b1-ad6593a69cdc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:46.515088 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:46.515088 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:46.515088 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:46.515088 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:46.515088 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:46.515088 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:46.515088 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:46.515088 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:46.515088 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:46.515088 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:46.515088 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:46.515088 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:09:46.515088 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:09:46.515088 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:09:46.516199 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:09:46.516199 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:46.516199 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:46.516199 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:46.516199 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:46.516199 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:46.516199 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:46.516199 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:46.516199 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:09:46.516199 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:46.516199 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:46.516199 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:46.516199 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:46.516199 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:46.516199 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:46.516199 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:46.516199 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:46.517356 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:09:46.517356 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:09:46.517356 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:46.517356 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:46.519354 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a74eeb-f36d-43b1-8efd-44d58d015b56 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:46.519797 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 486/971] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:09:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:09:46.523969 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a74eeb-f36d-43b1-8efd-44d58d015b56 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:46.525701 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e16f1-51dd-4921-87b1-ad6593a69cdc None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:46.546407 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-d4a74eeb-f36d-43b1-8efd-44d58d015b56 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 27 16:09:46.546407 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:46.546407 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:46.546407 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:46.546407 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:46.546407 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:46.546407 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:46.546407 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:46.546407 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:46.546407 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:46.546407 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:46.546407 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:46.546407 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 16:09:46.546407 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 16:09:46.546407 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 16:09:46.546407 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 16:09:46.547655 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:46.547655 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:46.547655 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 16:09:46.547655 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:09:46.547655 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 16:09:46.547655 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:09:46.547655 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:46.547655 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:46.547655 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:46.547655 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:46.547655 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:46.547655 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:09:46.547655 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:46.547655 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:46.547655 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:46.547655 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:46.547655 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:46.547655 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:46.548830 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:46.548830 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:46.548830 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 16:09:46.548830 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 16:09:46.548830 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 16:09:46.548830 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 16:09:46.548830 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 16:09:46.548830 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 16:09:46.548830 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 27 16:09:46.548830 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:46.552373 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 486/972] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 16:09:46 2022] GET /identity/v3/users/cinder => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:09:46.557988 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a74eeb-f36d-43b1-8efd-44d58d015b56 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:46.650607 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e16f1-51dd-4921-87b1-ad6593a69cdc None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:46.672944 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a74eeb-f36d-43b1-8efd-44d58d015b56 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:46.689185 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88ec1d8-06e0-49f2-977b-d284ac488cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:46.690065 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ec1d8-06e0-49f2-977b-d284ac488cf5 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:46.690485 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ec1d8-06e0-49f2-977b-d284ac488cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:46.690900 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ec1d8-06e0-49f2-977b-d284ac488cf5 None admin] PATH_INFO: `/v3/domains` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:46.692416 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88ec1d8-06e0-49f2-977b-d284ac488cf5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:46.692892 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88ec1d8-06e0-49f2-977b-d284ac488cf5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:46.694492 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88ec1d8-06e0-49f2-977b-d284ac488cf5 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:46.710411 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 487/973] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 16:09:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:09:46.715090 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88ec1d8-06e0-49f2-977b-d284ac488cf5 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:46.717383 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fbbec2-511c-433f-a648-da62e404dec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:46.718073 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fbbec2-511c-433f-a648-da62e404dec9 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:46.718415 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fbbec2-511c-433f-a648-da62e404dec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:46.718703 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fbbec2-511c-433f-a648-da62e404dec9 None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:46.719519 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fbbec2-511c-433f-a648-da62e404dec9 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:46.719833 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fbbec2-511c-433f-a648-da62e404dec9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:46.721401 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fbbec2-511c-433f-a648-da62e404dec9 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:46.762296 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 487/974] 10.222.0.62 () {56 vars in 1101 bytes} [Fri May 27 16:09:46 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:46.782054 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:46.837173 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88ec1d8-06e0-49f2-977b-d284ac488cf5 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:46.876823 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021ba8c1-0e56-4c21-b465-5861bb8b6b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:46.877843 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ba8c1-0e56-4c21-b465-5861bb8b6b32 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:46.878270 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ba8c1-0e56-4c21-b465-5861bb8b6b32 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:46.878659 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ba8c1-0e56-4c21-b465-5861bb8b6b32 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:46.888557 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021ba8c1-0e56-4c21-b465-5861bb8b6b32 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:46.890205 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021ba8c1-0e56-4c21-b465-5861bb8b6b32 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:46.906749 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-021ba8c1-0e56-4c21-b465-5861bb8b6b32 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 16:09:46.906749 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:46.906749 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:46.906749 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:46.906749 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:46.906749 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:46.906749 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:46.906749 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:46.906749 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:46.906749 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:46.906749 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:46.906749 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:46.906749 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 16:09:46.906749 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 16:09:46.906749 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 16:09:46.906749 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 16:09:46.907994 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:46.907994 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:46.907994 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 16:09:46.907994 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:09:46.907994 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 16:09:46.907994 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:09:46.907994 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:46.907994 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:46.907994 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:46.907994 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:46.907994 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:46.907994 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:09:46.907994 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:46.907994 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:46.907994 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:46.907994 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:46.907994 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:46.907994 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:46.909220 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:46.909220 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:46.909220 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 16:09:46.909220 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 16:09:46.909220 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 16:09:46.909220 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 16:09:46.909220 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 16:09:46.909220 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 16:09:46.909220 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 16:09:46.909220 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:46.911778 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 488/975] 10.222.0.62 () {56 vars in 1117 bytes} [Fri May 27 16:09:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:46.917584 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fbbec2-511c-433f-a648-da62e404dec9 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:46.951913 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:47.034418 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fbbec2-511c-433f-a648-da62e404dec9 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:47.072962 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcfe032-0fdc-40c1-8023-d8086dae6e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:47.074016 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcfe032-0fdc-40c1-8023-d8086dae6e6c None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:47.074566 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcfe032-0fdc-40c1-8023-d8086dae6e6c None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:47.075054 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcfe032-0fdc-40c1-8023-d8086dae6e6c None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:47.076119 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcfe032-0fdc-40c1-8023-d8086dae6e6c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:47.076634 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcfe032-0fdc-40c1-8023-d8086dae6e6c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:47.078394 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcfe032-0fdc-40c1-8023-d8086dae6e6c None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:47.096734 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 488/976] 10.222.0.62 () {56 vars in 1149 bytes} [Fri May 27 16:09:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:47.103027 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021ba8c1-0e56-4c21-b465-5861bb8b6b32 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:47.167802 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64304bfd-3d3d-416d-9753-a017224e9d4b None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:47.168434 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64304bfd-3d3d-416d-9753-a017224e9d4b None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:47.169140 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64304bfd-3d3d-416d-9753-a017224e9d4b None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:47.171871 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 489/977] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:09:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:09:47.177539 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0fd0e2-9c8f-4e09-92bb-10f262dcf7a7 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:47.177834 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0fd0e2-9c8f-4e09-92bb-10f262dcf7a7 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:47.178117 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0fd0e2-9c8f-4e09-92bb-10f262dcf7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:47.195838 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-2a0fd0e2-9c8f-4e09-92bb-10f262dcf7a7 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:09:47.197375 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-2a0fd0e2-9c8f-4e09-92bb-10f262dcf7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:09:47.209856 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021ba8c1-0e56-4c21-b465-5861bb8b6b32 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:47.226901 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:47.248224 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968e28de-784e-474e-b19f-fcef9675bf3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:47.248876 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e28de-784e-474e-b19f-fcef9675bf3e None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:47.249153 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e28de-784e-474e-b19f-fcef9675bf3e None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:47.249448 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e28de-784e-474e-b19f-fcef9675bf3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:47.273964 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 490/978] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:09:47 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 16:09:47.296126 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0fd0e2-9c8f-4e09-92bb-10f262dcf7a7 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:47.314329 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:47.338364 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968e28de-784e-474e-b19f-fcef9675bf3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:47.340192 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968e28de-784e-474e-b19f-fcef9675bf3e None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:47.406155 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0fd0e2-9c8f-4e09-92bb-10f262dcf7a7 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:47.443157 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a36f40a-78de-45ef-a8aa-bbc12c19bb9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:47.443956 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a36f40a-78de-45ef-a8aa-bbc12c19bb9b None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:47.444242 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a36f40a-78de-45ef-a8aa-bbc12c19bb9b None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:47.444556 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a36f40a-78de-45ef-a8aa-bbc12c19bb9b None admin] PATH_INFO: `/v3/services/compute` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:47.445213 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a36f40a-78de-45ef-a8aa-bbc12c19bb9b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:47.446624 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a36f40a-78de-45ef-a8aa-bbc12c19bb9b None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:47.455180 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 489/979] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 16:09:47 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 16:09:47.455180 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874fb914-7058-46f3-90ca-135d26cd124b None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:47.455180 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874fb914-7058-46f3-90ca-135d26cd124b None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:47.455180 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874fb914-7058-46f3-90ca-135d26cd124b None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:47.455180 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 490/980] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:09:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:09:47.456058 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874fb914-7058-46f3-90ca-135d26cd124b None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:47.459427 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-0a36f40a-78de-45ef-a8aa-bbc12c19bb9b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 27 16:09:47.459427 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:47.459427 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 16:09:47.459427 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 16:09:47.459427 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 16:09:47.459427 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 16:09:47.459427 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 16:09:47.459427 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:09:47.459427 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 27 16:09:47.459427 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:47.459427 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 16:09:47.459427 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:47.459427 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:47.459427 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:47.459427 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:47.459427 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:47.459427 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:47.460551 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:47.460551 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:47.460551 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:47.460551 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:47.460551 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:47.460551 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:47.460551 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 16:09:47.460551 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 16:09:47.460551 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 16:09:47.460551 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 16:09:47.460551 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:47.460551 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:47.460551 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:47.460551 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:47.460551 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:47.460551 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:47.461543 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:47.461543 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:09:47.461543 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:47.461543 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:47.461543 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:47.461543 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:47.461543 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:47.461543 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:47.461543 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:47.461543 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:47.461543 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 16:09:47.461543 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:09:47.461543 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 27 16:09:47.461543 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:47.461543 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 491/981] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 16:09:47 2022] GET /identity/v3/services/compute => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:09:47.462566 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5311bb31-b94c-427c-a47e-9abce905178f None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:47.462566 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5311bb31-b94c-427c-a47e-9abce905178f None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:47.462566 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5311bb31-b94c-427c-a47e-9abce905178f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:47.478940 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:47.480155 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-5311bb31-b94c-427c-a47e-9abce905178f None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:09:47.481357 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-5311bb31-b94c-427c-a47e-9abce905178f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:09:47.554419 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 492/982] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:09:47 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:09:47.554419 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5311bb31-b94c-427c-a47e-9abce905178f None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:47.564432 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:47.574937 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874fb914-7058-46f3-90ca-135d26cd124b None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:47.614998 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ff619d-d880-48ab-a2f6-07c906d4f5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:47.616273 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff619d-d880-48ab-a2f6-07c906d4f5bf None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:47.616553 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff619d-d880-48ab-a2f6-07c906d4f5bf None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:47.616828 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff619d-d880-48ab-a2f6-07c906d4f5bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:47.627122 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ff619d-d880-48ab-a2f6-07c906d4f5bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:47.628565 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ff619d-d880-48ab-a2f6-07c906d4f5bf None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:47.650405 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-95ff619d-d880-48ab-a2f6-07c906d4f5bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:47.650405 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:47.650405 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:47.650405 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:47.650405 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:47.650405 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:47.650405 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:47.650405 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:47.650405 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:47.650405 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:47.650405 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:47.650405 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:47.650405 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:09:47.650405 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:09:47.650405 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:09:47.651498 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:09:47.651498 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:47.651498 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:47.651498 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:47.651498 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:47.651498 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:47.651498 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:47.651498 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:47.651498 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:09:47.651498 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:47.651498 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:47.651498 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:47.651498 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:47.651498 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:47.651498 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:47.651498 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:47.651498 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:47.652621 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:09:47.652621 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:09:47.652621 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:47.652621 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:47.652866 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5311bb31-b94c-427c-a47e-9abce905178f None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:47.652952 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 491/983] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:09:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:47.652952 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ff619d-d880-48ab-a2f6-07c906d4f5bf None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:47.686625 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb4a1b2-7941-4d64-8c81-6a14a346e0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:47.686986 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb4a1b2-7941-4d64-8c81-6a14a346e0de None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:47.687270 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb4a1b2-7941-4d64-8c81-6a14a346e0de None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:47.687545 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb4a1b2-7941-4d64-8c81-6a14a346e0de None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:47.688242 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb4a1b2-7941-4d64-8c81-6a14a346e0de None admin] RBAC: Adding query filter params (name=compute) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:47.688547 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb4a1b2-7941-4d64-8c81-6a14a346e0de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:47.689906 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb4a1b2-7941-4d64-8c81-6a14a346e0de None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:47.695199 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 493/984] 10.222.0.62 () {56 vars in 1112 bytes} [Fri May 27 16:09:47 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:47.695972 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb4a1b2-7941-4d64-8c81-6a14a346e0de None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:47.726388 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:47.760816 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ff619d-d880-48ab-a2f6-07c906d4f5bf None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:47.769433 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:47.793832 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb4a1b2-7941-4d64-8c81-6a14a346e0de None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:47.795590 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c3fae-0f26-40dc-b8cd-4f850e91b00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:47.796531 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c3fae-0f26-40dc-b8cd-4f850e91b00a None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:47.796823 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c3fae-0f26-40dc-b8cd-4f850e91b00a None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:47.797162 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c3fae-0f26-40dc-b8cd-4f850e91b00a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:47.797817 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116c3fae-0f26-40dc-b8cd-4f850e91b00a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:47.799239 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116c3fae-0f26-40dc-b8cd-4f850e91b00a None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:47.811547 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-116c3fae-0f26-40dc-b8cd-4f850e91b00a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 16:09:47.811547 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:47.811547 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 16:09:47.811547 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 16:09:47.811547 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 16:09:47.811547 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 16:09:47.811547 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 16:09:47.811547 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:09:47.811547 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 16:09:47.811547 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:47.811547 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 16:09:47.811547 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:47.811547 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:47.811547 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:47.811547 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:47.811547 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:47.811547 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:47.812755 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:47.812755 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:47.812755 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:47.812755 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:47.812755 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:47.812755 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:47.812755 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 16:09:47.812755 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 16:09:47.812755 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 16:09:47.812755 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 16:09:47.812755 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:47.812755 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:47.812755 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:47.812755 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:47.812755 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:47.812755 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:47.813897 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:47.813897 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:09:47.813897 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:47.813897 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:47.813897 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:47.813897 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:47.813897 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:47.813897 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:47.813897 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:47.813897 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:47.813897 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 16:09:47.813897 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:09:47.813897 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 16:09:47.813897 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:47.813897 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 492/985] 10.222.0.62 () {56 vars in 1126 bytes} [Fri May 27 16:09:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:47.814898 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c3fae-0f26-40dc-b8cd-4f850e91b00a None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:47.833490 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7f3685-f205-4f20-82f2-afa8dcbe7c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:47.834150 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7f3685-f205-4f20-82f2-afa8dcbe7c94 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:47.834518 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7f3685-f205-4f20-82f2-afa8dcbe7c94 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:47.834746 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7f3685-f205-4f20-82f2-afa8dcbe7c94 None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:47.835471 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7f3685-f205-4f20-82f2-afa8dcbe7c94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:47.835783 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7f3685-f205-4f20-82f2-afa8dcbe7c94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:47.837149 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7f3685-f205-4f20-82f2-afa8dcbe7c94 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:47.853418 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 494/986] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 16:09:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:47.854273 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7f3685-f205-4f20-82f2-afa8dcbe7c94 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:47.916090 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c3fae-0f26-40dc-b8cd-4f850e91b00a None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:47.944365 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:47.951270 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6504f10-e2ae-4c98-bd74-56d0005b8fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:47.951944 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6504f10-e2ae-4c98-bd74-56d0005b8fde None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:47.962057 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6504f10-e2ae-4c98-bd74-56d0005b8fde None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:47.962057 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6504f10-e2ae-4c98-bd74-56d0005b8fde None admin] PATH_INFO: `/v3/services` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:47.962057 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6504f10-e2ae-4c98-bd74-56d0005b8fde None admin] RBAC: Adding query filter params (type=compute) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:47.962057 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6504f10-e2ae-4c98-bd74-56d0005b8fde None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:47.962498 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7f3685-f205-4f20-82f2-afa8dcbe7c94 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:47.962908 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6504f10-e2ae-4c98-bd74-56d0005b8fde None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:47.962908 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 493/987] 10.222.0.62 () {56 vars in 1112 bytes} [Fri May 27 16:09:47 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:47.962908 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6504f10-e2ae-4c98-bd74-56d0005b8fde None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:47.989333 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f280dc-0111-4833-9e05-289d934bdf06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:47.989994 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f280dc-0111-4833-9e05-289d934bdf06 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:47.990303 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f280dc-0111-4833-9e05-289d934bdf06 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:47.990586 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f280dc-0111-4833-9e05-289d934bdf06 None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:47.991289 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f280dc-0111-4833-9e05-289d934bdf06 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:47.991598 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f280dc-0111-4833-9e05-289d934bdf06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:47.992966 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f280dc-0111-4833-9e05-289d934bdf06 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:47.994035 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:48.002853 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 495/988] 10.222.0.62 () {56 vars in 1122 bytes} [Fri May 27 16:09:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:48.002853 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f280dc-0111-4833-9e05-289d934bdf06 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:48.064567 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6504f10-e2ae-4c98-bd74-56d0005b8fde None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:48.097973 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80fe1a3-48bf-4311-8a93-112848f5f49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:48.098795 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80fe1a3-48bf-4311-8a93-112848f5f49f None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:48.099084 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80fe1a3-48bf-4311-8a93-112848f5f49f None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:48.099364 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80fe1a3-48bf-4311-8a93-112848f5f49f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:48.100267 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f280dc-0111-4833-9e05-289d934bdf06 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:48.105993 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80fe1a3-48bf-4311-8a93-112848f5f49f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:48.107492 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80fe1a3-48bf-4311-8a93-112848f5f49f None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:48.122167 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-a80fe1a3-48bf-4311-8a93-112848f5f49f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:09:48.122167 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:48.122167 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:48.122167 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:48.122167 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:48.122167 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:48.122167 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:48.122167 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:48.122167 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:48.122167 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:48.122167 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:48.122167 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:48.122167 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 16:09:48.122167 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 16:09:48.122167 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 16:09:48.123132 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 16:09:48.123132 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:48.123132 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:48.123132 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:48.123132 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:48.123132 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:48.123132 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:48.123132 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:48.123132 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:09:48.123132 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:48.123132 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:48.123132 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:48.123132 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:48.123132 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:48.123132 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:48.123132 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:48.123132 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:48.124262 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 16:09:48.124262 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 16:09:48.124262 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 16:09:48.124262 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 16:09:48.124262 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 16:09:48.124262 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 16:09:48.124262 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:09:48.124262 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:48.124262 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 494/989] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 16:09:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:48.125022 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80fe1a3-48bf-4311-8a93-112848f5f49f None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:48.138186 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5808ca-a869-40ca-863b-4d578af6b44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:48.139091 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5808ca-a869-40ca-863b-4d578af6b44b None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:48.139381 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5808ca-a869-40ca-863b-4d578af6b44b None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:48.139667 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5808ca-a869-40ca-863b-4d578af6b44b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:48.140463 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5808ca-a869-40ca-863b-4d578af6b44b None admin] RBAC: Adding query filter params (interface=public, service_id=f229600c86664b459bb08dde37d105bb, region_id=RegionOne) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:48.140784 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5808ca-a869-40ca-863b-4d578af6b44b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:48.142149 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5808ca-a869-40ca-863b-4d578af6b44b None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:48.147240 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 496/990] 10.222.0.62 () {56 vars in 1251 bytes} [Fri May 27 16:09:47 2022] GET /identity/v3/endpoints?service_id=f229600c86664b459bb08dde37d105bb&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:48.148024 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5808ca-a869-40ca-863b-4d578af6b44b None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:48.185255 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:48.209522 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:48.229334 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80fe1a3-48bf-4311-8a93-112848f5f49f None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:48.246385 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5808ca-a869-40ca-863b-4d578af6b44b None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:48.266225 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aec6979-f15b-4303-91fd-21a2365aa584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:48.266978 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec6979-f15b-4303-91fd-21a2365aa584 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:48.267265 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec6979-f15b-4303-91fd-21a2365aa584 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:48.267540 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec6979-f15b-4303-91fd-21a2365aa584 None admin] PATH_INFO: `/v3/services` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:48.268241 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aec6979-f15b-4303-91fd-21a2365aa584 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:48.268549 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aec6979-f15b-4303-91fd-21a2365aa584 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:48.269942 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aec6979-f15b-4303-91fd-21a2365aa584 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:48.274896 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 495/991] 10.222.0.62 () {56 vars in 1122 bytes} [Fri May 27 16:09:48 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:48.275673 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aec6979-f15b-4303-91fd-21a2365aa584 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:48.280469 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e4e038-dd38-4e6c-af94-2421922dfe5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:48.281137 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4e038-dd38-4e6c-af94-2421922dfe5d None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:48.281421 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4e038-dd38-4e6c-af94-2421922dfe5d None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:48.281697 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4e038-dd38-4e6c-af94-2421922dfe5d None admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:48.282519 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e4e038-dd38-4e6c-af94-2421922dfe5d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:48.282829 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e4e038-dd38-4e6c-af94-2421922dfe5d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:48.284258 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e4e038-dd38-4e6c-af94-2421922dfe5d None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:48.302050 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 497/992] 10.222.0.62 () {56 vars in 1148 bytes} [Fri May 27 16:09:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:48.302050 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e4e038-dd38-4e6c-af94-2421922dfe5d None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:48.375358 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aec6979-f15b-4303-91fd-21a2365aa584 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:48.393034 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:48.398270 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e4e038-dd38-4e6c-af94-2421922dfe5d None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:48.409193 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db59722b-f1be-4eeb-989e-668e2f2150d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:48.409853 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db59722b-f1be-4eeb-989e-668e2f2150d0 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:48.410133 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db59722b-f1be-4eeb-989e-668e2f2150d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:48.410970 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db59722b-f1be-4eeb-989e-668e2f2150d0 None admin] PATH_INFO: `/v3/services` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:48.411723 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db59722b-f1be-4eeb-989e-668e2f2150d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:48.413082 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db59722b-f1be-4eeb-989e-668e2f2150d0 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:48.419471 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 496/993] 10.222.0.62 () {56 vars in 1087 bytes} [Fri May 27 16:09:48 2022] GET /identity/v3/services => generated 1727 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:09:48.420274 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db59722b-f1be-4eeb-989e-668e2f2150d0 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:48.421369 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:48.435635 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40151a73-a4d2-4d7a-87c3-a529d56d8efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:48.436431 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40151a73-a4d2-4d7a-87c3-a529d56d8efe None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:48.443817 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40151a73-a4d2-4d7a-87c3-a529d56d8efe None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:48.443817 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40151a73-a4d2-4d7a-87c3-a529d56d8efe None admin] PATH_INFO: `/v3/endpoints` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:48.443817 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40151a73-a4d2-4d7a-87c3-a529d56d8efe None admin] RBAC: Adding query filter params (interface=admin, service_id=b78656dc9bf74c9bae45c51459fef5f0, region_id=RegionOne) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:48.443817 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40151a73-a4d2-4d7a-87c3-a529d56d8efe None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:48.443817 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40151a73-a4d2-4d7a-87c3-a529d56d8efe None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:48.446936 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 498/994] 10.222.0.62 () {56 vars in 1249 bytes} [Fri May 27 16:09:48 2022] GET /identity/v3/endpoints?service_id=b78656dc9bf74c9bae45c51459fef5f0&interface=admin®ion_id=RegionOne => generated 193 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:48.452743 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40151a73-a4d2-4d7a-87c3-a529d56d8efe None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:48.543272 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db59722b-f1be-4eeb-989e-668e2f2150d0 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:48.581471 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40151a73-a4d2-4d7a-87c3-a529d56d8efe None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:48.585079 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1e8cc8-5586-4bdb-a27b-9149e71b493a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:48.585844 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e8cc8-5586-4bdb-a27b-9149e71b493a None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:48.586135 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e8cc8-5586-4bdb-a27b-9149e71b493a None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:48.586453 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e8cc8-5586-4bdb-a27b-9149e71b493a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:48.587315 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1e8cc8-5586-4bdb-a27b-9149e71b493a None admin] RBAC: Adding query filter params (role.id=769bfee541f54e48ab47d4056838a1e5, scope.project.id=d48d95a12587479ca5714f6ebd60dd9f, user.id=eb50bf5f39b04ab689b55f46d3dd2640) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:48.587635 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1e8cc8-5586-4bdb-a27b-9149e71b493a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:48.589125 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1e8cc8-5586-4bdb-a27b-9149e71b493a None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:48.603316 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 497/995] 10.222.0.62 () {56 vars in 1374 bytes} [Fri May 27 16:09:48 2022] GET /identity/v3/role_assignments?user.id=eb50bf5f39b04ab689b55f46d3dd2640&scope.project.id=d48d95a12587479ca5714f6ebd60dd9f&role.id=769bfee541f54e48ab47d4056838a1e5 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:48.633299 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693134b3-723a-4da6-80d9-0f2a964a4988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:48.633996 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693134b3-723a-4da6-80d9-0f2a964a4988 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:48.634334 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693134b3-723a-4da6-80d9-0f2a964a4988 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:48.634625 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693134b3-723a-4da6-80d9-0f2a964a4988 None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:48.635334 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693134b3-723a-4da6-80d9-0f2a964a4988 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:48.636760 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693134b3-723a-4da6-80d9-0f2a964a4988 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:48.643950 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 499/996] 10.222.0.62 () {56 vars in 1087 bytes} [Fri May 27 16:09:48 2022] GET /identity/v3/services => generated 1727 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 16:09:50.624796 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83015e09-3187-47d4-88cd-543c8ff225d0 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:50.625314 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83015e09-3187-47d4-88cd-543c8ff225d0 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:50.625392 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83015e09-3187-47d4-88cd-543c8ff225d0 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:50.626874 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 498/997] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:09:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:09:50.631993 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cace893-f1ad-4eef-8939-6fe33c39b0c9 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:50.632368 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cace893-f1ad-4eef-8939-6fe33c39b0c9 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:50.632543 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cace893-f1ad-4eef-8939-6fe33c39b0c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:50.648571 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-5cace893-f1ad-4eef-8939-6fe33c39b0c9 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:09:50.649744 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-5cace893-f1ad-4eef-8939-6fe33c39b0c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:09:50.704270 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:50.727827 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 500/998] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:09:50 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:09:50.749976 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83015e09-3187-47d4-88cd-543c8ff225d0 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:50.799973 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:50.861086 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83015e09-3187-47d4-88cd-543c8ff225d0 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:50.883109 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e08f18-5eda-487d-8edc-3891f92992fe None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:50.883336 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e08f18-5eda-487d-8edc-3891f92992fe None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:50.883623 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e08f18-5eda-487d-8edc-3891f92992fe None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:50.885140 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 501/999] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:09:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 16:09:50.886327 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06543c79-66dd-4859-8ba1-4bc44266a77a None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:50.886670 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06543c79-66dd-4859-8ba1-4bc44266a77a None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:50.886960 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06543c79-66dd-4859-8ba1-4bc44266a77a None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:50.888441 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 502/1000] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:09:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:09:50.890145 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9940db03-9026-49b7-b2fa-1286c86253e7 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:50.890484 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9940db03-9026-49b7-b2fa-1286c86253e7 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:50.890766 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9940db03-9026-49b7-b2fa-1286c86253e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:50.900532 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6411ed23-ab7f-4e4e-8907-30ef4aafe6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:50.901332 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411ed23-ab7f-4e4e-8907-30ef4aafe6d2 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:50.901616 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411ed23-ab7f-4e4e-8907-30ef4aafe6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:50.901890 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411ed23-ab7f-4e4e-8907-30ef4aafe6d2 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:50.902580 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6411ed23-ab7f-4e4e-8907-30ef4aafe6d2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:50.903951 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6411ed23-ab7f-4e4e-8907-30ef4aafe6d2 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:50.908111 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-9940db03-9026-49b7-b2fa-1286c86253e7 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:09:50.909286 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-9940db03-9026-49b7-b2fa-1286c86253e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:09:50.915619 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-6411ed23-ab7f-4e4e-8907-30ef4aafe6d2 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 27 16:09:50.915619 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:50.915619 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 16:09:50.915619 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 16:09:50.915619 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 16:09:50.915619 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 16:09:50.915619 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 16:09:50.915619 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:09:50.915619 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 27 16:09:50.915619 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:50.915619 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 16:09:50.915619 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:50.915619 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:50.915619 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:50.915619 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:50.915619 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:50.915619 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:50.916818 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:50.916818 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:50.916818 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:50.916818 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:50.916818 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:50.916818 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:50.916818 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 16:09:50.916818 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 16:09:50.916818 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 16:09:50.916818 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 16:09:50.916818 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:50.916818 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:50.916818 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:50.916818 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:50.916818 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:50.916818 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:50.918031 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:50.918031 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:09:50.918031 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:50.918031 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:50.918031 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:50.918031 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:50.918031 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:50.918031 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:50.918031 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:50.918031 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:50.918031 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 16:09:50.918031 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:09:50.918031 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 27 16:09:50.918031 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:50.918031 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 499/1001] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 16:09:50 2022] GET /identity/v3/services/compute => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:50.918888 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4e403-efb1-43a2-960b-2b9e76ce5174 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:50.918888 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4e403-efb1-43a2-960b-2b9e76ce5174 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:50.918888 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4e403-efb1-43a2-960b-2b9e76ce5174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:50.936297 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-c9a4e403-efb1-43a2-960b-2b9e76ce5174 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:09:50.937495 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-c9a4e403-efb1-43a2-960b-2b9e76ce5174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:09:50.980224 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 503/1002] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:09:50 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 16:09:50.981056 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9940db03-9026-49b7-b2fa-1286c86253e7 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:51.011721 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 500/1003] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:09:50 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:09:51.012562 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a4e403-efb1-43a2-960b-2b9e76ce5174 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:51.056183 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:51.082699 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9940db03-9026-49b7-b2fa-1286c86253e7 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:51.093218 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:51.113123 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a4e403-efb1-43a2-960b-2b9e76ce5174 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:51.116689 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1458620b-8cc6-4501-b0db-76924ee56acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:51.117357 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458620b-8cc6-4501-b0db-76924ee56acc None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:51.117647 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458620b-8cc6-4501-b0db-76924ee56acc None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:51.117931 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458620b-8cc6-4501-b0db-76924ee56acc None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:51.118777 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1458620b-8cc6-4501-b0db-76924ee56acc None admin] RBAC: Adding query filter params (name=compute) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:51.119093 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1458620b-8cc6-4501-b0db-76924ee56acc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:51.120470 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1458620b-8cc6-4501-b0db-76924ee56acc None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:51.125406 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 504/1004] 10.222.0.62 () {56 vars in 1112 bytes} [Fri May 27 16:09:50 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:51.126198 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1458620b-8cc6-4501-b0db-76924ee56acc None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:51.147972 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cf74b0-3ea1-427c-9b59-08b906d40e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:51.148679 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf74b0-3ea1-427c-9b59-08b906d40e38 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:51.148963 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf74b0-3ea1-427c-9b59-08b906d40e38 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:51.149240 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf74b0-3ea1-427c-9b59-08b906d40e38 None admin] PATH_INFO: `/v3/services/image` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:51.149893 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cf74b0-3ea1-427c-9b59-08b906d40e38 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:51.151294 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cf74b0-3ea1-427c-9b59-08b906d40e38 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:51.162673 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-33cf74b0-3ea1-427c-9b59-08b906d40e38 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 27 16:09:51.162673 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:51.162673 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 16:09:51.162673 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 16:09:51.162673 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 16:09:51.162673 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 16:09:51.162673 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 16:09:51.162673 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:09:51.162673 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 27 16:09:51.162673 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:51.162673 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 16:09:51.162673 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:51.162673 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:51.162673 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:51.162673 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:51.162673 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:51.162673 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:51.163882 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:51.163882 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:51.163882 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:51.163882 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:51.163882 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:51.163882 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:51.163882 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 16:09:51.163882 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 16:09:51.163882 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 16:09:51.163882 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 16:09:51.163882 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:51.163882 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:51.163882 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:51.163882 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:51.163882 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:51.163882 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:51.164753 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:51.164753 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:09:51.164753 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:51.164753 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:51.164753 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:51.164753 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:51.164753 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:51.164753 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:51.164753 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:51.164753 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:51.164753 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 16:09:51.164753 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:09:51.164753 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 27 16:09:51.164753 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:51.164753 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 501/1005] 10.222.0.62 () {56 vars in 1105 bytes} [Fri May 27 16:09:51 2022] GET /identity/v3/services/image => generated 86 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:51.165576 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cf74b0-3ea1-427c-9b59-08b906d40e38 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:51.230823 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1458620b-8cc6-4501-b0db-76924ee56acc None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:51.265695 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd2e5cb-e983-417f-a242-af36d5a8dbba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:51.266536 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2e5cb-e983-417f-a242-af36d5a8dbba None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:51.266829 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2e5cb-e983-417f-a242-af36d5a8dbba None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:51.267108 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2e5cb-e983-417f-a242-af36d5a8dbba None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:51.267435 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cf74b0-3ea1-427c-9b59-08b906d40e38 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:51.267755 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd2e5cb-e983-417f-a242-af36d5a8dbba None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:51.269130 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd2e5cb-e983-417f-a242-af36d5a8dbba None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:51.271372 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:51.281637 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-2dd2e5cb-e983-417f-a242-af36d5a8dbba None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 16:09:51.281637 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:51.281637 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 16:09:51.281637 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 16:09:51.281637 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 16:09:51.281637 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 16:09:51.281637 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 16:09:51.281637 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:09:51.281637 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 16:09:51.281637 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:51.281637 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 16:09:51.281637 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:51.281637 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:51.281637 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:51.281637 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:51.281637 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:51.281637 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:51.282801 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:51.282801 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:51.282801 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:51.282801 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:51.282801 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:51.282801 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:51.282801 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 16:09:51.282801 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 16:09:51.282801 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 16:09:51.282801 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 16:09:51.282801 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:51.282801 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:51.282801 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:51.282801 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:51.282801 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:51.282801 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:51.283660 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:51.283660 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:09:51.283660 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:51.283660 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:51.283660 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:51.283660 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:51.283660 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:51.283660 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:51.283660 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:51.283660 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:51.283660 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 16:09:51.283660 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:09:51.283660 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 16:09:51.283660 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:51.283660 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 505/1006] 10.222.0.62 () {56 vars in 1126 bytes} [Fri May 27 16:09:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:51.284447 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd2e5cb-e983-417f-a242-af36d5a8dbba None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:51.306885 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae80303-712d-464b-8be6-b514075bc492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:51.307559 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae80303-712d-464b-8be6-b514075bc492 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:51.307846 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae80303-712d-464b-8be6-b514075bc492 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:51.308128 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae80303-712d-464b-8be6-b514075bc492 None admin] PATH_INFO: `/v3/services` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:51.308842 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae80303-712d-464b-8be6-b514075bc492 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:51.309154 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae80303-712d-464b-8be6-b514075bc492 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:51.310595 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae80303-712d-464b-8be6-b514075bc492 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:51.315494 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 502/1007] 10.222.0.62 () {56 vars in 1112 bytes} [Fri May 27 16:09:51 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:51.316125 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae80303-712d-464b-8be6-b514075bc492 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:51.328196 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:51.389309 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd2e5cb-e983-417f-a242-af36d5a8dbba None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:51.418515 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae80303-712d-464b-8be6-b514075bc492 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:51.423480 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039bb576-942d-4de5-b5d4-3d48c8904d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:51.424406 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039bb576-942d-4de5-b5d4-3d48c8904d02 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:51.424687 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039bb576-942d-4de5-b5d4-3d48c8904d02 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:51.424972 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039bb576-942d-4de5-b5d4-3d48c8904d02 None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:51.425713 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039bb576-942d-4de5-b5d4-3d48c8904d02 None admin] RBAC: Adding query filter params (name=image) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:51.426050 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039bb576-942d-4de5-b5d4-3d48c8904d02 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:51.427502 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039bb576-942d-4de5-b5d4-3d48c8904d02 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:51.432435 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 506/1008] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:09:51 2022] GET /identity/v3/services?name=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:51.433214 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039bb576-942d-4de5-b5d4-3d48c8904d02 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:51.455136 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ae389-831c-4f15-a4be-8916e4f97741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:51.455806 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ae389-831c-4f15-a4be-8916e4f97741 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:51.456096 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ae389-831c-4f15-a4be-8916e4f97741 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:51.456369 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ae389-831c-4f15-a4be-8916e4f97741 None admin] PATH_INFO: `/v3/services` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:51.457080 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1ae389-831c-4f15-a4be-8916e4f97741 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:51.457956 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1ae389-831c-4f15-a4be-8916e4f97741 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:51.459364 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1ae389-831c-4f15-a4be-8916e4f97741 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:51.464116 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 503/1009] 10.222.0.62 () {56 vars in 1122 bytes} [Fri May 27 16:09:51 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:51.464897 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ae389-831c-4f15-a4be-8916e4f97741 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:51.502173 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:51.536459 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039bb576-942d-4de5-b5d4-3d48c8904d02 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:51.537996 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:51.570987 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f49f8-5f9f-443a-b067-fe10c2b3d8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:51.571645 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f49f8-5f9f-443a-b067-fe10c2b3d8e1 None admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:51.571936 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f49f8-5f9f-443a-b067-fe10c2b3d8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:51.572219 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f49f8-5f9f-443a-b067-fe10c2b3d8e1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:51.572972 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ae389-831c-4f15-a4be-8916e4f97741 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:51.573082 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45f49f8-5f9f-443a-b067-fe10c2b3d8e1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:51.574379 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45f49f8-5f9f-443a-b067-fe10c2b3d8e1 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:51.606663 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9355846e-d75c-4ef0-9065-b101fe88b8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:51.607457 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9355846e-d75c-4ef0-9065-b101fe88b8d2 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:51.607737 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9355846e-d75c-4ef0-9065-b101fe88b8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:51.608012 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9355846e-d75c-4ef0-9065-b101fe88b8d2 None admin] PATH_INFO: `/v3/services` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:51.608719 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9355846e-d75c-4ef0-9065-b101fe88b8d2 None admin] RBAC: Adding query filter params (type=image) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:51.609027 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9355846e-d75c-4ef0-9065-b101fe88b8d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:51.610395 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9355846e-d75c-4ef0-9065-b101fe88b8d2 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:51.614897 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 504/1010] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:09:51 2022] GET /identity/v3/services?type=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:51.615665 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9355846e-d75c-4ef0-9065-b101fe88b8d2 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:51.714383 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 507/1011] 10.222.0.62 () {60 vars in 1144 bytes} [Fri May 27 16:09:51 2022] POST /identity/v3/endpoints => generated 334 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:09:51.733309 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:51.740740 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9355846e-d75c-4ef0-9065-b101fe88b8d2 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:51.789680 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66a2511-9046-44a3-9832-b5b22db4163f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:51.790409 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a2511-9046-44a3-9832-b5b22db4163f None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:51.790693 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a2511-9046-44a3-9832-b5b22db4163f None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:51.790969 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a2511-9046-44a3-9832-b5b22db4163f None admin] PATH_INFO: `/v3/services` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:51.791708 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66a2511-9046-44a3-9832-b5b22db4163f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:51.792018 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66a2511-9046-44a3-9832-b5b22db4163f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:51.793464 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66a2511-9046-44a3-9832-b5b22db4163f None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:51.805045 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 505/1012] 10.222.0.62 () {56 vars in 1122 bytes} [Fri May 27 16:09:51 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:51.806572 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f49f8-5f9f-443a-b067-fe10c2b3d8e1 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:51.930310 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f49f8-5f9f-443a-b067-fe10c2b3d8e1 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:51.966448 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac8c21-6fe0-4852-8f7f-f1ab0b19e6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:51.967040 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac8c21-6fe0-4852-8f7f-f1ab0b19e6d0 None admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:51.967324 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac8c21-6fe0-4852-8f7f-f1ab0b19e6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:51.967605 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac8c21-6fe0-4852-8f7f-f1ab0b19e6d0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:51.968357 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ac8c21-6fe0-4852-8f7f-f1ab0b19e6d0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:51.969899 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ac8c21-6fe0-4852-8f7f-f1ab0b19e6d0 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:52.096733 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 508/1013] 10.222.0.62 () {60 vars in 1144 bytes} [Fri May 27 16:09:51 2022] POST /identity/v3/endpoints => generated 325 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:09:53.855394 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d3c552-d9bf-41d1-be59-485aaf70e956 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:53.855975 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d3c552-d9bf-41d1-be59-485aaf70e956 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:53.855975 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d3c552-d9bf-41d1-be59-485aaf70e956 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:53.857741 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 506/1014] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:09:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:09:53.863667 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b6173c-035d-4340-96ef-54f52a3623e2 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:53.864592 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b6173c-035d-4340-96ef-54f52a3623e2 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:53.865084 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b6173c-035d-4340-96ef-54f52a3623e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:53.884807 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-b0b6173c-035d-4340-96ef-54f52a3623e2 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:09:53.886415 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-b0b6173c-035d-4340-96ef-54f52a3623e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:09:53.902573 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:53.964150 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 509/1015] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:09:53 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:09:53.984937 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d3c552-d9bf-41d1-be59-485aaf70e956 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:54.063380 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d5c7b-d3d1-41ab-8cd5-51ea31ca9772 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:54.063960 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d5c7b-d3d1-41ab-8cd5-51ea31ca9772 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:54.064245 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d5c7b-d3d1-41ab-8cd5-51ea31ca9772 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:54.065628 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 510/1016] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:09:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:09:54.070785 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc127b7-5f32-40b7-a03a-8136943db9b1 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:54.071084 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc127b7-5f32-40b7-a03a-8136943db9b1 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:54.071364 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc127b7-5f32-40b7-a03a-8136943db9b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:54.088789 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-6bc127b7-5f32-40b7-a03a-8136943db9b1 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:09:54.089990 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-6bc127b7-5f32-40b7-a03a-8136943db9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:09:54.090213 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d3c552-d9bf-41d1-be59-485aaf70e956 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:54.130173 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3840776e-de7a-491b-97de-21396943115c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:54.130819 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3840776e-de7a-491b-97de-21396943115c None admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:54.131107 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3840776e-de7a-491b-97de-21396943115c None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:54.131396 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3840776e-de7a-491b-97de-21396943115c None admin] PATH_INFO: `/v3/services` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:54.132156 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3840776e-de7a-491b-97de-21396943115c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:54.133575 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3840776e-de7a-491b-97de-21396943115c None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:54.166687 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 511/1017] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:09:54 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 16:09:54.189974 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc127b7-5f32-40b7-a03a-8136943db9b1 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:54.246554 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 507/1018] 10.222.0.62 () {60 vars in 1141 bytes} [Fri May 27 16:09:53 2022] POST /identity/v3/services => generated 242 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:09:54.295578 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:54.308952 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55639ae3-362a-4315-9ca1-a6d7f7089955 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:54.309251 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55639ae3-362a-4315-9ca1-a6d7f7089955 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:54.309723 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55639ae3-362a-4315-9ca1-a6d7f7089955 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:54.311413 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 508/1019] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:09:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:09:54.317662 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205ca62a-f8e2-4c18-abb0-a64228c54796 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:54.321664 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205ca62a-f8e2-4c18-abb0-a64228c54796 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:54.321664 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205ca62a-f8e2-4c18-abb0-a64228c54796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:54.329104 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc127b7-5f32-40b7-a03a-8136943db9b1 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:54.336819 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-205ca62a-f8e2-4c18-abb0-a64228c54796 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:09:54.338055 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-205ca62a-f8e2-4c18-abb0-a64228c54796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:09:54.351462 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:54.493754 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb81610-834c-46f6-aa1c-16d70b1b17a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:54.494489 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 509/1020] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:09:54 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 16:09:54.494622 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb81610-834c-46f6-aa1c-16d70b1b17a3 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:54.494879 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb81610-834c-46f6-aa1c-16d70b1b17a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:54.495163 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb81610-834c-46f6-aa1c-16d70b1b17a3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:54.506669 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb81610-834c-46f6-aa1c-16d70b1b17a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:09:54.514836 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-acb81610-834c-46f6-aa1c-16d70b1b17a3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 16:09:54.514836 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:54.514836 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:54.514836 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:54.514836 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:54.514836 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:54.514836 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:54.514836 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:54.514836 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:54.514836 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:54.514836 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:54.514836 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:54.514836 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:09:54.514836 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:09:54.514836 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:09:54.514836 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:09:54.515781 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:09:54.515781 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:09:54.515781 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:09:54.515781 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:09:54.515781 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:54.515781 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:54.515781 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:54.515781 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:54.515781 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:54.515781 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:54.515781 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:54.515781 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:09:54.515781 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:54.515781 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:54.515781 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:54.515781 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:54.516623 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:54.516623 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:54.516623 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:54.516623 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:54.516623 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:09:54.516623 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:09:54.516623 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:09:54.516623 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:09:54.516623 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:09:54.516623 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:09:54.516623 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 16:09:54.516623 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:54.516623 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 512/1021] 10.222.0.62 () {56 vars in 1120 bytes} [Fri May 27 16:09:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:09:54.517357 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205ca62a-f8e2-4c18-abb0-a64228c54796 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:54.522428 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb81610-834c-46f6-aa1c-16d70b1b17a3 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:54.628187 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205ca62a-f8e2-4c18-abb0-a64228c54796 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:54.631031 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb81610-834c-46f6-aa1c-16d70b1b17a3 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:54.661920 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:54.664761 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b244f5-63a1-4fe7-8c80-a1b1ffc7274d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:54.665566 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b244f5-63a1-4fe7-8c80-a1b1ffc7274d None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:54.665850 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b244f5-63a1-4fe7-8c80-a1b1ffc7274d None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:54.666128 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b244f5-63a1-4fe7-8c80-a1b1ffc7274d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:54.667350 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b244f5-63a1-4fe7-8c80-a1b1ffc7274d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:54.668321 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a90a6b0-7368-45d8-9e68-1a577e3675a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:54.668799 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b244f5-63a1-4fe7-8c80-a1b1ffc7274d None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:54.668993 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a90a6b0-7368-45d8-9e68-1a577e3675a7 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:54.669283 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a90a6b0-7368-45d8-9e68-1a577e3675a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:54.669566 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a90a6b0-7368-45d8-9e68-1a577e3675a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:54.670357 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a90a6b0-7368-45d8-9e68-1a577e3675a7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:54.670708 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a90a6b0-7368-45d8-9e68-1a577e3675a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:54.672107 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a90a6b0-7368-45d8-9e68-1a577e3675a7 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:54.675966 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 510/1022] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:09:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:54.676765 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b244f5-63a1-4fe7-8c80-a1b1ffc7274d None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:54.686521 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 513/1023] 10.222.0.62 () {56 vars in 1115 bytes} [Fri May 27 16:09:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:09:54.687819 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a90a6b0-7368-45d8-9e68-1a577e3675a7 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:54.690863 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:54.783430 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b244f5-63a1-4fe7-8c80-a1b1ffc7274d None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:54.797768 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a90a6b0-7368-45d8-9e68-1a577e3675a7 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:54.823083 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a04e038-b7d5-4aeb-ae16-103ceaf9eb54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:54.823446 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a04e038-b7d5-4aeb-ae16-103ceaf9eb54 None admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:54.823708 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a04e038-b7d5-4aeb-ae16-103ceaf9eb54 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:54.823983 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a04e038-b7d5-4aeb-ae16-103ceaf9eb54 None admin] PATH_INFO: `/v3/projects` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:54.824710 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a04e038-b7d5-4aeb-ae16-103ceaf9eb54 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:54.826158 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a04e038-b7d5-4aeb-ae16-103ceaf9eb54 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:54.839286 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29776d3-7b78-4ebd-9fdd-a5ed83f5d6c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:54.840094 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29776d3-7b78-4ebd-9fdd-a5ed83f5d6c1 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:54.840380 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29776d3-7b78-4ebd-9fdd-a5ed83f5d6c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:54.840655 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29776d3-7b78-4ebd-9fdd-a5ed83f5d6c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:54.852774 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29776d3-7b78-4ebd-9fdd-a5ed83f5d6c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:54.854354 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29776d3-7b78-4ebd-9fdd-a5ed83f5d6c1 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:54.872512 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-b29776d3-7b78-4ebd-9fdd-a5ed83f5d6c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:54.872512 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:54.872512 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:54.872512 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:54.872512 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:54.872512 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:54.872512 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:54.872512 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:54.872512 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:54.872512 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:54.872512 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:54.872512 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:54.872512 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:09:54.872512 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:09:54.872512 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:09:54.873957 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:09:54.873957 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:54.873957 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:54.873957 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:54.873957 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:54.873957 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:54.873957 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:54.873957 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:54.873957 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:09:54.873957 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:54.873957 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:54.873957 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:54.873957 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:54.873957 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:54.873957 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:54.873957 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:54.873957 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:54.875184 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:09:54.875184 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:09:54.875184 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:54.875184 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:54.878411 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 514/1024] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:09:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:09:54.880094 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29776d3-7b78-4ebd-9fdd-a5ed83f5d6c1 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:54.926193 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:54.927664 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 511/1025] 10.222.0.62 () {60 vars in 1141 bytes} [Fri May 27 16:09:54 2022] POST /identity/v3/projects => generated 311 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:09:54.985911 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29776d3-7b78-4ebd-9fdd-a5ed83f5d6c1 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:55.026603 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0b41c0-1286-4305-b5be-1e55c8062236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:55.027297 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b41c0-1286-4305-b5be-1e55c8062236 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:55.027586 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b41c0-1286-4305-b5be-1e55c8062236 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:55.027866 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b41c0-1286-4305-b5be-1e55c8062236 None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:55.028617 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0b41c0-1286-4305-b5be-1e55c8062236 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:55.028932 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0b41c0-1286-4305-b5be-1e55c8062236 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:55.030387 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0b41c0-1286-4305-b5be-1e55c8062236 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:55.047791 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 515/1026] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 16:09:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:55.049276 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a04e038-b7d5-4aeb-ae16-103ceaf9eb54 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:55.118458 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:55.160768 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a04e038-b7d5-4aeb-ae16-103ceaf9eb54 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:55.197248 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93fc72f-6368-44f9-9390-4ab44281f7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:55.198064 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93fc72f-6368-44f9-9390-4ab44281f7a2 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:55.198417 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93fc72f-6368-44f9-9390-4ab44281f7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:55.198698 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93fc72f-6368-44f9-9390-4ab44281f7a2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:55.206657 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93fc72f-6368-44f9-9390-4ab44281f7a2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:55.208290 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93fc72f-6368-44f9-9390-4ab44281f7a2 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:55.223398 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-c93fc72f-6368-44f9-9390-4ab44281f7a2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 16:09:55.223398 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:55.223398 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:55.223398 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:55.223398 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:55.223398 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:55.223398 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:55.223398 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:55.223398 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:55.223398 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:55.223398 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:55.223398 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:55.223398 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 16:09:55.223398 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 16:09:55.223398 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 16:09:55.223398 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 16:09:55.224665 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:55.224665 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:55.224665 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 16:09:55.224665 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:09:55.224665 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 16:09:55.224665 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:09:55.224665 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:55.224665 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:55.224665 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:55.224665 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:55.224665 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:55.224665 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:09:55.224665 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:55.224665 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:55.224665 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:55.224665 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:55.224665 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:55.224665 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:55.225884 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:55.225884 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:55.225884 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 16:09:55.225884 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 16:09:55.225884 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 16:09:55.225884 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 16:09:55.225884 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 16:09:55.225884 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 16:09:55.225884 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 16:09:55.225884 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:09:55.225884 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 512/1027] 10.222.0.62 () {56 vars in 1093 bytes} [Fri May 27 16:09:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:55.230755 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0b41c0-1286-4305-b5be-1e55c8062236 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:55.334635 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0b41c0-1286-4305-b5be-1e55c8062236 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:55.337070 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:55.369768 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e546fa-8330-4aee-91ef-f741d5400061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:55.370478 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e546fa-8330-4aee-91ef-f741d5400061 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:55.370771 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e546fa-8330-4aee-91ef-f741d5400061 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:55.371055 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e546fa-8330-4aee-91ef-f741d5400061 None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:55.371899 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e546fa-8330-4aee-91ef-f741d5400061 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:55.372214 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e546fa-8330-4aee-91ef-f741d5400061 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:55.373971 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e546fa-8330-4aee-91ef-f741d5400061 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:55.398745 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 516/1028] 10.222.0.62 () {56 vars in 1133 bytes} [Fri May 27 16:09:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:55.400655 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93fc72f-6368-44f9-9390-4ab44281f7a2 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:55.508160 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93fc72f-6368-44f9-9390-4ab44281f7a2 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:55.531153 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:55.557055 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b413809-f093-4e6c-a82c-7cd548e428bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:55.557775 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b413809-f093-4e6c-a82c-7cd548e428bd None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:55.558064 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b413809-f093-4e6c-a82c-7cd548e428bd None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:55.558375 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b413809-f093-4e6c-a82c-7cd548e428bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:55.629666 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b413809-f093-4e6c-a82c-7cd548e428bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:55.631086 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b413809-f093-4e6c-a82c-7cd548e428bd None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:55.735923 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 513/1029] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 16:09:55 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 16:09:55.742493 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e546fa-8330-4aee-91ef-f741d5400061 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:55.847374 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e546fa-8330-4aee-91ef-f741d5400061 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:55.887583 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d4c50-154a-498e-b03e-fe4920bf9c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:55.888313 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d4c50-154a-498e-b03e-fe4920bf9c3e None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:55.888597 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d4c50-154a-498e-b03e-fe4920bf9c3e None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:55.888878 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d4c50-154a-498e-b03e-fe4920bf9c3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:55.899417 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566d4c50-154a-498e-b03e-fe4920bf9c3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:55.900882 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566d4c50-154a-498e-b03e-fe4920bf9c3e None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:55.919158 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-566d4c50-154a-498e-b03e-fe4920bf9c3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:55.919158 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:55.919158 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:55.919158 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:55.919158 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:55.919158 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:55.919158 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:55.919158 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:55.919158 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:55.919158 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:55.919158 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:55.919158 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:55.919158 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:09:55.919158 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:09:55.919158 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:09:55.920094 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:09:55.920094 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:55.920094 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:55.920094 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:55.920094 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:55.920094 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:55.920094 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:55.920094 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:55.920094 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:09:55.920094 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:55.920094 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:55.920094 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:55.920094 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:55.920094 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:55.920094 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:55.920094 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:55.920094 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:55.925882 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:09:55.925882 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:09:55.925882 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:55.925882 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:55.925882 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 517/1030] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:09:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:09:55.927665 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b413809-f093-4e6c-a82c-7cd548e428bd None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:55.952721 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:56.029070 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b413809-f093-4e6c-a82c-7cd548e428bd None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:56.063914 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c3ab89-adfe-4cd3-896e-08f0ab742192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:56.064588 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c3ab89-adfe-4cd3-896e-08f0ab742192 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:56.064877 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c3ab89-adfe-4cd3-896e-08f0ab742192 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:56.065158 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c3ab89-adfe-4cd3-896e-08f0ab742192 None admin] PATH_INFO: `/v3/domains` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:56.065890 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c3ab89-adfe-4cd3-896e-08f0ab742192 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:56.066743 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c3ab89-adfe-4cd3-896e-08f0ab742192 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:56.068121 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c3ab89-adfe-4cd3-896e-08f0ab742192 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:56.085905 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 514/1031] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 16:09:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:09:56.087719 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d4c50-154a-498e-b03e-fe4920bf9c3e None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:56.104607 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:56.195153 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d4c50-154a-498e-b03e-fe4920bf9c3e None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:56.231123 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc98f9f-b84c-4587-8454-2a1ad1eed785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:56.231919 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc98f9f-b84c-4587-8454-2a1ad1eed785 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:56.232208 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc98f9f-b84c-4587-8454-2a1ad1eed785 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:56.232488 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc98f9f-b84c-4587-8454-2a1ad1eed785 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:56.239566 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc98f9f-b84c-4587-8454-2a1ad1eed785 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:56.241029 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc98f9f-b84c-4587-8454-2a1ad1eed785 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:56.255903 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-4bc98f9f-b84c-4587-8454-2a1ad1eed785 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:09:56.255903 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:56.255903 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:56.255903 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:56.255903 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:56.255903 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:56.255903 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:56.255903 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:56.255903 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:56.255903 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:56.255903 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:56.255903 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:56.255903 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 16:09:56.255903 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 16:09:56.255903 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 16:09:56.256814 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 16:09:56.256814 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:56.256814 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:56.256814 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:56.256814 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:56.256814 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:56.256814 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:56.256814 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:56.256814 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:09:56.256814 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:56.256814 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:56.256814 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:56.256814 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:56.256814 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:56.256814 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:56.256814 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:56.256814 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:56.257737 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 16:09:56.257737 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 16:09:56.257737 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 16:09:56.257737 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 16:09:56.257737 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 16:09:56.257737 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 16:09:56.257737 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:09:56.257737 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:56.262015 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 518/1032] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 16:09:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:56.263405 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c3ab89-adfe-4cd3-896e-08f0ab742192 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:56.354465 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:56.372866 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c3ab89-adfe-4cd3-896e-08f0ab742192 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:56.407621 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1571b7c7-0c39-4017-a9d7-c9d4e6fc580a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:56.408580 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571b7c7-0c39-4017-a9d7-c9d4e6fc580a None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:56.409054 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571b7c7-0c39-4017-a9d7-c9d4e6fc580a None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:56.409515 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571b7c7-0c39-4017-a9d7-c9d4e6fc580a None admin] PATH_INFO: `/v3/projects` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:56.411082 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1571b7c7-0c39-4017-a9d7-c9d4e6fc580a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:56.411612 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1571b7c7-0c39-4017-a9d7-c9d4e6fc580a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:56.413221 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1571b7c7-0c39-4017-a9d7-c9d4e6fc580a None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:56.430417 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 515/1033] 10.222.0.62 () {56 vars in 1148 bytes} [Fri May 27 16:09:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:56.432473 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc98f9f-b84c-4587-8454-2a1ad1eed785 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:56.504339 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f2c4c6-4f3c-42c5-abef-3316070b4c67 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:56.504938 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f2c4c6-4f3c-42c5-abef-3316070b4c67 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:56.505410 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f2c4c6-4f3c-42c5-abef-3316070b4c67 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:56.507000 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 516/1034] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:09:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 16:09:56.512213 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e734bb-50bf-4739-b190-d8c9f9f8a764 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:56.512776 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e734bb-50bf-4739-b190-d8c9f9f8a764 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:56.513059 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e734bb-50bf-4739-b190-d8c9f9f8a764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:56.513561 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:56.530193 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-02e734bb-50bf-4739-b190-d8c9f9f8a764 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:09:56.531419 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-02e734bb-50bf-4739-b190-d8c9f9f8a764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:09:56.540227 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc98f9f-b84c-4587-8454-2a1ad1eed785 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:56.576917 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0000c93-1f8a-4fd2-ba3f-9ae528790d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:56.577592 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0000c93-1f8a-4fd2-ba3f-9ae528790d3e None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:56.577879 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0000c93-1f8a-4fd2-ba3f-9ae528790d3e None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:56.578161 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0000c93-1f8a-4fd2-ba3f-9ae528790d3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:56.579038 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0000c93-1f8a-4fd2-ba3f-9ae528790d3e None admin] RBAC: Adding query filter params (role.id=769bfee541f54e48ab47d4056838a1e5, scope.project.id=d48d95a12587479ca5714f6ebd60dd9f, user.id=cb13ad6d8b1e46029262556bff398796) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:56.579356 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0000c93-1f8a-4fd2-ba3f-9ae528790d3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:56.580786 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0000c93-1f8a-4fd2-ba3f-9ae528790d3e None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:56.587318 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 519/1035] 10.222.0.62 () {56 vars in 1374 bytes} [Fri May 27 16:09:56 2022] GET /identity/v3/role_assignments?user.id=cb13ad6d8b1e46029262556bff398796&scope.project.id=d48d95a12587479ca5714f6ebd60dd9f&role.id=769bfee541f54e48ab47d4056838a1e5 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:56.601878 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 517/1036] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:09:56 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 16:09:56.624595 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0000c93-1f8a-4fd2-ba3f-9ae528790d3e None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:56.736116 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0000c93-1f8a-4fd2-ba3f-9ae528790d3e None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:56.782915 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101a9b60-9c2d-409f-81f4-654d6aa71c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:56.783637 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101a9b60-9c2d-409f-81f4-654d6aa71c27 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:56.783923 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101a9b60-9c2d-409f-81f4-654d6aa71c27 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:56.784198 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101a9b60-9c2d-409f-81f4-654d6aa71c27 None admin] PATH_INFO: `/v3/services/image` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:56.784848 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101a9b60-9c2d-409f-81f4-654d6aa71c27 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:56.786772 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101a9b60-9c2d-409f-81f4-654d6aa71c27 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:56.798758 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-101a9b60-9c2d-409f-81f4-654d6aa71c27 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 27 16:09:56.798758 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:56.798758 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 16:09:56.798758 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 16:09:56.798758 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 16:09:56.798758 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 16:09:56.798758 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 16:09:56.798758 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:09:56.798758 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 27 16:09:56.798758 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:56.798758 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 16:09:56.798758 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:56.798758 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:56.798758 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:56.798758 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:56.798758 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:56.798758 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:56.800050 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:56.800050 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:56.800050 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:56.800050 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:56.800050 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:56.800050 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:56.800050 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 16:09:56.800050 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 16:09:56.800050 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 16:09:56.800050 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 16:09:56.800050 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:56.800050 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:56.800050 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:56.800050 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:56.800050 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:56.800050 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:56.801462 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:56.801462 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:09:56.801462 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:56.801462 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:56.801462 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:56.801462 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:56.801462 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:56.801462 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:56.801462 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:56.801462 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:56.801462 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 16:09:56.801462 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:09:56.801462 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 27 16:09:56.801462 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:56.803448 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 520/1037] 10.222.0.62 () {56 vars in 1105 bytes} [Fri May 27 16:09:56 2022] GET /identity/v3/services/image => generated 86 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:56.807014 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e734bb-50bf-4739-b190-d8c9f9f8a764 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:56.896709 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:56.927081 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e734bb-50bf-4739-b190-d8c9f9f8a764 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:56.964597 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee7a9fa-523c-4ab3-803e-44235c95520e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:56.965262 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee7a9fa-523c-4ab3-803e-44235c95520e None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:56.965535 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee7a9fa-523c-4ab3-803e-44235c95520e None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:56.965811 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee7a9fa-523c-4ab3-803e-44235c95520e None admin] PATH_INFO: `/v3/services` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:56.966556 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee7a9fa-523c-4ab3-803e-44235c95520e None admin] RBAC: Adding query filter params (name=image) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:56.966868 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee7a9fa-523c-4ab3-803e-44235c95520e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:56.968234 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee7a9fa-523c-4ab3-803e-44235c95520e None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:56.974030 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 518/1038] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:09:56 2022] GET /identity/v3/services?name=image => generated 122 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:09:56.979568 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101a9b60-9c2d-409f-81f4-654d6aa71c27 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:56.982647 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:57.090336 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101a9b60-9c2d-409f-81f4-654d6aa71c27 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:57.125168 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5e2d41-299e-4e99-8a91-788b81b33e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:57.126075 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e2d41-299e-4e99-8a91-788b81b33e2d None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:57.126767 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e2d41-299e-4e99-8a91-788b81b33e2d None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:57.127200 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e2d41-299e-4e99-8a91-788b81b33e2d None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:57.128108 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5e2d41-299e-4e99-8a91-788b81b33e2d None admin] RBAC: Adding query filter params (type=image) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:57.128677 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5e2d41-299e-4e99-8a91-788b81b33e2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:57.130211 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5e2d41-299e-4e99-8a91-788b81b33e2d None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:57.135931 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 521/1039] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:09:56 2022] GET /identity/v3/services?type=image => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:09:57.141398 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee7a9fa-523c-4ab3-803e-44235c95520e None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:57.200351 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be84a0-33da-46e8-b525-10ebc871e95f None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:57.200699 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be84a0-33da-46e8-b525-10ebc871e95f None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:57.200931 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be84a0-33da-46e8-b525-10ebc871e95f None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:57.205942 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 522/1040] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:09:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 16:09:57.208431 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee047e9-184a-4726-93c2-32a7851f2c08 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:57.209061 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee047e9-184a-4726-93c2-32a7851f2c08 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:57.209494 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee047e9-184a-4726-93c2-32a7851f2c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:57.227544 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-6ee047e9-184a-4726-93c2-32a7851f2c08 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:09:57.228722 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-6ee047e9-184a-4726-93c2-32a7851f2c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:09:57.255271 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee7a9fa-523c-4ab3-803e-44235c95520e None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:57.294235 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e3f7d6-b775-4fc0-9254-a479623508da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:57.294939 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e3f7d6-b775-4fc0-9254-a479623508da None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:57.295220 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e3f7d6-b775-4fc0-9254-a479623508da None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:57.295572 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e3f7d6-b775-4fc0-9254-a479623508da None admin] PATH_INFO: `/v3/endpoints` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:57.296039 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:57.296283 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e3f7d6-b775-4fc0-9254-a479623508da None admin] RBAC: Adding query filter params (interface=public, service_id=2cb74e9d9ebb44948b14579b3771ea1d, region_id=RegionOne) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:57.296603 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e3f7d6-b775-4fc0-9254-a479623508da None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:57.298276 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e3f7d6-b775-4fc0-9254-a479623508da None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:57.301475 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:57.304460 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 519/1041] 10.222.0.62 () {56 vars in 1251 bytes} [Fri May 27 16:09:57 2022] GET /identity/v3/endpoints?service_id=2cb74e9d9ebb44948b14579b3771ea1d&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:09:57.305053 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 523/1042] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:09:57 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:09:57.310006 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e3f7d6-b775-4fc0-9254-a479623508da None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:57.330619 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee047e9-184a-4726-93c2-32a7851f2c08 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:57.415976 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e3f7d6-b775-4fc0-9254-a479623508da None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:57.442557 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee047e9-184a-4726-93c2-32a7851f2c08 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:57.451450 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef5aa87-9a79-423b-9af3-029a97570527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:57.452467 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5aa87-9a79-423b-9af3-029a97570527 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:57.452610 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5aa87-9a79-423b-9af3-029a97570527 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:57.452777 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5aa87-9a79-423b-9af3-029a97570527 None admin] PATH_INFO: `/v3/services` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:57.453477 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef5aa87-9a79-423b-9af3-029a97570527 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:57.454961 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef5aa87-9a79-423b-9af3-029a97570527 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:57.470528 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 520/1043] 10.222.0.62 () {56 vars in 1087 bytes} [Fri May 27 16:09:57 2022] GET /identity/v3/services => generated 1957 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 16:09:57.488022 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0807f784-e6bc-4403-9b08-737b653b8ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:57.489802 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0807f784-e6bc-4403-9b08-737b653b8ba9 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:57.490187 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0807f784-e6bc-4403-9b08-737b653b8ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:57.490552 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0807f784-e6bc-4403-9b08-737b653b8ba9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:57.491921 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0807f784-e6bc-4403-9b08-737b653b8ba9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:57.493464 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0807f784-e6bc-4403-9b08-737b653b8ba9 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:57.500028 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 524/1044] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:09:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:09:57.501732 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef5aa87-9a79-423b-9af3-029a97570527 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:57.587815 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:57.629760 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef5aa87-9a79-423b-9af3-029a97570527 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:57.667963 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b740ec0-e238-498e-9263-9487797ed64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:57.667963 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b740ec0-e238-498e-9263-9487797ed64a None admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:57.668233 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b740ec0-e238-498e-9263-9487797ed64a None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:57.668488 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b740ec0-e238-498e-9263-9487797ed64a None admin] PATH_INFO: `/v3/users` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:57.669526 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b740ec0-e238-498e-9263-9487797ed64a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:57.670711 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b740ec0-e238-498e-9263-9487797ed64a None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:57.799279 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 521/1045] 10.222.0.62 () {60 vars in 1132 bytes} [Fri May 27 16:09:57 2022] POST /identity/v3/users => generated 285 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:09:58.804868 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2e414-ea90-4b50-9fed-ddd83100e5ba None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:58.805386 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2e414-ea90-4b50-9fed-ddd83100e5ba None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:58.805466 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2e414-ea90-4b50-9fed-ddd83100e5ba None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:58.806970 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 525/1046] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:09:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:09:58.811971 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9322f-7edb-4865-8427-09969345fae3 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:58.812383 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9322f-7edb-4865-8427-09969345fae3 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:58.812610 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9322f-7edb-4865-8427-09969345fae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:58.830034 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-81e9322f-7edb-4865-8427-09969345fae3 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:09:58.831262 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-81e9322f-7edb-4865-8427-09969345fae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:09:58.906289 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 522/1047] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:09:58 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:09:58.926955 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df2e414-ea90-4b50-9fed-ddd83100e5ba None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:59.016817 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:59.056073 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df2e414-ea90-4b50-9fed-ddd83100e5ba None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:59.091625 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d941bf1b-975d-48bc-b785-88a4a751dd43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:59.092443 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d941bf1b-975d-48bc-b785-88a4a751dd43 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:59.092731 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d941bf1b-975d-48bc-b785-88a4a751dd43 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:59.093013 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d941bf1b-975d-48bc-b785-88a4a751dd43 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:59.103236 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d941bf1b-975d-48bc-b785-88a4a751dd43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:09:59.111433 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-d941bf1b-975d-48bc-b785-88a4a751dd43 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 16:09:59.111433 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:59.111433 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:59.111433 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:59.111433 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:59.111433 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:59.111433 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:59.111433 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:59.111433 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:59.111433 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:59.111433 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:59.111433 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:59.111433 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:09:59.111433 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:09:59.111433 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:09:59.111433 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:09:59.112411 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:09:59.112411 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:09:59.112411 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:09:59.112411 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:09:59.112411 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:59.112411 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:59.112411 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:59.112411 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:59.112411 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:59.112411 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:59.112411 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:59.112411 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:09:59.112411 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:59.112411 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:59.112411 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:59.112411 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:59.113359 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:59.113359 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:59.113359 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:59.113359 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:59.113359 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:09:59.113359 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:09:59.113359 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:09:59.113359 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:09:59.113359 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:09:59.113359 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:09:59.113359 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 16:09:59.113359 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:59.117716 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 526/1048] 10.222.0.62 () {56 vars in 1120 bytes} [Fri May 27 16:09:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:09:59.118973 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e9322f-7edb-4865-8427-09969345fae3 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:59.170169 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:59.220017 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e9322f-7edb-4865-8427-09969345fae3 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:59.254165 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ff40ae-2ced-445a-9882-ab89ca2defc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:59.254911 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff40ae-2ced-445a-9882-ab89ca2defc0 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:59.255197 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff40ae-2ced-445a-9882-ab89ca2defc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:59.255470 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff40ae-2ced-445a-9882-ab89ca2defc0 None admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:59.256210 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ff40ae-2ced-445a-9882-ab89ca2defc0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:59.256514 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ff40ae-2ced-445a-9882-ab89ca2defc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:59.257921 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ff40ae-2ced-445a-9882-ab89ca2defc0 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:59.270745 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 523/1049] 10.222.0.62 () {56 vars in 1115 bytes} [Fri May 27 16:09:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:59.272540 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d941bf1b-975d-48bc-b785-88a4a751dd43 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:59.381801 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d941bf1b-975d-48bc-b785-88a4a751dd43 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:59.405056 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:59.416113 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056ad1ea-ddc4-4e08-a8a8-eb7b55bd160c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:59.416906 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ad1ea-ddc4-4e08-a8a8-eb7b55bd160c None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:59.417894 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ad1ea-ddc4-4e08-a8a8-eb7b55bd160c None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:59.417894 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ad1ea-ddc4-4e08-a8a8-eb7b55bd160c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:59.429073 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056ad1ea-ddc4-4e08-a8a8-eb7b55bd160c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:59.430548 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056ad1ea-ddc4-4e08-a8a8-eb7b55bd160c None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:59.448166 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-056ad1ea-ddc4-4e08-a8a8-eb7b55bd160c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:59.448166 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:59.448166 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:59.448166 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:59.448166 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:59.448166 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:59.448166 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:59.448166 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:59.448166 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:59.448166 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:59.448166 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:59.448166 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:59.448166 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:09:59.448166 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:09:59.448166 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:09:59.449102 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:09:59.449102 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:59.449102 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:59.449102 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:59.449102 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:59.449102 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:59.449102 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:59.449102 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:59.449102 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:09:59.449102 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:59.449102 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:59.449102 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:59.449102 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:59.449102 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:59.449102 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:59.449102 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:59.449102 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:59.449979 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:09:59.449979 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:09:59.449979 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:09:59.449979 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:59.454146 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 527/1050] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:09:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:59.455396 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ff40ae-2ced-445a-9882-ab89ca2defc0 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:59.562095 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ff40ae-2ced-445a-9882-ab89ca2defc0 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:59.576754 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:59.599154 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f802a94d-f9e4-4575-ad73-65c1d958457e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:59.599821 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f802a94d-f9e4-4575-ad73-65c1d958457e None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:59.600103 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f802a94d-f9e4-4575-ad73-65c1d958457e None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:59.600377 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f802a94d-f9e4-4575-ad73-65c1d958457e None admin] PATH_INFO: `/v3/domains` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:59.601092 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f802a94d-f9e4-4575-ad73-65c1d958457e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:59.601396 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f802a94d-f9e4-4575-ad73-65c1d958457e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:59.602804 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f802a94d-f9e4-4575-ad73-65c1d958457e None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:59.619565 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 524/1051] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 16:09:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:09:59.621040 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056ad1ea-ddc4-4e08-a8a8-eb7b55bd160c None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:59.724565 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056ad1ea-ddc4-4e08-a8a8-eb7b55bd160c None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:59.731027 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ac536-7ddc-4230-a7da-34ca6ae03b8a None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:59.731326 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ac536-7ddc-4230-a7da-34ca6ae03b8a None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:59.731617 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ac536-7ddc-4230-a7da-34ca6ae03b8a None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:59.732987 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 525/1052] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:09:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:09:59.738564 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906f82af-f855-4978-9d16-0638ed9c5153 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:59.738869 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906f82af-f855-4978-9d16-0638ed9c5153 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:59.739147 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906f82af-f855-4978-9d16-0638ed9c5153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:59.757084 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-906f82af-f855-4978-9d16-0638ed9c5153 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:09:59.758333 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-906f82af-f855-4978-9d16-0638ed9c5153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:09:59.761347 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8158f95-9360-457f-9f05-9ec832753b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:59.762145 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8158f95-9360-457f-9f05-9ec832753b4a None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:59.762460 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8158f95-9360-457f-9f05-9ec832753b4a None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:59.762738 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8158f95-9360-457f-9f05-9ec832753b4a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:59.770399 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8158f95-9360-457f-9f05-9ec832753b4a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:59.771835 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8158f95-9360-457f-9f05-9ec832753b4a None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:59.786286 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-e8158f95-9360-457f-9f05-9ec832753b4a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 16:09:59.786286 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:09:59.786286 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:09:59.786286 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:09:59.786286 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:09:59.786286 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:09:59.786286 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:09:59.786286 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:09:59.786286 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:09:59.786286 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:09:59.786286 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:09:59.786286 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:09:59.786286 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 16:09:59.786286 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 16:09:59.786286 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 16:09:59.786286 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 16:09:59.787314 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:09:59.787314 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:09:59.787314 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 16:09:59.787314 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:09:59.787314 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 16:09:59.787314 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:09:59.787314 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:09:59.787314 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:09:59.787314 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:09:59.787314 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:09:59.787314 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:09:59.787314 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:09:59.787314 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:09:59.787314 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:09:59.787314 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:09:59.787314 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:09:59.787314 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:09:59.787314 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:09:59.788271 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:09:59.788271 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:09:59.788271 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 16:09:59.788271 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 16:09:59.788271 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 16:09:59.788271 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 16:09:59.788271 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 16:09:59.788271 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 16:09:59.788271 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 16:09:59.788271 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:09:59.788271 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 528/1053] 10.222.0.62 () {56 vars in 1093 bytes} [Fri May 27 16:09:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:09:59.792965 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8158f95-9360-457f-9f05-9ec832753b4a None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:59.832255 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:09:59.835863 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 526/1054] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:09:59 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:09:59.861502 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906f82af-f855-4978-9d16-0638ed9c5153 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:59.902144 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8158f95-9360-457f-9f05-9ec832753b4a None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:59.944420 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04928d2a-d5e0-4b0b-b0ab-03ede4d22112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:09:59.945112 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04928d2a-d5e0-4b0b-b0ab-03ede4d22112 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:09:59.945397 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04928d2a-d5e0-4b0b-b0ab-03ede4d22112 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:09:59.945672 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04928d2a-d5e0-4b0b-b0ab-03ede4d22112 None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:09:59.946579 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04928d2a-d5e0-4b0b-b0ab-03ede4d22112 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:09:59.946860 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04928d2a-d5e0-4b0b-b0ab-03ede4d22112 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:09:59.948291 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04928d2a-d5e0-4b0b-b0ab-03ede4d22112 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:09:59.970415 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 529/1055] 10.222.0.62 () {56 vars in 1133 bytes} [Fri May 27 16:09:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:09:59.973199 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04928d2a-d5e0-4b0b-b0ab-03ede4d22112 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:09:59.975428 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906f82af-f855-4978-9d16-0638ed9c5153 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:09:59.977105 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:00.011412 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30da387e-57da-4a9d-b8bc-27694e1b8afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:00.012289 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da387e-57da-4a9d-b8bc-27694e1b8afb None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:00.012531 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da387e-57da-4a9d-b8bc-27694e1b8afb None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:00.012809 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da387e-57da-4a9d-b8bc-27694e1b8afb None admin] PATH_INFO: `/v3/services/image` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:00.013528 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30da387e-57da-4a9d-b8bc-27694e1b8afb None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:00.014972 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30da387e-57da-4a9d-b8bc-27694e1b8afb None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:00.027087 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-30da387e-57da-4a9d-b8bc-27694e1b8afb None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 27 16:10:00.027087 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:10:00.027087 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 16:10:00.027087 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 16:10:00.027087 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 16:10:00.027087 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 16:10:00.027087 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 16:10:00.027087 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:10:00.027087 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 27 16:10:00.027087 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:10:00.027087 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 16:10:00.027087 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:10:00.027087 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:10:00.027087 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:10:00.027087 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:10:00.027087 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:10:00.027087 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:10:00.028093 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:10:00.028093 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:10:00.028093 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:10:00.028093 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:10:00.028093 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:10:00.028093 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:10:00.028093 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 16:10:00.028093 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 16:10:00.028093 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 16:10:00.028093 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 16:10:00.028093 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:10:00.028093 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:10:00.028093 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:10:00.028093 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:10:00.028093 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:10:00.028093 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:10:00.028945 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:10:00.028945 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:10:00.028945 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:10:00.028945 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:10:00.028945 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:10:00.028945 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:10:00.028945 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:10:00.028945 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:10:00.028945 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:10:00.028945 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:10:00.028945 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 16:10:00.028945 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:10:00.028945 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 27 16:10:00.028945 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:10:00.028945 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 527/1056] 10.222.0.62 () {56 vars in 1105 bytes} [Fri May 27 16:09:59 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:10:00.034140 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30da387e-57da-4a9d-b8bc-27694e1b8afb None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:00.075493 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:00.083177 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04928d2a-d5e0-4b0b-b0ab-03ede4d22112 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:00.118029 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2defe8f-a982-4577-ad79-f5a0c4435457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:00.118865 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2defe8f-a982-4577-ad79-f5a0c4435457 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:00.119156 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2defe8f-a982-4577-ad79-f5a0c4435457 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:00.119434 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2defe8f-a982-4577-ad79-f5a0c4435457 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:00.129412 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2defe8f-a982-4577-ad79-f5a0c4435457 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:00.130890 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2defe8f-a982-4577-ad79-f5a0c4435457 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:00.137812 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30da387e-57da-4a9d-b8bc-27694e1b8afb None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:00.148497 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-d2defe8f-a982-4577-ad79-f5a0c4435457 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:10:00.148497 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:10:00.148497 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:10:00.148497 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:10:00.148497 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:10:00.148497 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:10:00.148497 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:10:00.148497 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:10:00.148497 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:10:00.148497 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:10:00.148497 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:10:00.148497 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:10:00.148497 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:10:00.148497 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:10:00.148497 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:10:00.149449 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:10:00.149449 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:10:00.149449 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:10:00.149449 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:10:00.149449 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:10:00.149449 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:10:00.149449 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:10:00.149449 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:10:00.149449 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:10:00.149449 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:10:00.149449 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:10:00.149449 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:10:00.149449 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:10:00.149449 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:10:00.149449 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:10:00.149449 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:10:00.149449 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:10:00.150539 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:10:00.150539 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:10:00.150539 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:10:00.150539 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:10:00.150539 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 530/1057] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:09:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:10:00.152396 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388f9c7-b613-43f9-84d8-4dd92ed8b8b5 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:00.152685 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388f9c7-b613-43f9-84d8-4dd92ed8b8b5 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:00.152963 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388f9c7-b613-43f9-84d8-4dd92ed8b8b5 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:00.154357 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 531/1058] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:10:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:10:00.155104 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388f9c7-b613-43f9-84d8-4dd92ed8b8b5 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:00.173498 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e99d59-cdda-48a9-81a0-a95bfc921ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:00.174546 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e99d59-cdda-48a9-81a0-a95bfc921ce3 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:00.174833 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e99d59-cdda-48a9-81a0-a95bfc921ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:00.175115 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e99d59-cdda-48a9-81a0-a95bfc921ce3 None admin] PATH_INFO: `/v3/services` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:00.175870 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e99d59-cdda-48a9-81a0-a95bfc921ce3 None admin] RBAC: Adding query filter params (name=image) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:10:00.176183 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e99d59-cdda-48a9-81a0-a95bfc921ce3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:00.177555 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e99d59-cdda-48a9-81a0-a95bfc921ce3 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:00.182381 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 528/1059] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:10:00 2022] GET /identity/v3/services?name=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:10:00.187523 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891df7ff-c4ac-49c3-8289-a4d026aca0df None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:00.188289 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891df7ff-c4ac-49c3-8289-a4d026aca0df None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:00.188289 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891df7ff-c4ac-49c3-8289-a4d026aca0df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:00.203972 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-891df7ff-c4ac-49c3-8289-a4d026aca0df None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:10:00.205163 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-891df7ff-c4ac-49c3-8289-a4d026aca0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:10:00.229188 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:00.257375 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388f9c7-b613-43f9-84d8-4dd92ed8b8b5 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:00.270381 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 529/1060] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:10:00 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:10:00.271211 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891df7ff-c4ac-49c3-8289-a4d026aca0df None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:00.294661 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed1c5cd-a94d-47ab-a4d7-0d525710306c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:00.295328 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed1c5cd-a94d-47ab-a4d7-0d525710306c None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:00.295614 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed1c5cd-a94d-47ab-a4d7-0d525710306c None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:00.295893 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed1c5cd-a94d-47ab-a4d7-0d525710306c None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:00.296615 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed1c5cd-a94d-47ab-a4d7-0d525710306c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:10:00.296932 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed1c5cd-a94d-47ab-a4d7-0d525710306c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:00.298360 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed1c5cd-a94d-47ab-a4d7-0d525710306c None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:00.315281 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 532/1061] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 16:10:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:10:00.315281 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed1c5cd-a94d-47ab-a4d7-0d525710306c None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:00.322886 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:00.378272 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891df7ff-c4ac-49c3-8289-a4d026aca0df None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:00.413643 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1178aa-0095-488e-a98c-4110631a1bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:00.414346 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1178aa-0095-488e-a98c-4110631a1bdb None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:00.414775 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1178aa-0095-488e-a98c-4110631a1bdb None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:00.415055 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1178aa-0095-488e-a98c-4110631a1bdb None admin] PATH_INFO: `/v3/services` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:00.415273 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed1c5cd-a94d-47ab-a4d7-0d525710306c None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:00.415759 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1178aa-0095-488e-a98c-4110631a1bdb None admin] RBAC: Adding query filter params (type=image) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:10:00.416066 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1178aa-0095-488e-a98c-4110631a1bdb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:00.417433 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1178aa-0095-488e-a98c-4110631a1bdb None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:00.422147 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 530/1062] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:10:00 2022] GET /identity/v3/services?type=image => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:10:00.422961 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1178aa-0095-488e-a98c-4110631a1bdb None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:00.449911 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf952a55-f25e-4238-8cd9-3fdeb64a9411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:00.450731 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf952a55-f25e-4238-8cd9-3fdeb64a9411 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:00.451017 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf952a55-f25e-4238-8cd9-3fdeb64a9411 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:00.451293 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf952a55-f25e-4238-8cd9-3fdeb64a9411 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:00.452207 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:00.461679 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf952a55-f25e-4238-8cd9-3fdeb64a9411 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:10:00.469263 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-bf952a55-f25e-4238-8cd9-3fdeb64a9411 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:10:00.469263 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:10:00.469263 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:10:00.469263 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:10:00.469263 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:10:00.469263 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:10:00.469263 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:10:00.469263 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:10:00.469263 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:10:00.469263 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:10:00.469263 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:10:00.469263 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:10:00.469263 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:10:00.469263 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:10:00.469263 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:10:00.469263 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:10:00.470202 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:10:00.470202 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:10:00.470202 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:10:00.470202 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:10:00.470202 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:10:00.470202 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:10:00.470202 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:10:00.470202 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:10:00.470202 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:10:00.470202 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:10:00.470202 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:10:00.470202 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:10:00.470202 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:10:00.470202 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:10:00.470202 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:10:00.470202 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:10:00.471197 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:10:00.471197 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:10:00.471197 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:10:00.471197 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:10:00.471197 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:10:00.471197 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:10:00.471197 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:10:00.471197 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:10:00.471197 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:10:00.471197 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:10:00.471197 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:10:00.471197 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:10:00.471197 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 533/1063] 10.222.0.62 () {56 vars in 1096 bytes} [Fri May 27 16:10:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:10:00.471197 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf952a55-f25e-4238-8cd9-3fdeb64a9411 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:00.532523 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1178aa-0095-488e-a98c-4110631a1bdb None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:00.534172 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:00.565325 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b277afe-73d3-49f5-bed1-c26f464606ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:00.566695 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b277afe-73d3-49f5-bed1-c26f464606ed None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:00.566979 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b277afe-73d3-49f5-bed1-c26f464606ed None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:00.567251 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b277afe-73d3-49f5-bed1-c26f464606ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:00.568933 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf952a55-f25e-4238-8cd9-3fdeb64a9411 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:00.573964 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b277afe-73d3-49f5-bed1-c26f464606ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:00.575431 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b277afe-73d3-49f5-bed1-c26f464606ed None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:00.589789 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-3b277afe-73d3-49f5-bed1-c26f464606ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:10:00.589789 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:10:00.589789 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:10:00.589789 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:10:00.589789 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:10:00.589789 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:10:00.589789 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:10:00.589789 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:10:00.589789 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:10:00.589789 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:10:00.589789 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:10:00.589789 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:10:00.589789 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 16:10:00.589789 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 16:10:00.589789 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 16:10:00.590714 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 16:10:00.590714 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:10:00.590714 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:10:00.590714 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:10:00.590714 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:10:00.590714 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:10:00.590714 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:10:00.590714 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:10:00.590714 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:10:00.590714 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:10:00.590714 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:10:00.590714 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:10:00.590714 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:10:00.590714 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:10:00.590714 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:10:00.590714 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:10:00.590714 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:10:00.591615 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 16:10:00.591615 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 16:10:00.591615 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 16:10:00.591615 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 16:10:00.591615 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 16:10:00.591615 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 16:10:00.591615 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:10:00.591615 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:10:00.591615 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 531/1064] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 16:10:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:10:00.592151 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b277afe-73d3-49f5-bed1-c26f464606ed None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:00.607023 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1cf07-5473-44a0-bb34-d4d62470901f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:00.607681 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1cf07-5473-44a0-bb34-d4d62470901f None admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:00.607965 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1cf07-5473-44a0-bb34-d4d62470901f None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:00.608252 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1cf07-5473-44a0-bb34-d4d62470901f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:00.608992 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a1cf07-5473-44a0-bb34-d4d62470901f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:00.610414 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a1cf07-5473-44a0-bb34-d4d62470901f None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:00.675397 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:00.690496 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b277afe-73d3-49f5-bed1-c26f464606ed None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:00.723702 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a4fcab-7d7d-435a-b274-f90363c6218c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:00.724364 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4fcab-7d7d-435a-b274-f90363c6218c None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:00.724651 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4fcab-7d7d-435a-b274-f90363c6218c None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:00.724926 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4fcab-7d7d-435a-b274-f90363c6218c None admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:00.725684 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a4fcab-7d7d-435a-b274-f90363c6218c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:10:00.725992 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a4fcab-7d7d-435a-b274-f90363c6218c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:00.727394 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a4fcab-7d7d-435a-b274-f90363c6218c None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:00.735119 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 532/1065] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 16:10:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:10:00.735891 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a4fcab-7d7d-435a-b274-f90363c6218c None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:00.751399 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 534/1066] 10.222.0.62 () {60 vars in 1144 bytes} [Fri May 27 16:10:00 2022] POST /identity/v3/endpoints => generated 327 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:10:00.752208 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1cf07-5473-44a0-bb34-d4d62470901f None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:00.851046 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a4fcab-7d7d-435a-b274-f90363c6218c None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:00.897161 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1cf07-5473-44a0-bb34-d4d62470901f None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:00.901404 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5126239e-4148-4e9a-8865-571dc06b9193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:00.902117 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126239e-4148-4e9a-8865-571dc06b9193 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:00.902447 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126239e-4148-4e9a-8865-571dc06b9193 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:00.902735 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126239e-4148-4e9a-8865-571dc06b9193 None admin] PATH_INFO: `/v3/projects` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:00.903542 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5126239e-4148-4e9a-8865-571dc06b9193 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:10:00.903860 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5126239e-4148-4e9a-8865-571dc06b9193 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:00.905327 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5126239e-4148-4e9a-8865-571dc06b9193 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:00.918851 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:00.920936 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 533/1067] 10.222.0.62 () {56 vars in 1148 bytes} [Fri May 27 16:10:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:10:00.927567 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5126239e-4148-4e9a-8865-571dc06b9193 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:00.930519 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:00.938870 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401e5c31-71f2-4f77-9c1b-4fa5f569e2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:00.939764 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e5c31-71f2-4f77-9c1b-4fa5f569e2ca None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:00.940053 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e5c31-71f2-4f77-9c1b-4fa5f569e2ca None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:00.940337 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e5c31-71f2-4f77-9c1b-4fa5f569e2ca None admin] PATH_INFO: `/v3/users/c8df524e86574b8386a2fbdfc30a35b9` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:00.956476 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401e5c31-71f2-4f77-9c1b-4fa5f569e2ca None admin] RBAC: Authorizing `identity:get_user(user_id=c8df524e86574b8386a2fbdfc30a35b9)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:00.957967 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401e5c31-71f2-4f77-9c1b-4fa5f569e2ca None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:00.960015 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 535/1068] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 16:10:00 2022] GET /identity/v3/users/c8df524e86574b8386a2fbdfc30a35b9 => generated 285 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:10:00.965512 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401e5c31-71f2-4f77-9c1b-4fa5f569e2ca None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:01.048263 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5126239e-4148-4e9a-8865-571dc06b9193 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:01.074967 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401e5c31-71f2-4f77-9c1b-4fa5f569e2ca None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:01.085474 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5405bc-4f64-4467-8198-88897b71d196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:01.086405 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5405bc-4f64-4467-8198-88897b71d196 None admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:01.086692 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5405bc-4f64-4467-8198-88897b71d196 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:01.086974 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5405bc-4f64-4467-8198-88897b71d196 None admin] PATH_INFO: `/v3/projects/d48d95a12587479ca5714f6ebd60dd9f/users/cb13ad6d8b1e46029262556bff398796/roles/769bfee541f54e48ab47d4056838a1e5` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:01.089225 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5405bc-4f64-4467-8198-88897b71d196 None admin] RBAC: Authorizing `identity:create_grant(project_id=d48d95a12587479ca5714f6ebd60dd9f, user_id=cb13ad6d8b1e46029262556bff398796, role_id=769bfee541f54e48ab47d4056838a1e5)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:01.090695 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5405bc-4f64-4467-8198-88897b71d196 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:01.111795 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b1bad3-281a-474d-bf35-480c9b793ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:01.112379 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1bad3-281a-474d-bf35-480c9b793ab6 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:01.112669 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1bad3-281a-474d-bf35-480c9b793ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:01.113524 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1bad3-281a-474d-bf35-480c9b793ab6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:01.157121 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:01.169550 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 534/1069] 10.222.0.62 () {58 vars in 1439 bytes} [Fri May 27 16:10:00 2022] PUT /identity/v3/projects/d48d95a12587479ca5714f6ebd60dd9f/users/cb13ad6d8b1e46029262556bff398796/roles/769bfee541f54e48ab47d4056838a1e5 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:10:01.181899 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b1bad3-281a-474d-bf35-480c9b793ab6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:01.183423 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b1bad3-281a-474d-bf35-480c9b793ab6 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:01.306641 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 536/1070] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 16:10:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 27 16:10:01.313114 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5405bc-4f64-4467-8198-88897b71d196 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:01.390816 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:01.432449 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5405bc-4f64-4467-8198-88897b71d196 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:01.466550 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eaa13a-197d-4dbd-8c64-892b034c7228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:01.467413 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eaa13a-197d-4dbd-8c64-892b034c7228 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:01.467693 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eaa13a-197d-4dbd-8c64-892b034c7228 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:01.467966 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eaa13a-197d-4dbd-8c64-892b034c7228 None admin] PATH_INFO: `/v3/projects/3adaf3d476b94333a8412f119fa330ee` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:01.469143 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eaa13a-197d-4dbd-8c64-892b034c7228 None admin] RBAC: Authorizing `identity:get_project(project_id=3adaf3d476b94333a8412f119fa330ee)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:01.471064 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eaa13a-197d-4dbd-8c64-892b034c7228 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:01.478148 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 535/1071] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 16:10:01 2022] GET /identity/v3/projects/3adaf3d476b94333a8412f119fa330ee => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:10:01.488682 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b1bad3-281a-474d-bf35-480c9b793ab6 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:01.557834 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:01.580277 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b1bad3-281a-474d-bf35-480c9b793ab6 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:01.616143 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48966fbc-4f5e-421b-bc03-766f0282611e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:01.616814 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48966fbc-4f5e-421b-bc03-766f0282611e None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:01.617101 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48966fbc-4f5e-421b-bc03-766f0282611e None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:01.617387 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48966fbc-4f5e-421b-bc03-766f0282611e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:01.618590 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48966fbc-4f5e-421b-bc03-766f0282611e None admin] RBAC: Adding query filter params (role.id=e04fe3eb1f714d74901ac83e33ea8a16, scope.project.id=3adaf3d476b94333a8412f119fa330ee, user.id=c8df524e86574b8386a2fbdfc30a35b9) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:10:01.618899 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48966fbc-4f5e-421b-bc03-766f0282611e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:01.620330 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48966fbc-4f5e-421b-bc03-766f0282611e None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:01.634562 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 537/1072] 10.222.0.62 () {56 vars in 1374 bytes} [Fri May 27 16:10:01 2022] GET /identity/v3/role_assignments?user.id=c8df524e86574b8386a2fbdfc30a35b9&scope.project.id=3adaf3d476b94333a8412f119fa330ee&role.id=e04fe3eb1f714d74901ac83e33ea8a16 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:10:03.172931 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a15cbf6-51bf-4cff-99ad-fdb4ec0ff2d3 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:03.173435 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a15cbf6-51bf-4cff-99ad-fdb4ec0ff2d3 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:03.173435 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a15cbf6-51bf-4cff-99ad-fdb4ec0ff2d3 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:03.175107 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 536/1073] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:10:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:10:03.180212 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db174304-3697-4702-b9e7-e1fddc7b74b5 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:03.180614 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db174304-3697-4702-b9e7-e1fddc7b74b5 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:03.180785 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db174304-3697-4702-b9e7-e1fddc7b74b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:03.197782 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-db174304-3697-4702-b9e7-e1fddc7b74b5 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:10:03.199028 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-db174304-3697-4702-b9e7-e1fddc7b74b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:10:03.271051 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 538/1074] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:10:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:10:03.293374 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a15cbf6-51bf-4cff-99ad-fdb4ec0ff2d3 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:03.397016 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a15cbf6-51bf-4cff-99ad-fdb4ec0ff2d3 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:03.411362 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d2390a-0cf1-41a8-ac30-8a5b702a6268 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:03.411660 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d2390a-0cf1-41a8-ac30-8a5b702a6268 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:03.411926 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d2390a-0cf1-41a8-ac30-8a5b702a6268 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:03.413441 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 539/1075] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:10:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 16:10:03.418305 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e61a8b-3120-4852-b4ee-a18f939bb78d None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:03.418611 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e61a8b-3120-4852-b4ee-a18f939bb78d None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:03.418885 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e61a8b-3120-4852-b4ee-a18f939bb78d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:03.426636 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:03.432572 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc82102c-a185-4743-8d95-29036898018c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:03.433223 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc82102c-a185-4743-8d95-29036898018c None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:03.433506 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc82102c-a185-4743-8d95-29036898018c None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:03.433784 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc82102c-a185-4743-8d95-29036898018c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:03.436084 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-b5e61a8b-3120-4852-b4ee-a18f939bb78d None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:10:03.439906 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-b5e61a8b-3120-4852-b4ee-a18f939bb78d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:10:03.504919 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:03.506692 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc82102c-a185-4743-8d95-29036898018c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:03.508139 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc82102c-a185-4743-8d95-29036898018c None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:03.514613 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 540/1076] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:10:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 16:10:03.538835 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e61a8b-3120-4852-b4ee-a18f939bb78d None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:03.619315 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 537/1077] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 16:10:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 16:10:03.624973 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc82102c-a185-4743-8d95-29036898018c None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:03.659843 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e61a8b-3120-4852-b4ee-a18f939bb78d None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:03.660105 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:03.701591 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa63f6a-ed23-4fab-8d17-439a0a2580dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:03.702612 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa63f6a-ed23-4fab-8d17-439a0a2580dc None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:03.702900 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa63f6a-ed23-4fab-8d17-439a0a2580dc None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:03.703177 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa63f6a-ed23-4fab-8d17-439a0a2580dc None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:03.716447 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa63f6a-ed23-4fab-8d17-439a0a2580dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:10:03.724687 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-3fa63f6a-ed23-4fab-8d17-439a0a2580dc None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 16:10:03.724687 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:10:03.724687 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:10:03.724687 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:10:03.724687 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:10:03.724687 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:10:03.724687 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:10:03.724687 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:10:03.724687 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:10:03.724687 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:10:03.724687 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:10:03.724687 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:10:03.724687 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:10:03.724687 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:10:03.724687 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:10:03.724687 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:10:03.725806 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:10:03.725806 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:10:03.725806 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:10:03.725806 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:10:03.725806 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:10:03.725806 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:10:03.725806 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:10:03.725806 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:10:03.725806 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:10:03.725806 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:10:03.725806 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:10:03.725806 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:10:03.725806 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:10:03.725806 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:10:03.725806 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:10:03.725806 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:10:03.727244 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:10:03.727244 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:10:03.727244 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:10:03.727244 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:10:03.727244 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:10:03.727244 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:10:03.727244 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:10:03.727244 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:10:03.727244 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:10:03.727244 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:10:03.727244 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 16:10:03.727244 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:10:03.727244 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 541/1078] 10.222.0.62 () {56 vars in 1120 bytes} [Fri May 27 16:10:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:10:03.731815 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa63f6a-ed23-4fab-8d17-439a0a2580dc None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:03.738714 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc82102c-a185-4743-8d95-29036898018c None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:03.776039 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83530ef-0cb2-48e9-ad64-3273e8b8b742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:03.777144 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83530ef-0cb2-48e9-ad64-3273e8b8b742 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:03.777763 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83530ef-0cb2-48e9-ad64-3273e8b8b742 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:03.778179 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83530ef-0cb2-48e9-ad64-3273e8b8b742 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:03.789363 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83530ef-0cb2-48e9-ad64-3273e8b8b742 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:03.791587 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83530ef-0cb2-48e9-ad64-3273e8b8b742 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:03.793553 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:03.812469 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-e83530ef-0cb2-48e9-ad64-3273e8b8b742 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:10:03.812469 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:10:03.812469 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:10:03.812469 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:10:03.812469 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:10:03.812469 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:10:03.812469 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:10:03.812469 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:10:03.812469 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:10:03.812469 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:10:03.812469 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:10:03.812469 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:10:03.812469 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:10:03.812469 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:10:03.812469 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:10:03.813818 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:10:03.813818 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:10:03.813818 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:10:03.813818 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:10:03.813818 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:10:03.813818 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:10:03.813818 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:10:03.813818 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:10:03.813818 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:10:03.813818 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:10:03.813818 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:10:03.813818 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:10:03.813818 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:10:03.813818 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:10:03.813818 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:10:03.813818 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:10:03.813818 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:10:03.815103 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:10:03.815103 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:10:03.815103 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:10:03.815103 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:10:03.815103 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 538/1079] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:10:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:10:03.820111 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83530ef-0cb2-48e9-ad64-3273e8b8b742 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:03.839567 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa63f6a-ed23-4fab-8d17-439a0a2580dc None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:03.879685 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8485091e-1f80-4cef-8901-d05f31b07587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:03.880353 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485091e-1f80-4cef-8901-d05f31b07587 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:03.880643 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485091e-1f80-4cef-8901-d05f31b07587 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:03.880919 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485091e-1f80-4cef-8901-d05f31b07587 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:03.881656 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8485091e-1f80-4cef-8901-d05f31b07587 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:10:03.881962 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8485091e-1f80-4cef-8901-d05f31b07587 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:03.883490 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8485091e-1f80-4cef-8901-d05f31b07587 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:03.891513 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 542/1080] 10.222.0.62 () {56 vars in 1115 bytes} [Fri May 27 16:10:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:10:03.892564 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc214391-8d23-4d89-8818-88b4ad85e5a5 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:03.892848 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc214391-8d23-4d89-8818-88b4ad85e5a5 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:03.893120 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc214391-8d23-4d89-8818-88b4ad85e5a5 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:03.894595 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 543/1081] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:10:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:10:03.897205 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc214391-8d23-4d89-8818-88b4ad85e5a5 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:03.912560 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:03.930592 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83530ef-0cb2-48e9-ad64-3273e8b8b742 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:03.965252 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a031d2a-6cba-4925-b213-c9d396f7fc7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:03.965831 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a031d2a-6cba-4925-b213-c9d396f7fc7b None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:03.966113 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a031d2a-6cba-4925-b213-c9d396f7fc7b None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:03.966424 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a031d2a-6cba-4925-b213-c9d396f7fc7b None admin] PATH_INFO: `/v3/domains` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:03.967140 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a031d2a-6cba-4925-b213-c9d396f7fc7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:10:03.967445 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a031d2a-6cba-4925-b213-c9d396f7fc7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:03.968799 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a031d2a-6cba-4925-b213-c9d396f7fc7b None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:03.979958 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 539/1082] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 16:10:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:10:03.981169 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b888786c-7762-4a15-9925-5051d09a357d None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:03.981465 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b888786c-7762-4a15-9925-5051d09a357d None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:03.981757 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b888786c-7762-4a15-9925-5051d09a357d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:04.000121 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-b888786c-7762-4a15-9925-5051d09a357d None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:10:04.000484 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc214391-8d23-4d89-8818-88b4ad85e5a5 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:04.001352 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-b888786c-7762-4a15-9925-5051d09a357d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:10:04.027433 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:04.039772 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed6c9ec-f4da-4ff6-921d-e43c5afc459b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:04.040739 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6c9ec-f4da-4ff6-921d-e43c5afc459b None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:04.041243 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6c9ec-f4da-4ff6-921d-e43c5afc459b None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:04.041524 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6c9ec-f4da-4ff6-921d-e43c5afc459b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:04.054716 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed6c9ec-f4da-4ff6-921d-e43c5afc459b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:04.056319 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed6c9ec-f4da-4ff6-921d-e43c5afc459b None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:04.076608 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-bed6c9ec-f4da-4ff6-921d-e43c5afc459b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:10:04.076608 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:10:04.076608 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:10:04.076608 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:10:04.076608 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:10:04.076608 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:10:04.076608 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:10:04.076608 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:10:04.076608 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:10:04.076608 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:10:04.076608 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:10:04.076608 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:10:04.076608 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:10:04.076608 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:10:04.076608 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:10:04.077636 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:10:04.077636 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:10:04.077636 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:10:04.077636 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:10:04.077636 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:10:04.077636 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:10:04.077636 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:10:04.077636 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:10:04.077636 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:10:04.077636 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:10:04.077636 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:10:04.077636 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:10:04.077636 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:10:04.077636 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:10:04.077636 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:10:04.077636 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:10:04.077636 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:10:04.078602 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:10:04.078602 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:10:04.078602 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:10:04.078602 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:10:04.082476 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 544/1083] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:10:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:10:04.083960 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed6c9ec-f4da-4ff6-921d-e43c5afc459b None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:04.084378 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 540/1084] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:10:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:10:04.107216 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b888786c-7762-4a15-9925-5051d09a357d None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:04.185157 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:04.200664 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed6c9ec-f4da-4ff6-921d-e43c5afc459b None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:04.219410 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b888786c-7762-4a15-9925-5051d09a357d None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:04.243499 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7467f8c-0374-4fd8-80ee-0339bef23776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:04.245253 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7467f8c-0374-4fd8-80ee-0339bef23776 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:04.245253 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7467f8c-0374-4fd8-80ee-0339bef23776 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:04.245253 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7467f8c-0374-4fd8-80ee-0339bef23776 None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:04.245509 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7467f8c-0374-4fd8-80ee-0339bef23776 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:10:04.245739 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7467f8c-0374-4fd8-80ee-0339bef23776 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:04.247210 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7467f8c-0374-4fd8-80ee-0339bef23776 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:04.255886 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f2eb8b-c134-4f17-8b24-99755b6f7c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:04.256690 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2eb8b-c134-4f17-8b24-99755b6f7c9f None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:04.256978 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2eb8b-c134-4f17-8b24-99755b6f7c9f None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:04.257254 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2eb8b-c134-4f17-8b24-99755b6f7c9f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:04.261849 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 545/1085] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 16:10:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:10:04.267486 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7467f8c-0374-4fd8-80ee-0339bef23776 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:04.272473 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f2eb8b-c134-4f17-8b24-99755b6f7c9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:10:04.280239 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-c4f2eb8b-c134-4f17-8b24-99755b6f7c9f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:10:04.280239 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:10:04.280239 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:10:04.280239 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:10:04.280239 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:10:04.280239 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:10:04.280239 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:10:04.280239 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:10:04.280239 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:10:04.280239 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:10:04.280239 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:10:04.280239 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:10:04.280239 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:10:04.280239 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:10:04.280239 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:10:04.280239 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:10:04.281290 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:10:04.281290 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:10:04.281290 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:10:04.281290 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:10:04.281290 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:10:04.281290 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:10:04.281290 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:10:04.281290 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:10:04.281290 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:10:04.281290 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:10:04.281290 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:10:04.281290 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:10:04.281290 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:10:04.281290 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:10:04.281290 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:10:04.281290 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:10:04.282208 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:10:04.282208 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:10:04.282208 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:10:04.282208 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:10:04.282208 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:10:04.282208 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:10:04.282208 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:10:04.282208 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:10:04.282208 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:10:04.282208 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:10:04.282208 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:10:04.282208 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:10:04.286537 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 541/1086] 10.222.0.62 () {56 vars in 1096 bytes} [Fri May 27 16:10:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:10:04.288044 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f2eb8b-c134-4f17-8b24-99755b6f7c9f None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:04.311258 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:04.378152 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7467f8c-0374-4fd8-80ee-0339bef23776 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:04.393236 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f2eb8b-c134-4f17-8b24-99755b6f7c9f None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:04.413696 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a40c19-3abf-4fa2-8c28-98fa20ee9be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:04.416904 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a40c19-3abf-4fa2-8c28-98fa20ee9be5 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:04.416904 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a40c19-3abf-4fa2-8c28-98fa20ee9be5 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:04.416904 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a40c19-3abf-4fa2-8c28-98fa20ee9be5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:04.422123 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a40c19-3abf-4fa2-8c28-98fa20ee9be5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:04.422276 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:04.423869 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a40c19-3abf-4fa2-8c28-98fa20ee9be5 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:04.427532 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff280c0-e336-4875-abda-8116aa8821d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:04.428196 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff280c0-e336-4875-abda-8116aa8821d7 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:04.428486 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff280c0-e336-4875-abda-8116aa8821d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:04.428766 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff280c0-e336-4875-abda-8116aa8821d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:04.429513 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff280c0-e336-4875-abda-8116aa8821d7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:10:04.429825 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff280c0-e336-4875-abda-8116aa8821d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:04.431229 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff280c0-e336-4875-abda-8116aa8821d7 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:04.438188 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-99a40c19-3abf-4fa2-8c28-98fa20ee9be5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 16:10:04.438188 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:10:04.438188 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:10:04.438188 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:10:04.438188 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:10:04.438188 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:10:04.438188 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:10:04.438188 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:10:04.438188 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:10:04.438188 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:10:04.438188 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:10:04.438188 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:10:04.438188 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 16:10:04.438188 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 16:10:04.438188 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 16:10:04.438188 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 16:10:04.445701 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:10:04.445701 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:10:04.445701 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 16:10:04.445701 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:10:04.445701 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 16:10:04.445701 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:10:04.445701 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:10:04.445701 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:10:04.445701 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:10:04.445701 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:10:04.445701 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:10:04.445701 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:10:04.445701 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:10:04.445701 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:10:04.445701 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:10:04.445701 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:10:04.445701 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:10:04.445701 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:10:04.446715 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:10:04.446715 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:10:04.446715 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 16:10:04.446715 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 16:10:04.446715 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 16:10:04.446715 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 16:10:04.446715 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 16:10:04.446715 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 16:10:04.446715 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 16:10:04.446715 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:10:04.446715 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 546/1087] 10.222.0.62 () {56 vars in 1093 bytes} [Fri May 27 16:10:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:10:04.447346 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 542/1088] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 16:10:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:10:04.447346 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff280c0-e336-4875-abda-8116aa8821d7 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:04.447485 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a40c19-3abf-4fa2-8c28-98fa20ee9be5 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:04.540530 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:04.546816 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a40c19-3abf-4fa2-8c28-98fa20ee9be5 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:04.547783 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff280c0-e336-4875-abda-8116aa8821d7 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:04.581509 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ecb0a-2c77-411b-9799-e8fe438a1e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:04.582195 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ecb0a-2c77-411b-9799-e8fe438a1e4c None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:04.582516 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ecb0a-2c77-411b-9799-e8fe438a1e4c None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:04.582790 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ecb0a-2c77-411b-9799-e8fe438a1e4c None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:04.582978 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db12075-2a5f-47be-a421-5aaf833777c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:04.583615 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552ecb0a-2c77-411b-9799-e8fe438a1e4c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:10:04.583849 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db12075-2a5f-47be-a421-5aaf833777c7 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:04.583941 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552ecb0a-2c77-411b-9799-e8fe438a1e4c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:04.584135 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db12075-2a5f-47be-a421-5aaf833777c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:04.584414 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db12075-2a5f-47be-a421-5aaf833777c7 None admin] PATH_INFO: `/v3/users/c8df524e86574b8386a2fbdfc30a35b9` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:04.585341 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552ecb0a-2c77-411b-9799-e8fe438a1e4c None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:04.585610 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db12075-2a5f-47be-a421-5aaf833777c7 None admin] RBAC: Authorizing `identity:get_user(user_id=c8df524e86574b8386a2fbdfc30a35b9)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:04.587072 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db12075-2a5f-47be-a421-5aaf833777c7 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:04.588704 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 543/1089] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 16:10:04 2022] GET /identity/v3/users/c8df524e86574b8386a2fbdfc30a35b9 => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:10:04.594318 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db12075-2a5f-47be-a421-5aaf833777c7 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:04.602424 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 547/1090] 10.222.0.62 () {56 vars in 1133 bytes} [Fri May 27 16:10:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:10:04.607887 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ecb0a-2c77-411b-9799-e8fe438a1e4c None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:04.660759 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:04.701111 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db12075-2a5f-47be-a421-5aaf833777c7 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:04.708262 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ecb0a-2c77-411b-9799-e8fe438a1e4c None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:04.734012 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e50ae8-6135-469f-87f2-bfe15ff1a98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:04.734898 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e50ae8-6135-469f-87f2-bfe15ff1a98c None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:04.735185 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e50ae8-6135-469f-87f2-bfe15ff1a98c None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:04.735460 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e50ae8-6135-469f-87f2-bfe15ff1a98c None admin] PATH_INFO: `/v3/projects/3adaf3d476b94333a8412f119fa330ee` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:04.736639 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e50ae8-6135-469f-87f2-bfe15ff1a98c None admin] RBAC: Authorizing `identity:get_project(project_id=3adaf3d476b94333a8412f119fa330ee)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:04.738606 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e50ae8-6135-469f-87f2-bfe15ff1a98c None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:04.740291 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 544/1091] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 16:10:04 2022] GET /identity/v3/projects/3adaf3d476b94333a8412f119fa330ee => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:10:04.742154 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608f8cf-3cac-42a4-8b66-aa65bad1cb24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:04.742832 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608f8cf-3cac-42a4-8b66-aa65bad1cb24 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:04.743120 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608f8cf-3cac-42a4-8b66-aa65bad1cb24 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:04.743402 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608f8cf-3cac-42a4-8b66-aa65bad1cb24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:04.746186 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e50ae8-6135-469f-87f2-bfe15ff1a98c None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:04.765277 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:04.810400 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1608f8cf-3cac-42a4-8b66-aa65bad1cb24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:04.811779 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1608f8cf-3cac-42a4-8b66-aa65bad1cb24 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:04.846726 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e50ae8-6135-469f-87f2-bfe15ff1a98c None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:04.878553 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:04.884947 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864d6b16-6785-4fd8-accc-7544cc98000f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:04.886238 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864d6b16-6785-4fd8-accc-7544cc98000f None admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:04.886556 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864d6b16-6785-4fd8-accc-7544cc98000f None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:04.886841 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864d6b16-6785-4fd8-accc-7544cc98000f None admin] PATH_INFO: `/v3/projects/3adaf3d476b94333a8412f119fa330ee/users/c8df524e86574b8386a2fbdfc30a35b9/roles/e04fe3eb1f714d74901ac83e33ea8a16` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:04.889247 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864d6b16-6785-4fd8-accc-7544cc98000f None admin] RBAC: Authorizing `identity:create_grant(project_id=3adaf3d476b94333a8412f119fa330ee, user_id=c8df524e86574b8386a2fbdfc30a35b9, role_id=e04fe3eb1f714d74901ac83e33ea8a16)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:04.890733 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864d6b16-6785-4fd8-accc-7544cc98000f None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:04.910892 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 548/1092] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 16:10:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 27 16:10:04.916956 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608f8cf-3cac-42a4-8b66-aa65bad1cb24 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:04.968122 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:04.992234 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 545/1093] 10.222.0.62 () {58 vars in 1439 bytes} [Fri May 27 16:10:04 2022] PUT /identity/v3/projects/3adaf3d476b94333a8412f119fa330ee/users/c8df524e86574b8386a2fbdfc30a35b9/roles/e04fe3eb1f714d74901ac83e33ea8a16 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:10:05.015314 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608f8cf-3cac-42a4-8b66-aa65bad1cb24 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:05.053558 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7750cc86-fc2e-4308-a0ee-fac8c7b606d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:05.054409 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7750cc86-fc2e-4308-a0ee-fac8c7b606d4 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:05.054694 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7750cc86-fc2e-4308-a0ee-fac8c7b606d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:05.054969 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7750cc86-fc2e-4308-a0ee-fac8c7b606d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:05.066445 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7750cc86-fc2e-4308-a0ee-fac8c7b606d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:05.067852 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7750cc86-fc2e-4308-a0ee-fac8c7b606d4 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:05.086566 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-7750cc86-fc2e-4308-a0ee-fac8c7b606d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:10:05.086566 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:10:05.086566 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:10:05.086566 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:10:05.086566 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:10:05.086566 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:10:05.086566 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:10:05.086566 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:10:05.086566 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:10:05.086566 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:10:05.086566 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:10:05.086566 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:10:05.086566 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:10:05.086566 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:10:05.086566 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:10:05.087688 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:10:05.087688 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:10:05.087688 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:10:05.087688 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:10:05.087688 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:10:05.087688 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:10:05.087688 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:10:05.087688 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:10:05.087688 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:10:05.087688 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:10:05.087688 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:10:05.087688 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:10:05.087688 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:10:05.087688 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:10:05.087688 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:10:05.087688 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:10:05.087688 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:10:05.088774 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:10:05.088774 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:10:05.088774 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:10:05.088774 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:10:05.088774 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 549/1094] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:10:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:10:05.093796 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864d6b16-6785-4fd8-accc-7544cc98000f None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:05.200468 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864d6b16-6785-4fd8-accc-7544cc98000f None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:05.234008 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44040641-d095-4d2d-b3d8-2d0e1be51b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:05.234701 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44040641-d095-4d2d-b3d8-2d0e1be51b7f None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:05.235025 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44040641-d095-4d2d-b3d8-2d0e1be51b7f None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:05.235305 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44040641-d095-4d2d-b3d8-2d0e1be51b7f None admin] PATH_INFO: `/v3/domains` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:05.236048 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44040641-d095-4d2d-b3d8-2d0e1be51b7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:10:05.236355 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44040641-d095-4d2d-b3d8-2d0e1be51b7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:05.238371 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44040641-d095-4d2d-b3d8-2d0e1be51b7f None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:05.253903 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 546/1095] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 16:10:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:10:05.255193 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7750cc86-fc2e-4308-a0ee-fac8c7b606d4 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:05.357300 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7750cc86-fc2e-4308-a0ee-fac8c7b606d4 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:05.359708 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:05.391817 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a722fc-e718-4d14-b96f-7b1c15773c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:05.392614 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a722fc-e718-4d14-b96f-7b1c15773c11 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:05.392902 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a722fc-e718-4d14-b96f-7b1c15773c11 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:05.393182 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a722fc-e718-4d14-b96f-7b1c15773c11 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:05.400922 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a722fc-e718-4d14-b96f-7b1c15773c11 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:05.402393 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a722fc-e718-4d14-b96f-7b1c15773c11 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:05.416497 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-61a722fc-e718-4d14-b96f-7b1c15773c11 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:10:05.416497 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:10:05.416497 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:10:05.416497 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:10:05.416497 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:10:05.416497 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:10:05.416497 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:10:05.416497 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:10:05.416497 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:10:05.416497 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:10:05.416497 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:10:05.416497 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:10:05.416497 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 16:10:05.416497 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 16:10:05.416497 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 16:10:05.417414 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 16:10:05.417414 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:10:05.417414 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:10:05.417414 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:10:05.417414 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:10:05.417414 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:10:05.417414 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:10:05.417414 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:10:05.417414 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:10:05.417414 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:10:05.417414 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:10:05.417414 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:10:05.417414 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:10:05.417414 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:10:05.417414 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:10:05.417414 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:10:05.417414 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:10:05.418386 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 16:10:05.418386 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 16:10:05.418386 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 16:10:05.418386 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 16:10:05.418386 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 16:10:05.418386 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 16:10:05.418386 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:10:05.418386 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:10:05.422373 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 550/1096] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 16:10:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:10:05.423752 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44040641-d095-4d2d-b3d8-2d0e1be51b7f None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:05.473387 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:05.523743 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44040641-d095-4d2d-b3d8-2d0e1be51b7f None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:05.556989 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7585c5-378b-42c1-8c32-9f9b67799cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:05.557651 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7585c5-378b-42c1-8c32-9f9b67799cfd None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:05.557939 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7585c5-378b-42c1-8c32-9f9b67799cfd None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:05.558221 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7585c5-378b-42c1-8c32-9f9b67799cfd None admin] PATH_INFO: `/v3/projects` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:05.559037 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7585c5-378b-42c1-8c32-9f9b67799cfd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:10:05.559351 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7585c5-378b-42c1-8c32-9f9b67799cfd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:05.560782 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7585c5-378b-42c1-8c32-9f9b67799cfd None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:05.573178 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 547/1097] 10.222.0.62 () {56 vars in 1148 bytes} [Fri May 27 16:10:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:10:05.579445 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a722fc-e718-4d14-b96f-7b1c15773c11 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:05.681558 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a722fc-e718-4d14-b96f-7b1c15773c11 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:05.714447 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32177d3-51cb-46f6-b2b3-dc57c1e1b31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:05.715105 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32177d3-51cb-46f6-b2b3-dc57c1e1b31b None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:05.715390 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32177d3-51cb-46f6-b2b3-dc57c1e1b31b None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:05.715674 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32177d3-51cb-46f6-b2b3-dc57c1e1b31b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:05.716498 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32177d3-51cb-46f6-b2b3-dc57c1e1b31b None admin] RBAC: Adding query filter params (role.id=769bfee541f54e48ab47d4056838a1e5, scope.project.id=d48d95a12587479ca5714f6ebd60dd9f, user.id=cb13ad6d8b1e46029262556bff398796) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:10:05.716814 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32177d3-51cb-46f6-b2b3-dc57c1e1b31b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:05.718238 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32177d3-51cb-46f6-b2b3-dc57c1e1b31b None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:05.724491 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 551/1098] 10.222.0.62 () {56 vars in 1374 bytes} [Fri May 27 16:10:05 2022] GET /identity/v3/role_assignments?user.id=cb13ad6d8b1e46029262556bff398796&scope.project.id=d48d95a12587479ca5714f6ebd60dd9f&role.id=769bfee541f54e48ab47d4056838a1e5 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:10:07.185516 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f86c4-248b-47d3-91b8-455eaeaaeee6 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:07.186024 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f86c4-248b-47d3-91b8-455eaeaaeee6 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:07.186024 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f86c4-248b-47d3-91b8-455eaeaaeee6 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:07.187408 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 548/1099] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:10:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:10:07.192791 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23231744-59c0-4f65-aaa0-f99d1e5320cd None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:07.193168 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23231744-59c0-4f65-aaa0-f99d1e5320cd None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:07.193362 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23231744-59c0-4f65-aaa0-f99d1e5320cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:07.210809 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-23231744-59c0-4f65-aaa0-f99d1e5320cd None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:10:07.211996 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-23231744-59c0-4f65-aaa0-f99d1e5320cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:10:07.234494 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:07.276680 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 552/1100] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:10:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:10:07.300903 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0f86c4-248b-47d3-91b8-455eaeaaeee6 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:07.398485 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0f86c4-248b-47d3-91b8-455eaeaaeee6 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:07.408811 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:07.432280 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee1915-368b-474c-b9af-8aeca90b9a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:07.433063 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee1915-368b-474c-b9af-8aeca90b9a82 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:07.433349 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee1915-368b-474c-b9af-8aeca90b9a82 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:07.433625 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee1915-368b-474c-b9af-8aeca90b9a82 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:07.443839 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ee1915-368b-474c-b9af-8aeca90b9a82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:10:07.451849 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-b8ee1915-368b-474c-b9af-8aeca90b9a82 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:10:07.451849 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:10:07.451849 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:10:07.451849 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:10:07.451849 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:10:07.451849 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:10:07.451849 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:10:07.451849 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:10:07.451849 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:10:07.451849 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:10:07.451849 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:10:07.451849 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:10:07.451849 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:10:07.451849 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:10:07.451849 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:10:07.451849 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:10:07.452941 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:10:07.452941 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:10:07.452941 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:10:07.452941 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:10:07.452941 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:10:07.452941 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:10:07.452941 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:10:07.452941 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:10:07.452941 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:10:07.452941 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:10:07.452941 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:10:07.452941 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:10:07.452941 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:10:07.452941 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:10:07.452941 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:10:07.452941 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:10:07.453805 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:10:07.453805 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:10:07.453805 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:10:07.453805 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:10:07.453805 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:10:07.453805 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:10:07.453805 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:10:07.453805 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:10:07.453805 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:10:07.453805 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:10:07.453805 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:10:07.453805 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:10:07.453805 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 549/1101] 10.222.0.62 () {56 vars in 1096 bytes} [Fri May 27 16:10:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:10:07.459069 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23231744-59c0-4f65-aaa0-f99d1e5320cd None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:07.555171 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23231744-59c0-4f65-aaa0-f99d1e5320cd None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:07.587269 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fce333-9c0e-4bd7-9c58-07af0f5c3ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:07.587913 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fce333-9c0e-4bd7-9c58-07af0f5c3ebf None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:07.588194 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fce333-9c0e-4bd7-9c58-07af0f5c3ebf None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:07.588467 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fce333-9c0e-4bd7-9c58-07af0f5c3ebf None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:07.589201 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fce333-9c0e-4bd7-9c58-07af0f5c3ebf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:10:07.589507 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fce333-9c0e-4bd7-9c58-07af0f5c3ebf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:07.590893 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fce333-9c0e-4bd7-9c58-07af0f5c3ebf None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:07.599206 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 553/1102] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 16:10:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:10:07.605062 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee1915-368b-474c-b9af-8aeca90b9a82 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:07.714339 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee1915-368b-474c-b9af-8aeca90b9a82 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:07.746551 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3143b184-7e62-48fd-89a2-e433bfdda5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:07.747417 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3143b184-7e62-48fd-89a2-e433bfdda5f0 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:07.747699 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3143b184-7e62-48fd-89a2-e433bfdda5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:07.747976 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3143b184-7e62-48fd-89a2-e433bfdda5f0 None admin] PATH_INFO: `/v3/users/c8df524e86574b8386a2fbdfc30a35b9` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:07.749148 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3143b184-7e62-48fd-89a2-e433bfdda5f0 None admin] RBAC: Authorizing `identity:get_user(user_id=c8df524e86574b8386a2fbdfc30a35b9)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:07.750612 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3143b184-7e62-48fd-89a2-e433bfdda5f0 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:07.752252 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 550/1103] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 16:10:07 2022] GET /identity/v3/users/c8df524e86574b8386a2fbdfc30a35b9 => generated 285 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:10:07.758699 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fce333-9c0e-4bd7-9c58-07af0f5c3ebf None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:07.780029 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:07.858165 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fce333-9c0e-4bd7-9c58-07af0f5c3ebf None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:07.891928 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da13212e-4fa5-408e-b7f2-8fe1a6d95213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:07.894867 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da13212e-4fa5-408e-b7f2-8fe1a6d95213 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:07.894867 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da13212e-4fa5-408e-b7f2-8fe1a6d95213 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:07.894867 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da13212e-4fa5-408e-b7f2-8fe1a6d95213 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:07.958809 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da13212e-4fa5-408e-b7f2-8fe1a6d95213 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:07.960242 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da13212e-4fa5-408e-b7f2-8fe1a6d95213 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:07.979547 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:08.053998 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 554/1104] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 16:10:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 16:10:08.059874 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3143b184-7e62-48fd-89a2-e433bfdda5f0 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:08.099358 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:08.157241 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3143b184-7e62-48fd-89a2-e433bfdda5f0 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:08.190032 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc2f2f8-3f2d-4e55-a3d0-d262a68bcc22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:08.191505 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc2f2f8-3f2d-4e55-a3d0-d262a68bcc22 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:08.191790 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc2f2f8-3f2d-4e55-a3d0-d262a68bcc22 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:08.192068 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc2f2f8-3f2d-4e55-a3d0-d262a68bcc22 None admin] PATH_INFO: `/v3/projects/3adaf3d476b94333a8412f119fa330ee` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:08.193246 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc2f2f8-3f2d-4e55-a3d0-d262a68bcc22 None admin] RBAC: Authorizing `identity:get_project(project_id=3adaf3d476b94333a8412f119fa330ee)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:08.194723 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc2f2f8-3f2d-4e55-a3d0-d262a68bcc22 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:08.196407 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 551/1105] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 16:10:08 2022] GET /identity/v3/projects/3adaf3d476b94333a8412f119fa330ee => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:10:08.202362 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da13212e-4fa5-408e-b7f2-8fe1a6d95213 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:08.297413 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da13212e-4fa5-408e-b7f2-8fe1a6d95213 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:08.317579 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:08.330682 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697aa54e-6082-4c30-8cc8-61995b55328c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:08.332422 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697aa54e-6082-4c30-8cc8-61995b55328c None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:08.332422 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697aa54e-6082-4c30-8cc8-61995b55328c None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:08.332422 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697aa54e-6082-4c30-8cc8-61995b55328c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:08.332680 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697aa54e-6082-4c30-8cc8-61995b55328c None admin] RBAC: Adding query filter params (role.id=e04fe3eb1f714d74901ac83e33ea8a16, scope.project.id=3adaf3d476b94333a8412f119fa330ee, user.id=c8df524e86574b8386a2fbdfc30a35b9) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:10:08.332962 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697aa54e-6082-4c30-8cc8-61995b55328c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:08.334389 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697aa54e-6082-4c30-8cc8-61995b55328c None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:08.339954 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 555/1106] 10.222.0.62 () {56 vars in 1374 bytes} [Fri May 27 16:10:08 2022] GET /identity/v3/role_assignments?user.id=c8df524e86574b8386a2fbdfc30a35b9&scope.project.id=3adaf3d476b94333a8412f119fa330ee&role.id=e04fe3eb1f714d74901ac83e33ea8a16 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:10:10.537883 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44fcce2-a77c-4b99-946f-147c8d4dd8ea None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:10.538460 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44fcce2-a77c-4b99-946f-147c8d4dd8ea None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:10.538460 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44fcce2-a77c-4b99-946f-147c8d4dd8ea None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:10.539827 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 552/1107] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:10:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:10:10.545189 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d11c05-3265-4efc-80fb-c6ba8e81e37c None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:10.545604 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d11c05-3265-4efc-80fb-c6ba8e81e37c None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:10.545748 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d11c05-3265-4efc-80fb-c6ba8e81e37c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:10.562217 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-e2d11c05-3265-4efc-80fb-c6ba8e81e37c None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:10:10.563403 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-e2d11c05-3265-4efc-80fb-c6ba8e81e37c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:10:10.626901 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 556/1108] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:10:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 16:10:10.652325 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44fcce2-a77c-4b99-946f-147c8d4dd8ea None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:10.757341 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44fcce2-a77c-4b99-946f-147c8d4dd8ea None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:10.764455 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:10.789991 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586d14b2-daea-41cf-bec2-9c28d7106960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:10.790753 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d14b2-daea-41cf-bec2-9c28d7106960 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:10.791037 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d14b2-daea-41cf-bec2-9c28d7106960 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:10.791315 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d14b2-daea-41cf-bec2-9c28d7106960 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:10.792480 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586d14b2-daea-41cf-bec2-9c28d7106960 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:10.793918 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586d14b2-daea-41cf-bec2-9c28d7106960 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:10.795679 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 553/1109] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:10:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:10:10.802147 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d11c05-3265-4efc-80fb-c6ba8e81e37c None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:10.897022 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d11c05-3265-4efc-80fb-c6ba8e81e37c None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:10.910912 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:10.930704 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd51cf54-209c-4c35-bb00-c60429f4fc3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:10.931361 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51cf54-209c-4c35-bb00-c60429f4fc3c None admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:10.931642 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51cf54-209c-4c35-bb00-c60429f4fc3c None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:10.931916 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51cf54-209c-4c35-bb00-c60429f4fc3c None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:10.932614 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd51cf54-209c-4c35-bb00-c60429f4fc3c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:10.934025 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd51cf54-209c-4c35-bb00-c60429f4fc3c None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:11.053122 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 557/1110] 10.222.0.62 () {60 vars in 1132 bytes} [Fri May 27 16:10:10 2022] POST /identity/v3/users => generated 286 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:10:13.280293 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350bd90-354e-4e6f-abfe-d8f62a4d7e25 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:13.280816 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350bd90-354e-4e6f-abfe-d8f62a4d7e25 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:13.280816 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350bd90-354e-4e6f-abfe-d8f62a4d7e25 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:13.282267 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 554/1111] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:10:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:10:13.288384 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00591b4e-c4b8-49bd-887d-4f12ab786591 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:13.288840 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00591b4e-c4b8-49bd-887d-4f12ab786591 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:13.288958 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00591b4e-c4b8-49bd-887d-4f12ab786591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:13.306454 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-00591b4e-c4b8-49bd-887d-4f12ab786591 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:10:13.307642 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-00591b4e-c4b8-49bd-887d-4f12ab786591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:10:13.371741 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 558/1112] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:10:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:10:13.394688 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1350bd90-354e-4e6f-abfe-d8f62a4d7e25 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:13.493018 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1350bd90-354e-4e6f-abfe-d8f62a4d7e25 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:13.525166 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088ff25b-82c7-41f7-a627-b9d0d0f48efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:13.526004 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ff25b-82c7-41f7-a627-b9d0d0f48efc None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:13.526305 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ff25b-82c7-41f7-a627-b9d0d0f48efc None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:13.526582 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ff25b-82c7-41f7-a627-b9d0d0f48efc None admin] PATH_INFO: `/v3/roles/404d2ea20e7c4842892e5001133f1b93` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:13.528019 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088ff25b-82c7-41f7-a627-b9d0d0f48efc None admin] RBAC: Authorizing `identity:get_role(role_id=404d2ea20e7c4842892e5001133f1b93)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:13.529366 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088ff25b-82c7-41f7-a627-b9d0d0f48efc None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:13.530783 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 555/1113] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 16:10:13 2022] GET /identity/v3/roles/404d2ea20e7c4842892e5001133f1b93 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:10:13.536997 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00591b4e-c4b8-49bd-887d-4f12ab786591 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:13.629686 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:13.632522 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00591b4e-c4b8-49bd-887d-4f12ab786591 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:13.668405 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76863309-f379-4b79-9357-84882ea8b221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:13.669267 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76863309-f379-4b79-9357-84882ea8b221 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:13.669543 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76863309-f379-4b79-9357-84882ea8b221 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:13.669813 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76863309-f379-4b79-9357-84882ea8b221 None admin] PATH_INFO: `/v3/users/bd0abd21b2f64a86bd7234feef9d501e` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:13.683227 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76863309-f379-4b79-9357-84882ea8b221 None admin] RBAC: Authorizing `identity:get_user(user_id=bd0abd21b2f64a86bd7234feef9d501e)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:13.684663 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76863309-f379-4b79-9357-84882ea8b221 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:13.686325 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 559/1114] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 16:10:13 2022] GET /identity/v3/users/bd0abd21b2f64a86bd7234feef9d501e => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:10:13.692701 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088ff25b-82c7-41f7-a627-b9d0d0f48efc None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:13.739080 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:13.792854 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088ff25b-82c7-41f7-a627-b9d0d0f48efc None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:13.826427 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5489a9ef-c793-4b4c-ac91-e6c6ea2baec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:13.827066 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5489a9ef-c793-4b4c-ac91-e6c6ea2baec6 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:13.827345 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5489a9ef-c793-4b4c-ac91-e6c6ea2baec6 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:13.827618 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5489a9ef-c793-4b4c-ac91-e6c6ea2baec6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:13.891876 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5489a9ef-c793-4b4c-ac91-e6c6ea2baec6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:13.893307 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5489a9ef-c793-4b4c-ac91-e6c6ea2baec6 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:13.933524 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:13.987922 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 556/1115] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 16:10:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 27 16:10:13.993823 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76863309-f379-4b79-9357-84882ea8b221 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:14.088838 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76863309-f379-4b79-9357-84882ea8b221 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:14.121399 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000cc43d-c584-4ed1-8e91-34f2890e8d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:14.122240 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000cc43d-c584-4ed1-8e91-34f2890e8d37 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:14.122544 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000cc43d-c584-4ed1-8e91-34f2890e8d37 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:14.122819 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000cc43d-c584-4ed1-8e91-34f2890e8d37 None admin] PATH_INFO: `/v3/projects/3adaf3d476b94333a8412f119fa330ee` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:14.123964 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000cc43d-c584-4ed1-8e91-34f2890e8d37 None admin] RBAC: Authorizing `identity:get_project(project_id=3adaf3d476b94333a8412f119fa330ee)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:14.125376 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000cc43d-c584-4ed1-8e91-34f2890e8d37 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:14.127061 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 560/1116] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 16:10:13 2022] GET /identity/v3/projects/3adaf3d476b94333a8412f119fa330ee => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:10:14.132870 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5489a9ef-c793-4b4c-ac91-e6c6ea2baec6 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:14.229568 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5489a9ef-c793-4b4c-ac91-e6c6ea2baec6 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:14.263075 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752aeb80-0566-4c95-9e22-826b234fe9d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:14.264099 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752aeb80-0566-4c95-9e22-826b234fe9d8 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:14.264390 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752aeb80-0566-4c95-9e22-826b234fe9d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:14.264672 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752aeb80-0566-4c95-9e22-826b234fe9d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:14.265506 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752aeb80-0566-4c95-9e22-826b234fe9d8 None admin] RBAC: Adding query filter params (role.id=404d2ea20e7c4842892e5001133f1b93, scope.project.id=3adaf3d476b94333a8412f119fa330ee, user.id=bd0abd21b2f64a86bd7234feef9d501e) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:10:14.265823 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752aeb80-0566-4c95-9e22-826b234fe9d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:14.267270 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752aeb80-0566-4c95-9e22-826b234fe9d8 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:14.273319 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 557/1117] 10.222.0.62 () {56 vars in 1374 bytes} [Fri May 27 16:10:14 2022] GET /identity/v3/role_assignments?user.id=bd0abd21b2f64a86bd7234feef9d501e&scope.project.id=3adaf3d476b94333a8412f119fa330ee&role.id=404d2ea20e7c4842892e5001133f1b93 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:10:16.461225 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd996013-e75b-455f-b0c0-8484cac7a036 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:16.461749 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd996013-e75b-455f-b0c0-8484cac7a036 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:16.461749 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd996013-e75b-455f-b0c0-8484cac7a036 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:16.463190 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 561/1118] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:10:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:10:16.468320 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3f619-b32d-4915-b333-59b59088dd75 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:16.468760 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3f619-b32d-4915-b333-59b59088dd75 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:16.468890 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3f619-b32d-4915-b333-59b59088dd75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:16.480037 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:16.485751 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-f9f3f619-b32d-4915-b333-59b59088dd75 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:10:16.487489 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-f9f3f619-b32d-4915-b333-59b59088dd75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:10:16.553647 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 558/1119] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:10:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:10:16.575924 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd996013-e75b-455f-b0c0-8484cac7a036 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:16.603286 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:16.674982 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd996013-e75b-455f-b0c0-8484cac7a036 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:16.707274 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639e2213-3ac6-48c5-88cf-0f7579948e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:16.708112 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639e2213-3ac6-48c5-88cf-0f7579948e93 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:16.708392 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639e2213-3ac6-48c5-88cf-0f7579948e93 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:16.708668 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639e2213-3ac6-48c5-88cf-0f7579948e93 None admin] PATH_INFO: `/v3/roles/404d2ea20e7c4842892e5001133f1b93` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:16.710106 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639e2213-3ac6-48c5-88cf-0f7579948e93 None admin] RBAC: Authorizing `identity:get_role(role_id=404d2ea20e7c4842892e5001133f1b93)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:16.711545 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639e2213-3ac6-48c5-88cf-0f7579948e93 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:16.712840 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 562/1120] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 16:10:16 2022] GET /identity/v3/roles/404d2ea20e7c4842892e5001133f1b93 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:10:16.718730 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f3f619-b32d-4915-b333-59b59088dd75 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:16.823432 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f3f619-b32d-4915-b333-59b59088dd75 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:16.856548 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06fa8c9-648d-4bc3-a355-37e2e0200b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:16.857412 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06fa8c9-648d-4bc3-a355-37e2e0200b4d None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:16.857693 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06fa8c9-648d-4bc3-a355-37e2e0200b4d None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:16.857963 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06fa8c9-648d-4bc3-a355-37e2e0200b4d None admin] PATH_INFO: `/v3/users/bd0abd21b2f64a86bd7234feef9d501e` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:16.859160 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06fa8c9-648d-4bc3-a355-37e2e0200b4d None admin] RBAC: Authorizing `identity:get_user(user_id=bd0abd21b2f64a86bd7234feef9d501e)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:16.860592 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06fa8c9-648d-4bc3-a355-37e2e0200b4d None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:16.862896 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 559/1121] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 16:10:16 2022] GET /identity/v3/users/bd0abd21b2f64a86bd7234feef9d501e => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:10:16.868566 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639e2213-3ac6-48c5-88cf-0f7579948e93 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:16.959362 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:16.965907 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639e2213-3ac6-48c5-88cf-0f7579948e93 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:16.999476 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506e7151-eb85-44b2-acaa-a52f97274b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:17.000323 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e7151-eb85-44b2-acaa-a52f97274b2a None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:17.000606 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e7151-eb85-44b2-acaa-a52f97274b2a None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:17.000880 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e7151-eb85-44b2-acaa-a52f97274b2a None admin] PATH_INFO: `/v3/projects/3adaf3d476b94333a8412f119fa330ee` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:17.002054 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506e7151-eb85-44b2-acaa-a52f97274b2a None admin] RBAC: Authorizing `identity:get_project(project_id=3adaf3d476b94333a8412f119fa330ee)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:17.003554 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506e7151-eb85-44b2-acaa-a52f97274b2a None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:17.005245 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 563/1122] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 16:10:16 2022] GET /identity/v3/projects/3adaf3d476b94333a8412f119fa330ee => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:10:17.011231 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06fa8c9-648d-4bc3-a355-37e2e0200b4d None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:17.014976 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:17.119586 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06fa8c9-648d-4bc3-a355-37e2e0200b4d None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:17.153103 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b876919e-dd0f-447f-8b44-061e5e9720db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:17.153983 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b876919e-dd0f-447f-8b44-061e5e9720db None admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:17.154289 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b876919e-dd0f-447f-8b44-061e5e9720db None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:17.154574 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b876919e-dd0f-447f-8b44-061e5e9720db None admin] PATH_INFO: `/v3/projects/3adaf3d476b94333a8412f119fa330ee/users/bd0abd21b2f64a86bd7234feef9d501e/roles/404d2ea20e7c4842892e5001133f1b93` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:17.156756 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b876919e-dd0f-447f-8b44-061e5e9720db None admin] RBAC: Authorizing `identity:create_grant(project_id=3adaf3d476b94333a8412f119fa330ee, user_id=bd0abd21b2f64a86bd7234feef9d501e, role_id=404d2ea20e7c4842892e5001133f1b93)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:17.158192 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b876919e-dd0f-447f-8b44-061e5e9720db None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:17.219983 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 560/1123] 10.222.0.62 () {58 vars in 1439 bytes} [Fri May 27 16:10:17 2022] PUT /identity/v3/projects/3adaf3d476b94333a8412f119fa330ee/users/bd0abd21b2f64a86bd7234feef9d501e/roles/404d2ea20e7c4842892e5001133f1b93 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:10:19.372469 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2594a25-1556-41d6-bf5e-74df434303ff None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:19.372987 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2594a25-1556-41d6-bf5e-74df434303ff None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:19.373082 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2594a25-1556-41d6-bf5e-74df434303ff None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:19.374460 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 564/1124] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:10:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:10:19.380300 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c78d5e-7624-43ae-ac4f-1bfb7d4eb6e0 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:19.380721 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c78d5e-7624-43ae-ac4f-1bfb7d4eb6e0 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:19.380863 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c78d5e-7624-43ae-ac4f-1bfb7d4eb6e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:19.397809 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-69c78d5e-7624-43ae-ac4f-1bfb7d4eb6e0 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:10:19.399315 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-69c78d5e-7624-43ae-ac4f-1bfb7d4eb6e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:10:19.455338 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:19.463887 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 561/1125] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:10:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:10:19.487604 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2594a25-1556-41d6-bf5e-74df434303ff None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:19.587490 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2594a25-1556-41d6-bf5e-74df434303ff None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:19.619916 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70e0ec1-00dd-4403-8056-5bcf14f20a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:19.620760 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e0ec1-00dd-4403-8056-5bcf14f20a64 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:19.621044 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e0ec1-00dd-4403-8056-5bcf14f20a64 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:19.621322 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e0ec1-00dd-4403-8056-5bcf14f20a64 None admin] PATH_INFO: `/v3/roles/404d2ea20e7c4842892e5001133f1b93` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:19.622858 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70e0ec1-00dd-4403-8056-5bcf14f20a64 None admin] RBAC: Authorizing `identity:get_role(role_id=404d2ea20e7c4842892e5001133f1b93)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:19.624165 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70e0ec1-00dd-4403-8056-5bcf14f20a64 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:19.625519 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 565/1126] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 16:10:19 2022] GET /identity/v3/roles/404d2ea20e7c4842892e5001133f1b93 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:10:19.631834 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c78d5e-7624-43ae-ac4f-1bfb7d4eb6e0 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:19.730830 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c78d5e-7624-43ae-ac4f-1bfb7d4eb6e0 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:19.764109 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afbf8ae-e8cb-464d-aeb0-59e9bdd4f1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:19.764969 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afbf8ae-e8cb-464d-aeb0-59e9bdd4f1d3 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:19.765250 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afbf8ae-e8cb-464d-aeb0-59e9bdd4f1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:19.765523 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afbf8ae-e8cb-464d-aeb0-59e9bdd4f1d3 None admin] PATH_INFO: `/v3/users/bd0abd21b2f64a86bd7234feef9d501e` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:19.766718 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afbf8ae-e8cb-464d-aeb0-59e9bdd4f1d3 None admin] RBAC: Authorizing `identity:get_user(user_id=bd0abd21b2f64a86bd7234feef9d501e)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:19.768217 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afbf8ae-e8cb-464d-aeb0-59e9bdd4f1d3 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:19.778444 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 562/1127] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 16:10:19 2022] GET /identity/v3/users/bd0abd21b2f64a86bd7234feef9d501e => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:10:19.781420 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70e0ec1-00dd-4403-8056-5bcf14f20a64 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:19.812052 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:19.880252 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70e0ec1-00dd-4403-8056-5bcf14f20a64 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:19.912911 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eee6777-144a-43c2-aa6e-b881039f2147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:19.913552 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee6777-144a-43c2-aa6e-b881039f2147 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:19.913837 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee6777-144a-43c2-aa6e-b881039f2147 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:19.914116 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee6777-144a-43c2-aa6e-b881039f2147 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:19.978616 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eee6777-144a-43c2-aa6e-b881039f2147 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:19.980056 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eee6777-144a-43c2-aa6e-b881039f2147 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:20.007818 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:20.075212 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 566/1128] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 16:10:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 16:10:20.081839 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afbf8ae-e8cb-464d-aeb0-59e9bdd4f1d3 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:20.142029 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:20.179894 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afbf8ae-e8cb-464d-aeb0-59e9bdd4f1d3 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:20.213175 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62602d32-2b35-4322-a5b0-32ad9e1217e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:20.214051 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62602d32-2b35-4322-a5b0-32ad9e1217e8 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:20.214367 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62602d32-2b35-4322-a5b0-32ad9e1217e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:20.214647 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62602d32-2b35-4322-a5b0-32ad9e1217e8 None admin] PATH_INFO: `/v3/projects/3adaf3d476b94333a8412f119fa330ee` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:20.215816 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62602d32-2b35-4322-a5b0-32ad9e1217e8 None admin] RBAC: Authorizing `identity:get_project(project_id=3adaf3d476b94333a8412f119fa330ee)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:20.217236 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62602d32-2b35-4322-a5b0-32ad9e1217e8 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:20.218924 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 563/1129] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 16:10:20 2022] GET /identity/v3/projects/3adaf3d476b94333a8412f119fa330ee => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:10:20.224928 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eee6777-144a-43c2-aa6e-b881039f2147 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:20.321256 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eee6777-144a-43c2-aa6e-b881039f2147 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:20.348587 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:20.354143 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f12d22d-cb88-467e-afa1-51f7b1210cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:20.354811 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f12d22d-cb88-467e-afa1-51f7b1210cf6 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:20.355097 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f12d22d-cb88-467e-afa1-51f7b1210cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:20.355376 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f12d22d-cb88-467e-afa1-51f7b1210cf6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:20.356196 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f12d22d-cb88-467e-afa1-51f7b1210cf6 None admin] RBAC: Adding query filter params (role.id=404d2ea20e7c4842892e5001133f1b93, scope.project.id=3adaf3d476b94333a8412f119fa330ee, user.id=bd0abd21b2f64a86bd7234feef9d501e) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:10:20.356509 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f12d22d-cb88-467e-afa1-51f7b1210cf6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:20.357920 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f12d22d-cb88-467e-afa1-51f7b1210cf6 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:20.364247 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 567/1130] 10.222.0.62 () {56 vars in 1374 bytes} [Fri May 27 16:10:20 2022] GET /identity/v3/role_assignments?user.id=bd0abd21b2f64a86bd7234feef9d501e&scope.project.id=3adaf3d476b94333a8412f119fa330ee&role.id=404d2ea20e7c4842892e5001133f1b93 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:10:22.557994 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49622d76-6497-43fe-9a9a-7dd6ce998e2d None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:22.558573 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49622d76-6497-43fe-9a9a-7dd6ce998e2d None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:22.558573 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49622d76-6497-43fe-9a9a-7dd6ce998e2d None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:22.559935 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 564/1131] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:10:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:10:22.565104 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73050d70-c50f-4ae4-8648-4f7618d70b9d None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:22.565523 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73050d70-c50f-4ae4-8648-4f7618d70b9d None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:22.565679 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73050d70-c50f-4ae4-8648-4f7618d70b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:22.582593 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-73050d70-c50f-4ae4-8648-4f7618d70b9d None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:10:22.583760 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-73050d70-c50f-4ae4-8648-4f7618d70b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:10:22.648643 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 568/1132] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:10:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:10:22.671986 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49622d76-6497-43fe-9a9a-7dd6ce998e2d None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:22.769920 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49622d76-6497-43fe-9a9a-7dd6ce998e2d None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:22.797924 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:22.803906 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100777c7-60a6-441b-a054-fbf7ffb3bb09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:22.804694 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100777c7-60a6-441b-a054-fbf7ffb3bb09 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:22.804979 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100777c7-60a6-441b-a054-fbf7ffb3bb09 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:22.805285 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100777c7-60a6-441b-a054-fbf7ffb3bb09 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:22.806500 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100777c7-60a6-441b-a054-fbf7ffb3bb09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:22.807941 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100777c7-60a6-441b-a054-fbf7ffb3bb09 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:22.811653 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 565/1133] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:10:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:10:22.815925 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73050d70-c50f-4ae4-8648-4f7618d70b9d None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:22.911611 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73050d70-c50f-4ae4-8648-4f7618d70b9d None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:22.934935 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:22.945094 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb8097d-acfa-4dfc-8474-60334a1d296b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:22.945744 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb8097d-acfa-4dfc-8474-60334a1d296b None admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:22.946024 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb8097d-acfa-4dfc-8474-60334a1d296b None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:22.948972 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb8097d-acfa-4dfc-8474-60334a1d296b None admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:22.948972 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb8097d-acfa-4dfc-8474-60334a1d296b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:22.948972 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb8097d-acfa-4dfc-8474-60334a1d296b None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:23.077760 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 569/1134] 10.222.0.62 () {60 vars in 1141 bytes} [Fri May 27 16:10:22 2022] POST /identity/v3/projects => generated 311 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:10:25.280832 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d6934-8146-4ff9-b5bf-1f5809147246 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:25.281327 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d6934-8146-4ff9-b5bf-1f5809147246 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:25.281327 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d6934-8146-4ff9-b5bf-1f5809147246 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:25.282687 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 566/1135] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:10:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:10:25.287943 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ee5373-afaf-4711-9d07-734acef50d0c None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:25.288359 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ee5373-afaf-4711-9d07-734acef50d0c None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:25.288511 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ee5373-afaf-4711-9d07-734acef50d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:25.305167 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-c8ee5373-afaf-4711-9d07-734acef50d0c None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:10:25.306369 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-c8ee5373-afaf-4711-9d07-734acef50d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:10:25.369409 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 570/1136] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:10:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:10:25.394158 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2d6934-8146-4ff9-b5bf-1f5809147246 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:25.491009 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2d6934-8146-4ff9-b5bf-1f5809147246 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:25.523321 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e6c7f1-b3f5-4b32-90eb-29135eb1f8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:25.524089 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6c7f1-b3f5-4b32-90eb-29135eb1f8c6 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:25.524368 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6c7f1-b3f5-4b32-90eb-29135eb1f8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:25.524643 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6c7f1-b3f5-4b32-90eb-29135eb1f8c6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:25.525830 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e6c7f1-b3f5-4b32-90eb-29135eb1f8c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:25.527290 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e6c7f1-b3f5-4b32-90eb-29135eb1f8c6 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:25.528855 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 567/1137] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:10:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:10:25.534482 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ee5373-afaf-4711-9d07-734acef50d0c None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:25.631062 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ee5373-afaf-4711-9d07-734acef50d0c None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:25.638120 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:25.663879 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a92c0ae-e77e-450d-a165-acd52192f036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:25.664550 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a92c0ae-e77e-450d-a165-acd52192f036 None admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:25.664837 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a92c0ae-e77e-450d-a165-acd52192f036 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:25.665115 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a92c0ae-e77e-450d-a165-acd52192f036 None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:25.665821 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a92c0ae-e77e-450d-a165-acd52192f036 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:25.667281 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a92c0ae-e77e-450d-a165-acd52192f036 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:25.773352 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 571/1138] 10.222.0.62 () {60 vars in 1132 bytes} [Fri May 27 16:10:25 2022] POST /identity/v3/users => generated 286 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:10:28.008534 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ad562-deae-4725-91b1-e0d067a57f32 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:28.009048 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ad562-deae-4725-91b1-e0d067a57f32 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:28.009156 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ad562-deae-4725-91b1-e0d067a57f32 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:28.010487 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 568/1139] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:10:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:10:28.015740 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e0bbea-74f0-4fd2-ae19-94e51dc349e8 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:28.016167 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e0bbea-74f0-4fd2-ae19-94e51dc349e8 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:28.016301 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e0bbea-74f0-4fd2-ae19-94e51dc349e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:28.033887 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-88e0bbea-74f0-4fd2-ae19-94e51dc349e8 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:10:28.035084 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-88e0bbea-74f0-4fd2-ae19-94e51dc349e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:10:28.099726 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 572/1140] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:10:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:10:28.122838 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24ad562-deae-4725-91b1-e0d067a57f32 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:28.188010 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:28.222930 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24ad562-deae-4725-91b1-e0d067a57f32 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:28.256842 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f24cbe9-3720-4fe0-869d-bb91de167fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:28.257618 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f24cbe9-3720-4fe0-869d-bb91de167fe7 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:28.257904 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f24cbe9-3720-4fe0-869d-bb91de167fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:28.258180 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f24cbe9-3720-4fe0-869d-bb91de167fe7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:28.268237 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f24cbe9-3720-4fe0-869d-bb91de167fe7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:10:28.276385 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-6f24cbe9-3720-4fe0-869d-bb91de167fe7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:10:28.276385 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:10:28.276385 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:10:28.276385 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:10:28.276385 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:10:28.276385 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:10:28.276385 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:10:28.276385 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:10:28.276385 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:10:28.276385 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:10:28.276385 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:10:28.276385 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:10:28.276385 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:10:28.276385 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:10:28.276385 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:10:28.276385 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:10:28.277311 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:10:28.277311 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:10:28.277311 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:10:28.277311 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:10:28.277311 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:10:28.277311 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:10:28.277311 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:10:28.277311 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:10:28.277311 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:10:28.277311 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:10:28.277311 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:10:28.277311 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:10:28.277311 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:10:28.277311 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:10:28.277311 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:10:28.277311 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:10:28.278150 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:10:28.278150 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:10:28.278150 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:10:28.278150 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:10:28.278150 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:10:28.278150 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:10:28.278150 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:10:28.278150 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:10:28.278150 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:10:28.278150 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:10:28.278150 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:10:28.278150 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:10:28.278150 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 569/1141] 10.222.0.62 () {56 vars in 1096 bytes} [Fri May 27 16:10:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:10:28.283571 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e0bbea-74f0-4fd2-ae19-94e51dc349e8 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:28.370316 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:28.381959 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e0bbea-74f0-4fd2-ae19-94e51dc349e8 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:28.411721 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abdab80-1d6a-442c-accc-499460aa738c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:28.412372 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abdab80-1d6a-442c-accc-499460aa738c None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:28.412658 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abdab80-1d6a-442c-accc-499460aa738c None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:28.412938 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abdab80-1d6a-442c-accc-499460aa738c None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:28.413676 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abdab80-1d6a-442c-accc-499460aa738c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:10:28.413986 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abdab80-1d6a-442c-accc-499460aa738c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:28.415387 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abdab80-1d6a-442c-accc-499460aa738c None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:28.423379 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 573/1142] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 16:10:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:10:28.429056 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f24cbe9-3720-4fe0-869d-bb91de167fe7 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:28.525545 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f24cbe9-3720-4fe0-869d-bb91de167fe7 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:28.549879 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:28.558343 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75cb6ae-956e-4d1b-b866-b97e1685cd45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:28.561175 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75cb6ae-956e-4d1b-b866-b97e1685cd45 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:28.561175 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75cb6ae-956e-4d1b-b866-b97e1685cd45 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:28.561175 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75cb6ae-956e-4d1b-b866-b97e1685cd45 None admin] PATH_INFO: `/v3/users/c92cff0cd5874ca3830576702636561b` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:28.573476 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75cb6ae-956e-4d1b-b866-b97e1685cd45 None admin] RBAC: Authorizing `identity:get_user(user_id=c92cff0cd5874ca3830576702636561b)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:28.574959 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75cb6ae-956e-4d1b-b866-b97e1685cd45 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:28.576621 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 570/1143] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 16:10:28 2022] GET /identity/v3/users/c92cff0cd5874ca3830576702636561b => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:10:28.582546 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abdab80-1d6a-442c-accc-499460aa738c None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:28.680803 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abdab80-1d6a-442c-accc-499460aa738c None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:28.713016 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5878e4c-e0e0-41e9-86f4-a6b440861c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:28.713651 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5878e4c-e0e0-41e9-86f4-a6b440861c24 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:28.713939 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5878e4c-e0e0-41e9-86f4-a6b440861c24 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:28.714217 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5878e4c-e0e0-41e9-86f4-a6b440861c24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:28.737412 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:28.779425 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5878e4c-e0e0-41e9-86f4-a6b440861c24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:28.780868 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5878e4c-e0e0-41e9-86f4-a6b440861c24 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:28.877910 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 574/1144] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 16:10:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 16:10:28.886198 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75cb6ae-956e-4d1b-b866-b97e1685cd45 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:29.003900 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75cb6ae-956e-4d1b-b866-b97e1685cd45 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:29.036593 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9454f7d-70a8-4fda-9a16-1a3c5eaf45bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:29.037443 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9454f7d-70a8-4fda-9a16-1a3c5eaf45bd None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:29.037729 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9454f7d-70a8-4fda-9a16-1a3c5eaf45bd None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:29.038006 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9454f7d-70a8-4fda-9a16-1a3c5eaf45bd None admin] PATH_INFO: `/v3/projects/58dd01b417694613b5ff9b8ad6c1120c` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:29.039290 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9454f7d-70a8-4fda-9a16-1a3c5eaf45bd None admin] RBAC: Authorizing `identity:get_project(project_id=58dd01b417694613b5ff9b8ad6c1120c)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:29.040713 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9454f7d-70a8-4fda-9a16-1a3c5eaf45bd None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:29.042407 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 571/1145] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 16:10:28 2022] GET /identity/v3/projects/58dd01b417694613b5ff9b8ad6c1120c => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:10:29.048692 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5878e4c-e0e0-41e9-86f4-a6b440861c24 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:29.102104 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:29.146541 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5878e4c-e0e0-41e9-86f4-a6b440861c24 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:29.179361 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc211b9-5952-449f-97a4-3b353c81c743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:29.180012 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc211b9-5952-449f-97a4-3b353c81c743 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:29.180301 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc211b9-5952-449f-97a4-3b353c81c743 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:29.180583 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc211b9-5952-449f-97a4-3b353c81c743 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:29.181407 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc211b9-5952-449f-97a4-3b353c81c743 None admin] RBAC: Adding query filter params (role.id=e04fe3eb1f714d74901ac83e33ea8a16, scope.project.id=58dd01b417694613b5ff9b8ad6c1120c, user.id=c92cff0cd5874ca3830576702636561b) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:10:29.181725 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc211b9-5952-449f-97a4-3b353c81c743 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:29.183183 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc211b9-5952-449f-97a4-3b353c81c743 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:29.188491 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 575/1146] 10.222.0.62 () {56 vars in 1374 bytes} [Fri May 27 16:10:29 2022] GET /identity/v3/role_assignments?user.id=c92cff0cd5874ca3830576702636561b&scope.project.id=58dd01b417694613b5ff9b8ad6c1120c&role.id=e04fe3eb1f714d74901ac83e33ea8a16 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:10:31.362103 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf8ea4-b231-4943-abad-3231591855e4 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:31.362646 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf8ea4-b231-4943-abad-3231591855e4 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:31.362758 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf8ea4-b231-4943-abad-3231591855e4 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:31.364031 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 572/1147] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:10:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:10:31.369150 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b49b9-83d5-4c8d-a554-89552f730379 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:31.369519 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b49b9-83d5-4c8d-a554-89552f730379 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:31.369715 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b49b9-83d5-4c8d-a554-89552f730379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:31.386784 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-5a5b49b9-83d5-4c8d-a554-89552f730379 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:10:31.387968 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-5a5b49b9-83d5-4c8d-a554-89552f730379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:10:31.452933 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 576/1148] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:10:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:10:31.475272 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf8ea4-b231-4943-abad-3231591855e4 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:31.528545 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:31.575173 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf8ea4-b231-4943-abad-3231591855e4 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:31.607639 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eed165-00e1-49f1-8720-facfde4cb536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:31.608420 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eed165-00e1-49f1-8720-facfde4cb536 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:31.608707 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eed165-00e1-49f1-8720-facfde4cb536 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:31.608989 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eed165-00e1-49f1-8720-facfde4cb536 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:31.619663 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eed165-00e1-49f1-8720-facfde4cb536 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:10:31.627852 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-33eed165-00e1-49f1-8720-facfde4cb536 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:10:31.627852 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:10:31.627852 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:10:31.627852 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:10:31.627852 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:10:31.627852 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:10:31.627852 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:10:31.627852 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:10:31.627852 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:10:31.627852 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:10:31.627852 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:10:31.627852 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:10:31.627852 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:10:31.627852 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:10:31.627852 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:10:31.627852 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:10:31.628879 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:10:31.628879 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:10:31.628879 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:10:31.628879 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:10:31.628879 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:10:31.628879 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:10:31.628879 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:10:31.628879 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:10:31.628879 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:10:31.628879 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:10:31.628879 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:10:31.628879 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:10:31.628879 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:10:31.628879 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:10:31.628879 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:10:31.628879 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:10:31.629792 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:10:31.629792 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:10:31.629792 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:10:31.629792 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:10:31.629792 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:10:31.629792 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:10:31.629792 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:10:31.629792 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:10:31.629792 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:10:31.629792 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:10:31.629792 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:10:31.629792 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:10:31.629792 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 573/1149] 10.222.0.62 () {56 vars in 1096 bytes} [Fri May 27 16:10:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:10:31.634969 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b49b9-83d5-4c8d-a554-89552f730379 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:31.681984 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:31.730582 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b49b9-83d5-4c8d-a554-89552f730379 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:31.763776 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53243692-401d-4b99-b46b-273410b3a2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:31.764432 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53243692-401d-4b99-b46b-273410b3a2ee None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:31.764721 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53243692-401d-4b99-b46b-273410b3a2ee None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:31.765006 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53243692-401d-4b99-b46b-273410b3a2ee None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:31.765752 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53243692-401d-4b99-b46b-273410b3a2ee None admin] RBAC: Adding query filter params (name=admin) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:10:31.766066 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53243692-401d-4b99-b46b-273410b3a2ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:31.767492 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53243692-401d-4b99-b46b-273410b3a2ee None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:31.775320 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 577/1150] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 16:10:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:10:31.781115 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eed165-00e1-49f1-8720-facfde4cb536 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:31.880398 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eed165-00e1-49f1-8720-facfde4cb536 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:31.892701 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:31.925223 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526682af-763a-4c75-8641-d1366ecab60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:31.926085 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526682af-763a-4c75-8641-d1366ecab60e None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:31.926405 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526682af-763a-4c75-8641-d1366ecab60e None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:31.926685 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526682af-763a-4c75-8641-d1366ecab60e None admin] PATH_INFO: `/v3/users/c92cff0cd5874ca3830576702636561b` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:31.927881 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526682af-763a-4c75-8641-d1366ecab60e None admin] RBAC: Authorizing `identity:get_user(user_id=c92cff0cd5874ca3830576702636561b)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:31.929320 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526682af-763a-4c75-8641-d1366ecab60e None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:31.930975 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 574/1151] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 16:10:31 2022] GET /identity/v3/users/c92cff0cd5874ca3830576702636561b => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:10:31.936686 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53243692-401d-4b99-b46b-273410b3a2ee None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:32.038378 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53243692-401d-4b99-b46b-273410b3a2ee None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:32.048480 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:32.071053 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d3de88-fc18-4144-bb0a-08c2db4af49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:32.071900 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3de88-fc18-4144-bb0a-08c2db4af49c None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:32.072182 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3de88-fc18-4144-bb0a-08c2db4af49c None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:32.072458 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3de88-fc18-4144-bb0a-08c2db4af49c None admin] PATH_INFO: `/v3/projects/58dd01b417694613b5ff9b8ad6c1120c` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:32.073611 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d3de88-fc18-4144-bb0a-08c2db4af49c None admin] RBAC: Authorizing `identity:get_project(project_id=58dd01b417694613b5ff9b8ad6c1120c)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:32.075062 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d3de88-fc18-4144-bb0a-08c2db4af49c None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:32.076739 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 578/1152] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 16:10:31 2022] GET /identity/v3/projects/58dd01b417694613b5ff9b8ad6c1120c => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:10:32.082711 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526682af-763a-4c75-8641-d1366ecab60e None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:32.180022 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526682af-763a-4c75-8641-d1366ecab60e None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:32.211634 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f741a0de-6352-493d-9f97-19f31ecb2b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:32.212512 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741a0de-6352-493d-9f97-19f31ecb2b61 None admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:32.212794 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741a0de-6352-493d-9f97-19f31ecb2b61 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:32.213069 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741a0de-6352-493d-9f97-19f31ecb2b61 None admin] PATH_INFO: `/v3/projects/58dd01b417694613b5ff9b8ad6c1120c/users/c92cff0cd5874ca3830576702636561b/roles/e04fe3eb1f714d74901ac83e33ea8a16` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:32.214980 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f741a0de-6352-493d-9f97-19f31ecb2b61 None admin] RBAC: Authorizing `identity:create_grant(project_id=58dd01b417694613b5ff9b8ad6c1120c, user_id=c92cff0cd5874ca3830576702636561b, role_id=e04fe3eb1f714d74901ac83e33ea8a16)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:32.216397 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f741a0de-6352-493d-9f97-19f31ecb2b61 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:32.308611 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 575/1153] 10.222.0.62 () {58 vars in 1439 bytes} [Fri May 27 16:10:32 2022] PUT /identity/v3/projects/58dd01b417694613b5ff9b8ad6c1120c/users/c92cff0cd5874ca3830576702636561b/roles/e04fe3eb1f714d74901ac83e33ea8a16 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:10:34.502980 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad7da78-7240-40a9-94c6-00377a9a64f8 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:34.503535 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad7da78-7240-40a9-94c6-00377a9a64f8 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:34.503535 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad7da78-7240-40a9-94c6-00377a9a64f8 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:34.504920 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 579/1154] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:10:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:10:34.510213 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debdb24-4bb6-4500-86d8-a32624e4a36b None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:34.510660 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debdb24-4bb6-4500-86d8-a32624e4a36b None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:34.510805 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debdb24-4bb6-4500-86d8-a32624e4a36b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:34.527691 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-5debdb24-4bb6-4500-86d8-a32624e4a36b None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:10:34.528913 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-5debdb24-4bb6-4500-86d8-a32624e4a36b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:10:34.562039 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:34.593019 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 576/1155] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:10:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:10:34.616942 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad7da78-7240-40a9-94c6-00377a9a64f8 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:34.716382 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad7da78-7240-40a9-94c6-00377a9a64f8 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:34.748732 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e73e88-296f-4de4-87c8-c3a62d5b7644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:34.749506 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e73e88-296f-4de4-87c8-c3a62d5b7644 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:34.749792 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e73e88-296f-4de4-87c8-c3a62d5b7644 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:34.750068 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e73e88-296f-4de4-87c8-c3a62d5b7644 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:34.762782 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e73e88-296f-4de4-87c8-c3a62d5b7644 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:10:34.770275 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-11e73e88-296f-4de4-87c8-c3a62d5b7644 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:10:34.770275 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:10:34.770275 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:10:34.770275 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:10:34.770275 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:10:34.770275 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:10:34.770275 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:10:34.770275 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:10:34.770275 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:10:34.770275 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:10:34.770275 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:10:34.770275 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:10:34.770275 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:10:34.770275 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:10:34.770275 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:10:34.770275 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:10:34.771439 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:10:34.771439 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:10:34.771439 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:10:34.771439 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:10:34.771439 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:10:34.771439 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:10:34.771439 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:10:34.771439 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:10:34.771439 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:10:34.771439 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:10:34.771439 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:10:34.771439 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:10:34.771439 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:10:34.771439 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:10:34.771439 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:10:34.771439 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:10:34.772365 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:10:34.772365 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:10:34.772365 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:10:34.772365 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:10:34.772365 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:10:34.772365 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:10:34.772365 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:10:34.772365 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:10:34.772365 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:10:34.772365 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:10:34.772365 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:10:34.772365 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:10:34.772365 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 580/1156] 10.222.0.62 () {56 vars in 1096 bytes} [Fri May 27 16:10:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:10:34.778197 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5debdb24-4bb6-4500-86d8-a32624e4a36b None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:34.874868 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5debdb24-4bb6-4500-86d8-a32624e4a36b None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:34.908476 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e8d117-12ed-4b4b-91c6-b0457690f233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:34.909134 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8d117-12ed-4b4b-91c6-b0457690f233 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:34.909418 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8d117-12ed-4b4b-91c6-b0457690f233 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:34.909696 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8d117-12ed-4b4b-91c6-b0457690f233 None admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:34.910467 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e8d117-12ed-4b4b-91c6-b0457690f233 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:10:34.910776 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e8d117-12ed-4b4b-91c6-b0457690f233 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:34.912142 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e8d117-12ed-4b4b-91c6-b0457690f233 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:34.919934 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 577/1157] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 16:10:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:10:34.925937 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e73e88-296f-4de4-87c8-c3a62d5b7644 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:34.965070 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:35.022451 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e73e88-296f-4de4-87c8-c3a62d5b7644 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:35.055092 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3e9d96-71e6-4f90-ad98-3fd88ab30b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:35.055948 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e9d96-71e6-4f90-ad98-3fd88ab30b55 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:35.056231 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e9d96-71e6-4f90-ad98-3fd88ab30b55 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:35.056507 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e9d96-71e6-4f90-ad98-3fd88ab30b55 None admin] PATH_INFO: `/v3/users/c92cff0cd5874ca3830576702636561b` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:35.057679 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3e9d96-71e6-4f90-ad98-3fd88ab30b55 None admin] RBAC: Authorizing `identity:get_user(user_id=c92cff0cd5874ca3830576702636561b)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:35.059129 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3e9d96-71e6-4f90-ad98-3fd88ab30b55 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:35.060749 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 581/1158] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 16:10:34 2022] GET /identity/v3/users/c92cff0cd5874ca3830576702636561b => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:10:35.066961 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e8d117-12ed-4b4b-91c6-b0457690f233 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:35.098308 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:35.165498 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e8d117-12ed-4b4b-91c6-b0457690f233 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:35.199429 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbdecc2-01a0-4f97-9b1d-5430dd6931e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:35.200074 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbdecc2-01a0-4f97-9b1d-5430dd6931e8 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:35.200363 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbdecc2-01a0-4f97-9b1d-5430dd6931e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:35.200646 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbdecc2-01a0-4f97-9b1d-5430dd6931e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:35.267199 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbdecc2-01a0-4f97-9b1d-5430dd6931e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:35.268659 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbdecc2-01a0-4f97-9b1d-5430dd6931e8 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:35.299668 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:35.366321 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 578/1159] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 16:10:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 16:10:35.372318 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3e9d96-71e6-4f90-ad98-3fd88ab30b55 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:35.468203 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3e9d96-71e6-4f90-ad98-3fd88ab30b55 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:35.475172 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:35.501990 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74da98c-f7ac-485b-b9b6-05d97d21d8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:35.502872 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74da98c-f7ac-485b-b9b6-05d97d21d8db None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:35.503159 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74da98c-f7ac-485b-b9b6-05d97d21d8db None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:35.503687 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74da98c-f7ac-485b-b9b6-05d97d21d8db None admin] PATH_INFO: `/v3/projects/58dd01b417694613b5ff9b8ad6c1120c` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:35.504596 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74da98c-f7ac-485b-b9b6-05d97d21d8db None admin] RBAC: Authorizing `identity:get_project(project_id=58dd01b417694613b5ff9b8ad6c1120c)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:35.506020 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74da98c-f7ac-485b-b9b6-05d97d21d8db None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:35.507718 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 582/1160] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 16:10:35 2022] GET /identity/v3/projects/58dd01b417694613b5ff9b8ad6c1120c => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:10:35.513679 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbdecc2-01a0-4f97-9b1d-5430dd6931e8 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:35.608936 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbdecc2-01a0-4f97-9b1d-5430dd6931e8 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:35.637199 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:35.641949 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92cb5d8-fa0c-4d37-9a39-50cc9ab9c182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:35.642680 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92cb5d8-fa0c-4d37-9a39-50cc9ab9c182 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:35.642968 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92cb5d8-fa0c-4d37-9a39-50cc9ab9c182 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:35.643250 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92cb5d8-fa0c-4d37-9a39-50cc9ab9c182 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:35.644072 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92cb5d8-fa0c-4d37-9a39-50cc9ab9c182 None admin] RBAC: Adding query filter params (role.id=e04fe3eb1f714d74901ac83e33ea8a16, scope.project.id=58dd01b417694613b5ff9b8ad6c1120c, user.id=c92cff0cd5874ca3830576702636561b) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:10:35.644384 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92cb5d8-fa0c-4d37-9a39-50cc9ab9c182 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:35.645806 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92cb5d8-fa0c-4d37-9a39-50cc9ab9c182 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:35.651544 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 579/1161] 10.222.0.62 () {56 vars in 1374 bytes} [Fri May 27 16:10:35 2022] GET /identity/v3/role_assignments?user.id=c92cff0cd5874ca3830576702636561b&scope.project.id=58dd01b417694613b5ff9b8ad6c1120c&role.id=e04fe3eb1f714d74901ac83e33ea8a16 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:10:37.840409 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85de9bc-b2cf-4f40-b077-8fa8d7cbdc76 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:37.840929 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85de9bc-b2cf-4f40-b077-8fa8d7cbdc76 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:37.841040 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85de9bc-b2cf-4f40-b077-8fa8d7cbdc76 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:37.842374 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 583/1162] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:10:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:10:37.848204 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8c1ec-8291-456a-a762-29b7f56b974a None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:37.848575 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8c1ec-8291-456a-a762-29b7f56b974a None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:37.848759 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8c1ec-8291-456a-a762-29b7f56b974a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:37.865079 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-b2f8c1ec-8291-456a-a762-29b7f56b974a None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:10:37.866267 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-b2f8c1ec-8291-456a-a762-29b7f56b974a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:10:37.930197 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 580/1163] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:10:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:10:37.952689 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85de9bc-b2cf-4f40-b077-8fa8d7cbdc76 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:38.056555 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85de9bc-b2cf-4f40-b077-8fa8d7cbdc76 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:38.091080 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d3e53a-e06c-4b63-a460-0fd97b9815db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:38.091655 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d3e53a-e06c-4b63-a460-0fd97b9815db None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:38.091942 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d3e53a-e06c-4b63-a460-0fd97b9815db None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:38.092224 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d3e53a-e06c-4b63-a460-0fd97b9815db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:38.133002 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:38.157450 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d3e53a-e06c-4b63-a460-0fd97b9815db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:38.158943 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d3e53a-e06c-4b63-a460-0fd97b9815db None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:38.253742 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 584/1164] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 16:10:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 16:10:38.259726 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f8c1ec-8291-456a-a762-29b7f56b974a None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:38.355820 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f8c1ec-8291-456a-a762-29b7f56b974a None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:38.379810 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:38.387988 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0afeae-0c65-4ddb-8368-ab456f313957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:38.397069 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0afeae-0c65-4ddb-8368-ab456f313957 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:38.397069 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0afeae-0c65-4ddb-8368-ab456f313957 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:38.397069 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0afeae-0c65-4ddb-8368-ab456f313957 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:38.397069 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0afeae-0c65-4ddb-8368-ab456f313957 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:38.397845 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0afeae-0c65-4ddb-8368-ab456f313957 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:38.412580 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-ff0afeae-0c65-4ddb-8368-ab456f313957 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 27 16:10:38.412580 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:10:38.412580 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 27 16:10:38.412580 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 27 16:10:38.412580 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 16:10:38.412580 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 16:10:38.412580 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 16:10:38.412580 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 16:10:38.412580 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 27 16:10:38.412580 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:10:38.412580 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 16:10:38.412580 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:10:38.412580 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:10:38.412580 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:10:38.412580 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:10:38.412580 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:10:38.412580 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:10:38.413625 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:10:38.413625 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:10:38.413625 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:10:38.413625 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:10:38.413625 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:10:38.413625 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:10:38.413625 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:10:38.413625 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:10:38.413625 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:10:38.413625 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:10:38.413625 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:10:38.413625 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:10:38.413625 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:10:38.413625 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:10:38.413625 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:10:38.413625 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:10:38.414540 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:10:38.414540 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:10:38.414540 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:10:38.414540 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:10:38.414540 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:10:38.414540 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:10:38.414540 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:10:38.414540 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:10:38.414540 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:10:38.414540 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:10:38.414540 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 27 16:10:38.414540 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:10:38.414540 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 27 16:10:38.414540 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:10:38.414540 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 581/1165] 10.222.0.62 () {56 vars in 1117 bytes} [Fri May 27 16:10:38 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:10:38.419871 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d3e53a-e06c-4b63-a460-0fd97b9815db None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:38.491855 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:38.515012 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d3e53a-e06c-4b63-a460-0fd97b9815db None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:38.548716 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec17fc47-94f2-4597-9248-0fb6fbdb02b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:38.549361 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec17fc47-94f2-4597-9248-0fb6fbdb02b5 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:38.549645 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec17fc47-94f2-4597-9248-0fb6fbdb02b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:38.549923 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec17fc47-94f2-4597-9248-0fb6fbdb02b5 None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:38.550665 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec17fc47-94f2-4597-9248-0fb6fbdb02b5 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:10:38.550975 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec17fc47-94f2-4597-9248-0fb6fbdb02b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:38.552337 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec17fc47-94f2-4597-9248-0fb6fbdb02b5 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:38.559275 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 585/1166] 10.222.0.62 () {56 vars in 1115 bytes} [Fri May 27 16:10:38 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:10:40.698639 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7850af1-a058-4749-bf8f-ca514645e267 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:40.699201 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7850af1-a058-4749-bf8f-ca514645e267 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:40.699201 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7850af1-a058-4749-bf8f-ca514645e267 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:40.700561 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 582/1167] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:10:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:10:40.706272 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd27ea1-337f-4c79-805b-b6f4576ee612 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:40.706706 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd27ea1-337f-4c79-805b-b6f4576ee612 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:40.706855 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd27ea1-337f-4c79-805b-b6f4576ee612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:40.723282 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-0bd27ea1-337f-4c79-805b-b6f4576ee612 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:10:40.725004 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-0bd27ea1-337f-4c79-805b-b6f4576ee612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:10:40.789666 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 586/1168] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:10:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:10:40.811662 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7850af1-a058-4749-bf8f-ca514645e267 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:40.911467 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7850af1-a058-4749-bf8f-ca514645e267 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:40.944428 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193da7e5-9e21-476a-9bf6-62d48d8bd23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:40.945081 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193da7e5-9e21-476a-9bf6-62d48d8bd23a None admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:40.945368 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193da7e5-9e21-476a-9bf6-62d48d8bd23a None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:40.945646 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193da7e5-9e21-476a-9bf6-62d48d8bd23a None admin] PATH_INFO: `/v3/domains` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:40.946411 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193da7e5-9e21-476a-9bf6-62d48d8bd23a None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:40.947769 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193da7e5-9e21-476a-9bf6-62d48d8bd23a None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:41.054174 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 583/1169] 10.222.0.62 () {60 vars in 1138 bytes} [Fri May 27 16:10:40 2022] POST /identity/v3/domains => generated 267 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:10:43.279087 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b95934-f7d3-4b1c-bd50-8d9ee2f04359 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:43.279594 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b95934-f7d3-4b1c-bd50-8d9ee2f04359 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:43.279594 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b95934-f7d3-4b1c-bd50-8d9ee2f04359 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:43.280927 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 587/1170] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:10:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:10:43.286844 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed067bf-a2e0-4bb2-b383-3380122986f4 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:43.287283 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed067bf-a2e0-4bb2-b383-3380122986f4 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:43.287388 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed067bf-a2e0-4bb2-b383-3380122986f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:43.304743 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-9ed067bf-a2e0-4bb2-b383-3380122986f4 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:10:43.305930 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-9ed067bf-a2e0-4bb2-b383-3380122986f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:10:43.347759 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:43.372195 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 584/1171] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:10:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:10:43.395540 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b95934-f7d3-4b1c-bd50-8d9ee2f04359 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:43.461121 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:43.494037 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b95934-f7d3-4b1c-bd50-8d9ee2f04359 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:43.526891 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa865561-eb46-4b61-9262-6a17193f546e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:43.527738 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa865561-eb46-4b61-9262-6a17193f546e None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:43.528019 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa865561-eb46-4b61-9262-6a17193f546e None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:43.528292 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa865561-eb46-4b61-9262-6a17193f546e None admin] PATH_INFO: `/v3/domains/3c2f62db205e44f8b10899da1abca43d` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:43.538965 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa865561-eb46-4b61-9262-6a17193f546e None admin] RBAC: Authorizing `identity:get_domain(domain_id=3c2f62db205e44f8b10899da1abca43d)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:43.540344 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa865561-eb46-4b61-9262-6a17193f546e None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:43.541946 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 588/1172] 10.222.0.62 () {56 vars in 1183 bytes} [Fri May 27 16:10:43 2022] GET /identity/v3/domains/3c2f62db205e44f8b10899da1abca43d => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:10:43.547991 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed067bf-a2e0-4bb2-b383-3380122986f4 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:43.643192 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed067bf-a2e0-4bb2-b383-3380122986f4 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:43.676278 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca37e21-75f1-4a48-b276-112d7388cdca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:43.676926 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca37e21-75f1-4a48-b276-112d7388cdca None admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:43.677214 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca37e21-75f1-4a48-b276-112d7388cdca None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:43.677490 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca37e21-75f1-4a48-b276-112d7388cdca None admin] PATH_INFO: `/v3/projects` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:43.678199 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca37e21-75f1-4a48-b276-112d7388cdca None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:43.679666 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca37e21-75f1-4a48-b276-112d7388cdca None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:43.797287 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 585/1173] 10.222.0.62 () {60 vars in 1141 bytes} [Fri May 27 16:10:43 2022] POST /identity/v3/projects => generated 361 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:10:45.980987 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032fccd1-8196-443b-8cc7-650d5ef2f226 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:45.981517 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032fccd1-8196-443b-8cc7-650d5ef2f226 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:45.981517 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032fccd1-8196-443b-8cc7-650d5ef2f226 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:45.982934 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 589/1174] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:10:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:10:45.988223 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede65d7-eec1-4645-8b5e-6fe56994fc12 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:45.988644 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede65d7-eec1-4645-8b5e-6fe56994fc12 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:45.988782 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede65d7-eec1-4645-8b5e-6fe56994fc12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:46.005258 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-0ede65d7-eec1-4645-8b5e-6fe56994fc12 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:10:46.006498 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-0ede65d7-eec1-4645-8b5e-6fe56994fc12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:10:46.028873 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:46.081862 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 586/1175] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:10:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:10:46.106747 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032fccd1-8196-443b-8cc7-650d5ef2f226 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:46.214751 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032fccd1-8196-443b-8cc7-650d5ef2f226 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:46.239361 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:46.247038 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac44eb61-3ad2-4673-8848-95c2b778d7d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:46.257987 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac44eb61-3ad2-4673-8848-95c2b778d7d0 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:46.257987 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac44eb61-3ad2-4673-8848-95c2b778d7d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:46.257987 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac44eb61-3ad2-4673-8848-95c2b778d7d0 None admin] PATH_INFO: `/v3/domains/3c2f62db205e44f8b10899da1abca43d` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:46.257987 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac44eb61-3ad2-4673-8848-95c2b778d7d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=3c2f62db205e44f8b10899da1abca43d)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:46.257987 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac44eb61-3ad2-4673-8848-95c2b778d7d0 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:46.257987 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 590/1176] 10.222.0.62 () {56 vars in 1183 bytes} [Fri May 27 16:10:46 2022] GET /identity/v3/domains/3c2f62db205e44f8b10899da1abca43d => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:10:46.258982 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ede65d7-eec1-4645-8b5e-6fe56994fc12 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:46.353506 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ede65d7-eec1-4645-8b5e-6fe56994fc12 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:46.386029 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dd8f6b-6b57-4e2e-bafb-9be090788b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:46.386715 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd8f6b-6b57-4e2e-bafb-9be090788b52 None admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:46.387001 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd8f6b-6b57-4e2e-bafb-9be090788b52 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:46.387279 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd8f6b-6b57-4e2e-bafb-9be090788b52 None admin] PATH_INFO: `/v3/users` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:46.387982 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dd8f6b-6b57-4e2e-bafb-9be090788b52 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:46.389398 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dd8f6b-6b57-4e2e-bafb-9be090788b52 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:46.508780 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 587/1177] 10.222.0.62 () {60 vars in 1132 bytes} [Fri May 27 16:10:46 2022] POST /identity/v3/users => generated 311 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:10:48.717828 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76615bc6-5c73-423d-b6e5-5ea63bacfb00 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:48.718380 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76615bc6-5c73-423d-b6e5-5ea63bacfb00 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:48.718624 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76615bc6-5c73-423d-b6e5-5ea63bacfb00 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:48.720023 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 591/1178] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:10:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:10:48.725164 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02b7a7-5021-4f98-88e8-0f97211af1af None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:48.725532 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02b7a7-5021-4f98-88e8-0f97211af1af None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:48.725726 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02b7a7-5021-4f98-88e8-0f97211af1af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:48.742869 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-2d02b7a7-5021-4f98-88e8-0f97211af1af None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:10:48.744045 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-2d02b7a7-5021-4f98-88e8-0f97211af1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:10:48.753571 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:48.809730 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 588/1179] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:10:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:10:48.833342 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76615bc6-5c73-423d-b6e5-5ea63bacfb00 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:48.947327 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76615bc6-5c73-423d-b6e5-5ea63bacfb00 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:48.979502 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afc2816-bd81-42b2-99df-1e765022dff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:48.980229 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afc2816-bd81-42b2-99df-1e765022dff7 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:48.980517 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afc2816-bd81-42b2-99df-1e765022dff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:48.980799 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afc2816-bd81-42b2-99df-1e765022dff7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:48.991638 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afc2816-bd81-42b2-99df-1e765022dff7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:10:48.999331 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-1afc2816-bd81-42b2-99df-1e765022dff7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:10:48.999331 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:10:48.999331 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:10:48.999331 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:10:48.999331 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:10:48.999331 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:10:48.999331 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:10:48.999331 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:10:48.999331 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:10:48.999331 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:10:48.999331 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:10:48.999331 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:10:48.999331 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:10:48.999331 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:10:48.999331 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:10:48.999331 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:10:49.000413 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:10:49.000413 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:10:49.000413 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:10:49.000413 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:10:49.000413 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:10:49.000413 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:10:49.000413 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:10:49.000413 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:10:49.000413 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:10:49.000413 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:10:49.000413 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:10:49.000413 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:10:49.000413 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:10:49.000413 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:10:49.000413 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:10:49.000413 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:10:49.006965 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:10:49.006965 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:10:49.006965 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:10:49.006965 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:10:49.006965 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:10:49.006965 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:10:49.006965 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:10:49.006965 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:10:49.006965 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:10:49.006965 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:10:49.006965 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:10:49.006965 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:10:49.006965 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 592/1180] 10.222.0.62 () {56 vars in 1096 bytes} [Fri May 27 16:10:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:10:49.007830 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d02b7a7-5021-4f98-88e8-0f97211af1af None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:49.101078 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d02b7a7-5021-4f98-88e8-0f97211af1af None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:49.133458 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d8cdab-eb2b-4a49-a80d-0c63b1a93a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:49.134105 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d8cdab-eb2b-4a49-a80d-0c63b1a93a7a None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:49.134416 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d8cdab-eb2b-4a49-a80d-0c63b1a93a7a None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:49.134693 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d8cdab-eb2b-4a49-a80d-0c63b1a93a7a None admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:49.135430 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d8cdab-eb2b-4a49-a80d-0c63b1a93a7a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:10:49.135735 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d8cdab-eb2b-4a49-a80d-0c63b1a93a7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:49.137094 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d8cdab-eb2b-4a49-a80d-0c63b1a93a7a None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:49.144853 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 589/1181] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 16:10:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:10:49.150469 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afc2816-bd81-42b2-99df-1e765022dff7 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:49.205965 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:49.249784 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afc2816-bd81-42b2-99df-1e765022dff7 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:49.283060 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f187206f-3a9f-421b-8a5d-cff5f087bc68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:49.283913 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187206f-3a9f-421b-8a5d-cff5f087bc68 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:49.284195 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187206f-3a9f-421b-8a5d-cff5f087bc68 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:49.284465 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187206f-3a9f-421b-8a5d-cff5f087bc68 None admin] PATH_INFO: `/v3/users/4b6839c77cf440d6bc1ab5067fb14f88` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:49.297391 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f187206f-3a9f-421b-8a5d-cff5f087bc68 None admin] RBAC: Authorizing `identity:get_user(user_id=4b6839c77cf440d6bc1ab5067fb14f88)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:49.299521 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f187206f-3a9f-421b-8a5d-cff5f087bc68 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:49.301141 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 593/1182] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 16:10:49 2022] GET /identity/v3/users/4b6839c77cf440d6bc1ab5067fb14f88 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:10:49.307105 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d8cdab-eb2b-4a49-a80d-0c63b1a93a7a None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:49.316346 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:49.404485 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d8cdab-eb2b-4a49-a80d-0c63b1a93a7a None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:49.439432 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e8d880-577f-4f01-a6a4-2c19274fc38e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:49.440076 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e8d880-577f-4f01-a6a4-2c19274fc38e None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:49.440416 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e8d880-577f-4f01-a6a4-2c19274fc38e None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:49.440698 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e8d880-577f-4f01-a6a4-2c19274fc38e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:49.506229 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e8d880-577f-4f01-a6a4-2c19274fc38e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:49.507670 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e8d880-577f-4f01-a6a4-2c19274fc38e None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:49.515059 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:49.604326 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 590/1183] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 16:10:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 16:10:49.610288 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f187206f-3a9f-421b-8a5d-cff5f087bc68 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:49.706044 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f187206f-3a9f-421b-8a5d-cff5f087bc68 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:49.719361 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:49.738802 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e1e5c0-fc85-4fea-80c6-747f877b6dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:49.743904 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1e5c0-fc85-4fea-80c6-747f877b6dbc None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:49.743904 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1e5c0-fc85-4fea-80c6-747f877b6dbc None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:49.743904 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1e5c0-fc85-4fea-80c6-747f877b6dbc None admin] PATH_INFO: `/v3/projects/6d2fc10a26714fbaacceaeab3a290f63` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:49.743904 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e1e5c0-fc85-4fea-80c6-747f877b6dbc None admin] RBAC: Authorizing `identity:get_project(project_id=6d2fc10a26714fbaacceaeab3a290f63)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:49.743904 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e1e5c0-fc85-4fea-80c6-747f877b6dbc None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:49.744469 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 594/1184] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 16:10:49 2022] GET /identity/v3/projects/6d2fc10a26714fbaacceaeab3a290f63 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:10:49.750702 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e8d880-577f-4f01-a6a4-2c19274fc38e None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:49.847836 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e8d880-577f-4f01-a6a4-2c19274fc38e None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:49.855099 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:49.881435 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ca9ab1-ed3b-44ff-87e8-89fd149bc93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:49.882128 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca9ab1-ed3b-44ff-87e8-89fd149bc93a None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:49.882443 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca9ab1-ed3b-44ff-87e8-89fd149bc93a None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:49.882725 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca9ab1-ed3b-44ff-87e8-89fd149bc93a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:49.883557 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ca9ab1-ed3b-44ff-87e8-89fd149bc93a None admin] RBAC: Adding query filter params (role.id=e04fe3eb1f714d74901ac83e33ea8a16, scope.project.id=6d2fc10a26714fbaacceaeab3a290f63, user.id=4b6839c77cf440d6bc1ab5067fb14f88) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:10:49.883870 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ca9ab1-ed3b-44ff-87e8-89fd149bc93a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:49.885305 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ca9ab1-ed3b-44ff-87e8-89fd149bc93a None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:49.890678 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 591/1185] 10.222.0.62 () {56 vars in 1374 bytes} [Fri May 27 16:10:49 2022] GET /identity/v3/role_assignments?user.id=4b6839c77cf440d6bc1ab5067fb14f88&scope.project.id=6d2fc10a26714fbaacceaeab3a290f63&role.id=e04fe3eb1f714d74901ac83e33ea8a16 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:10:52.042927 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafbc339-1672-43a6-8882-1a35798394c0 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:52.043463 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafbc339-1672-43a6-8882-1a35798394c0 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:52.043463 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafbc339-1672-43a6-8882-1a35798394c0 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:52.044851 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 595/1186] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:10:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:10:52.050897 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c72341-0d66-417b-910f-4f8269671695 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:52.051308 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c72341-0d66-417b-910f-4f8269671695 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:52.051464 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c72341-0d66-417b-910f-4f8269671695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:52.068478 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-86c72341-0d66-417b-910f-4f8269671695 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:10:52.069687 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-86c72341-0d66-417b-910f-4f8269671695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:10:52.144502 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 592/1187] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:10:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:10:52.167120 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafbc339-1672-43a6-8882-1a35798394c0 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:52.264521 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafbc339-1672-43a6-8882-1a35798394c0 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:52.296937 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca61fd4-60c1-4148-9e61-f27a6c2c4ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:52.298272 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca61fd4-60c1-4148-9e61-f27a6c2c4ba7 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:52.298573 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca61fd4-60c1-4148-9e61-f27a6c2c4ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:52.298846 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca61fd4-60c1-4148-9e61-f27a6c2c4ba7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:52.308505 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca61fd4-60c1-4148-9e61-f27a6c2c4ba7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:10:52.316038 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-bca61fd4-60c1-4148-9e61-f27a6c2c4ba7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:10:52.316038 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:10:52.316038 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:10:52.316038 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:10:52.316038 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:10:52.316038 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:10:52.316038 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:10:52.316038 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:10:52.316038 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:10:52.316038 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:10:52.316038 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:10:52.316038 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:10:52.316038 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:10:52.316038 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:10:52.316038 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:10:52.316038 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:10:52.317146 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:10:52.317146 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:10:52.317146 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:10:52.317146 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:10:52.317146 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:10:52.317146 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:10:52.317146 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:10:52.317146 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:10:52.317146 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:10:52.317146 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:10:52.317146 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:10:52.317146 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:10:52.317146 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:10:52.317146 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:10:52.317146 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:10:52.317146 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:10:52.318034 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:10:52.318034 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:10:52.318034 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:10:52.318034 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:10:52.318034 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:10:52.318034 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:10:52.318034 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:10:52.318034 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:10:52.318034 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:10:52.318034 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:10:52.318034 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:10:52.318034 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:10:52.318034 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 596/1188] 10.222.0.62 () {56 vars in 1096 bytes} [Fri May 27 16:10:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:10:52.323146 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c72341-0d66-417b-910f-4f8269671695 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:52.415057 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:52.417833 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c72341-0d66-417b-910f-4f8269671695 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:52.450532 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edba1ab1-94ba-48cf-97e4-3edef2b4d1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:52.451191 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba1ab1-94ba-48cf-97e4-3edef2b4d1ea None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:52.451479 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba1ab1-94ba-48cf-97e4-3edef2b4d1ea None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:52.451758 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba1ab1-94ba-48cf-97e4-3edef2b4d1ea None admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:52.452503 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edba1ab1-94ba-48cf-97e4-3edef2b4d1ea None admin] RBAC: Adding query filter params (name=admin) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:10:52.452812 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edba1ab1-94ba-48cf-97e4-3edef2b4d1ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:52.454200 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edba1ab1-94ba-48cf-97e4-3edef2b4d1ea None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:52.461908 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 593/1189] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 16:10:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:10:52.467631 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca61fd4-60c1-4148-9e61-f27a6c2c4ba7 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:52.510717 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:52.565319 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca61fd4-60c1-4148-9e61-f27a6c2c4ba7 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:52.599173 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2402f5a9-6713-458f-9f39-0bfb6837dab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:52.600029 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2402f5a9-6713-458f-9f39-0bfb6837dab7 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:52.600314 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2402f5a9-6713-458f-9f39-0bfb6837dab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:52.600593 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2402f5a9-6713-458f-9f39-0bfb6837dab7 None admin] PATH_INFO: `/v3/users/4b6839c77cf440d6bc1ab5067fb14f88` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:52.601758 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2402f5a9-6713-458f-9f39-0bfb6837dab7 None admin] RBAC: Authorizing `identity:get_user(user_id=4b6839c77cf440d6bc1ab5067fb14f88)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:52.603220 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2402f5a9-6713-458f-9f39-0bfb6837dab7 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:52.604824 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 597/1190] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 16:10:52 2022] GET /identity/v3/users/4b6839c77cf440d6bc1ab5067fb14f88 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:10:52.610562 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edba1ab1-94ba-48cf-97e4-3edef2b4d1ea None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:52.707015 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edba1ab1-94ba-48cf-97e4-3edef2b4d1ea None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:52.738903 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083bc594-219b-45e6-8baa-034b3be942b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:52.739797 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083bc594-219b-45e6-8baa-034b3be942b0 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:52.740080 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083bc594-219b-45e6-8baa-034b3be942b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:52.740356 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083bc594-219b-45e6-8baa-034b3be942b0 None admin] PATH_INFO: `/v3/projects/6d2fc10a26714fbaacceaeab3a290f63` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:52.741514 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083bc594-219b-45e6-8baa-034b3be942b0 None admin] RBAC: Authorizing `identity:get_project(project_id=6d2fc10a26714fbaacceaeab3a290f63)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:52.742956 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083bc594-219b-45e6-8baa-034b3be942b0 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:52.744599 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 594/1191] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 16:10:52 2022] GET /identity/v3/projects/6d2fc10a26714fbaacceaeab3a290f63 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:10:52.750393 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2402f5a9-6713-458f-9f39-0bfb6837dab7 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:52.846217 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2402f5a9-6713-458f-9f39-0bfb6837dab7 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:52.856256 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:52.879387 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898c64c7-57a5-4ed7-b881-bf4dec081d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:52.880272 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898c64c7-57a5-4ed7-b881-bf4dec081d9a None admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:52.880556 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898c64c7-57a5-4ed7-b881-bf4dec081d9a None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:52.880831 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898c64c7-57a5-4ed7-b881-bf4dec081d9a None admin] PATH_INFO: `/v3/projects/6d2fc10a26714fbaacceaeab3a290f63/users/4b6839c77cf440d6bc1ab5067fb14f88/roles/e04fe3eb1f714d74901ac83e33ea8a16` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:52.882843 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898c64c7-57a5-4ed7-b881-bf4dec081d9a None admin] RBAC: Authorizing `identity:create_grant(project_id=6d2fc10a26714fbaacceaeab3a290f63, user_id=4b6839c77cf440d6bc1ab5067fb14f88, role_id=e04fe3eb1f714d74901ac83e33ea8a16)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:52.884270 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898c64c7-57a5-4ed7-b881-bf4dec081d9a None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:52.989701 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 598/1192] 10.222.0.62 () {58 vars in 1439 bytes} [Fri May 27 16:10:52 2022] PUT /identity/v3/projects/6d2fc10a26714fbaacceaeab3a290f63/users/4b6839c77cf440d6bc1ab5067fb14f88/roles/e04fe3eb1f714d74901ac83e33ea8a16 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:10:55.147452 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10850509-21a6-454c-a966-307da27a7830 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:55.147963 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10850509-21a6-454c-a966-307da27a7830 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:55.147963 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10850509-21a6-454c-a966-307da27a7830 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:55.149286 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 595/1193] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:10:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:10:55.154781 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f69f08-5ec8-4068-8328-0f3d39ac10f9 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:55.155210 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f69f08-5ec8-4068-8328-0f3d39ac10f9 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:55.155344 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f69f08-5ec8-4068-8328-0f3d39ac10f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:55.173191 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-98f69f08-5ec8-4068-8328-0f3d39ac10f9 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:10:55.174405 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-98f69f08-5ec8-4068-8328-0f3d39ac10f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:10:55.238204 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 599/1194] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:10:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:10:55.261821 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10850509-21a6-454c-a966-307da27a7830 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:55.292975 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:55.361752 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10850509-21a6-454c-a966-307da27a7830 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:55.394484 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9c7da1-6b3b-4d3c-8cbb-786f17485606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:55.395270 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c7da1-6b3b-4d3c-8cbb-786f17485606 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:55.395554 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c7da1-6b3b-4d3c-8cbb-786f17485606 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:55.395832 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c7da1-6b3b-4d3c-8cbb-786f17485606 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:55.405692 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9c7da1-6b3b-4d3c-8cbb-786f17485606 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:10:55.413237 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-4b9c7da1-6b3b-4d3c-8cbb-786f17485606 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:10:55.413237 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:10:55.413237 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:10:55.413237 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:10:55.413237 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:10:55.413237 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:10:55.413237 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:10:55.413237 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:10:55.413237 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:10:55.413237 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:10:55.413237 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:10:55.413237 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:10:55.413237 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:10:55.413237 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:10:55.413237 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:10:55.413237 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:10:55.414344 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:10:55.414344 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:10:55.414344 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:10:55.414344 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:10:55.414344 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:10:55.414344 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:10:55.414344 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:10:55.414344 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:10:55.414344 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:10:55.414344 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:10:55.414344 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:10:55.414344 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:10:55.414344 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:10:55.414344 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:10:55.414344 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:10:55.414344 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:10:55.415636 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:10:55.415636 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:10:55.415636 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:10:55.415636 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:10:55.415636 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:10:55.415636 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:10:55.415636 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:10:55.415636 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:10:55.415636 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:10:55.415636 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:10:55.415636 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:10:55.415636 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:10:55.415636 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 596/1195] 10.222.0.62 () {56 vars in 1096 bytes} [Fri May 27 16:10:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:10:55.420297 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f69f08-5ec8-4068-8328-0f3d39ac10f9 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:55.514030 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:55.516914 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f69f08-5ec8-4068-8328-0f3d39ac10f9 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:55.549724 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2c6c85-6954-4123-a703-ccb250a4aa05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:55.550409 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c6c85-6954-4123-a703-ccb250a4aa05 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:55.550698 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c6c85-6954-4123-a703-ccb250a4aa05 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:55.550976 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c6c85-6954-4123-a703-ccb250a4aa05 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:55.551716 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2c6c85-6954-4123-a703-ccb250a4aa05 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:10:55.552029 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2c6c85-6954-4123-a703-ccb250a4aa05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:55.553401 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2c6c85-6954-4123-a703-ccb250a4aa05 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:55.561562 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 600/1196] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 16:10:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:10:55.567843 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9c7da1-6b3b-4d3c-8cbb-786f17485606 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:55.656412 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:55.665537 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9c7da1-6b3b-4d3c-8cbb-786f17485606 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:55.699959 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34f450f-3adc-4d8d-9fcd-1bc3188c1b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:55.700826 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f450f-3adc-4d8d-9fcd-1bc3188c1b1b None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:55.701111 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f450f-3adc-4d8d-9fcd-1bc3188c1b1b None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:55.701388 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f450f-3adc-4d8d-9fcd-1bc3188c1b1b None admin] PATH_INFO: `/v3/users/4b6839c77cf440d6bc1ab5067fb14f88` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:55.702588 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34f450f-3adc-4d8d-9fcd-1bc3188c1b1b None admin] RBAC: Authorizing `identity:get_user(user_id=4b6839c77cf440d6bc1ab5067fb14f88)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:55.704076 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34f450f-3adc-4d8d-9fcd-1bc3188c1b1b None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:55.705673 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 597/1197] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 16:10:55 2022] GET /identity/v3/users/4b6839c77cf440d6bc1ab5067fb14f88 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:10:55.711497 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2c6c85-6954-4123-a703-ccb250a4aa05 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:55.808172 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2c6c85-6954-4123-a703-ccb250a4aa05 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:55.842827 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b1da93-5966-493a-a0e8-7fbbd4c7ad4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:55.843468 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1da93-5966-493a-a0e8-7fbbd4c7ad4f None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:55.843752 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1da93-5966-493a-a0e8-7fbbd4c7ad4f None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:55.844564 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1da93-5966-493a-a0e8-7fbbd4c7ad4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:55.873934 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:55.912312 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b1da93-5966-493a-a0e8-7fbbd4c7ad4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:55.913684 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b1da93-5966-493a-a0e8-7fbbd4c7ad4f None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:56.008423 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 601/1198] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 16:10:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 16:10:56.014257 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34f450f-3adc-4d8d-9fcd-1bc3188c1b1b None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:56.110918 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34f450f-3adc-4d8d-9fcd-1bc3188c1b1b None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:56.143297 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ae2d71-d739-43bb-b973-6de3a44152b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:56.144141 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae2d71-d739-43bb-b973-6de3a44152b5 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:56.144426 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae2d71-d739-43bb-b973-6de3a44152b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:56.144705 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae2d71-d739-43bb-b973-6de3a44152b5 None admin] PATH_INFO: `/v3/projects/6d2fc10a26714fbaacceaeab3a290f63` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:56.145867 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ae2d71-d739-43bb-b973-6de3a44152b5 None admin] RBAC: Authorizing `identity:get_project(project_id=6d2fc10a26714fbaacceaeab3a290f63)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:56.147320 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ae2d71-d739-43bb-b973-6de3a44152b5 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:56.148971 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 598/1199] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 16:10:56 2022] GET /identity/v3/projects/6d2fc10a26714fbaacceaeab3a290f63 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:10:56.154857 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b1da93-5966-493a-a0e8-7fbbd4c7ad4f None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:10:56.224318 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:10:56.261272 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b1da93-5966-493a-a0e8-7fbbd4c7ad4f None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:10:56.294999 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c29e7b-3f17-4830-b57c-deb9bf8ebf08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:10:56.295644 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c29e7b-3f17-4830-b57c-deb9bf8ebf08 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:10:56.296187 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c29e7b-3f17-4830-b57c-deb9bf8ebf08 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:10:56.296462 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c29e7b-3f17-4830-b57c-deb9bf8ebf08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:10:56.297301 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c29e7b-3f17-4830-b57c-deb9bf8ebf08 None admin] RBAC: Adding query filter params (role.id=e04fe3eb1f714d74901ac83e33ea8a16, scope.project.id=6d2fc10a26714fbaacceaeab3a290f63, user.id=4b6839c77cf440d6bc1ab5067fb14f88) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:10:56.297663 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c29e7b-3f17-4830-b57c-deb9bf8ebf08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:10:56.299098 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c29e7b-3f17-4830-b57c-deb9bf8ebf08 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:10:56.304886 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 602/1200] 10.222.0.62 () {56 vars in 1374 bytes} [Fri May 27 16:10:56 2022] GET /identity/v3/role_assignments?user.id=4b6839c77cf440d6bc1ab5067fb14f88&scope.project.id=6d2fc10a26714fbaacceaeab3a290f63&role.id=e04fe3eb1f714d74901ac83e33ea8a16 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:11:06.139263 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=87 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:11:06.302181 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=37 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:12:21.894482 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e808160-8dd0-4931-b5b1-3baf6f1e108b None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:21.894982 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e808160-8dd0-4931-b5b1-3baf6f1e108b None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:21.895081 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e808160-8dd0-4931-b5b1-3baf6f1e108b None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:21.896445 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 599/1201] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:12:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:12:21.901691 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e4723-d755-47e3-911d-7fbbe1e3386e None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:21.902221 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e4723-d755-47e3-911d-7fbbe1e3386e None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:21.902221 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e4723-d755-47e3-911d-7fbbe1e3386e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:21.919154 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-1e1e4723-d755-47e3-911d-7fbbe1e3386e None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:12:21.920347 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-1e1e4723-d755-47e3-911d-7fbbe1e3386e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:12:21.989367 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 603/1202] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:12:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:12:22.020332 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e808160-8dd0-4931-b5b1-3baf6f1e108b None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:12:22.120499 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e808160-8dd0-4931-b5b1-3baf6f1e108b None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:12:22.155526 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0804dd4-cd06-4f50-a3bd-f84575b2f2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:12:22.156314 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0804dd4-cd06-4f50-a3bd-f84575b2f2ee None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:22.156593 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0804dd4-cd06-4f50-a3bd-f84575b2f2ee None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:22.156863 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0804dd4-cd06-4f50-a3bd-f84575b2f2ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:22.167324 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0804dd4-cd06-4f50-a3bd-f84575b2f2ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:12:22.168778 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0804dd4-cd06-4f50-a3bd-f84575b2f2ee None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:12:22.186407 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-e0804dd4-cd06-4f50-a3bd-f84575b2f2ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:12:22.186407 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:12:22.186407 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:12:22.186407 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:12:22.186407 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:12:22.186407 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:12:22.186407 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:12:22.186407 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:12:22.186407 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:12:22.186407 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:12:22.186407 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:12:22.186407 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:12:22.186407 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:12:22.186407 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:12:22.186407 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:12:22.187558 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:12:22.187558 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:12:22.187558 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:12:22.187558 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:12:22.187558 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:12:22.187558 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:12:22.187558 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:12:22.187558 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:12:22.187558 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:12:22.187558 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:12:22.187558 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:12:22.187558 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:12:22.187558 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:12:22.187558 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:12:22.187558 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:12:22.187558 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:12:22.187558 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:12:22.188557 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:12:22.188557 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:12:22.188557 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:12:22.188557 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:12:22.188557 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 600/1203] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:12:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:12:22.193959 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1e4723-d755-47e3-911d-7fbbe1e3386e None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:12:22.293147 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1e4723-d755-47e3-911d-7fbbe1e3386e None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:12:22.325516 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:12:22.333756 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004b5505-12b3-47b4-9916-475722be14d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:12:22.334916 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b5505-12b3-47b4-9916-475722be14d4 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:22.335385 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b5505-12b3-47b4-9916-475722be14d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:22.335827 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b5505-12b3-47b4-9916-475722be14d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:22.337404 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004b5505-12b3-47b4-9916-475722be14d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:12:22.337715 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004b5505-12b3-47b4-9916-475722be14d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:12:22.339170 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004b5505-12b3-47b4-9916-475722be14d4 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:12:22.351182 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 604/1204] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 16:12:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:12:22.356743 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0804dd4-cd06-4f50-a3bd-f84575b2f2ee None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:12:22.409050 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:12:22.454221 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0804dd4-cd06-4f50-a3bd-f84575b2f2ee None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:12:22.490314 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46787ad6-d641-4ed1-8094-79ccd2a7955c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:12:22.490991 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46787ad6-d641-4ed1-8094-79ccd2a7955c None admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:22.491277 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46787ad6-d641-4ed1-8094-79ccd2a7955c None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:22.491554 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46787ad6-d641-4ed1-8094-79ccd2a7955c None admin] PATH_INFO: `/v3/users` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:22.492259 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46787ad6-d641-4ed1-8094-79ccd2a7955c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:12:22.493689 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46787ad6-d641-4ed1-8094-79ccd2a7955c None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:12:22.649281 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 601/1205] 10.222.0.62 () {60 vars in 1132 bytes} [Fri May 27 16:12:22 2022] POST /identity/v3/users => generated 251 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:12:24.894780 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de48bbc-961f-46c0-bf4e-579936bce7a7 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:24.895246 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de48bbc-961f-46c0-bf4e-579936bce7a7 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:24.895470 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de48bbc-961f-46c0-bf4e-579936bce7a7 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:24.896832 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 605/1206] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:12:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:12:24.902655 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcfd3ad-026e-431e-8915-7e2b398ffbaa None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:24.903074 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcfd3ad-026e-431e-8915-7e2b398ffbaa None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:24.903218 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcfd3ad-026e-431e-8915-7e2b398ffbaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:24.921388 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-fdcfd3ad-026e-431e-8915-7e2b398ffbaa None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:12:24.922607 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-fdcfd3ad-026e-431e-8915-7e2b398ffbaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:12:24.988433 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 602/1207] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:12:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:12:25.011965 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de48bbc-961f-46c0-bf4e-579936bce7a7 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:12:25.114266 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de48bbc-961f-46c0-bf4e-579936bce7a7 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:12:25.147189 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c615c7-9762-4030-9b8f-06170390604b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:12:25.147918 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c615c7-9762-4030-9b8f-06170390604b None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:25.148208 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c615c7-9762-4030-9b8f-06170390604b None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:25.148489 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c615c7-9762-4030-9b8f-06170390604b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:25.163683 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c615c7-9762-4030-9b8f-06170390604b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:12:25.172704 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-a0c615c7-9762-4030-9b8f-06170390604b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 16:12:25.172704 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:12:25.172704 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:12:25.172704 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:12:25.172704 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:12:25.172704 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:12:25.172704 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:12:25.172704 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:12:25.172704 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:12:25.172704 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:12:25.172704 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:12:25.172704 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:12:25.172704 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:12:25.172704 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:12:25.172704 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:12:25.172704 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:12:25.176001 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:12:25.176001 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:12:25.176001 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:12:25.176001 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:12:25.176001 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:12:25.176001 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:12:25.176001 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:12:25.176001 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:12:25.176001 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:12:25.176001 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:12:25.176001 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:12:25.176001 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:12:25.176001 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:12:25.176001 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:12:25.176001 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:12:25.176001 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:12:25.177051 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:12:25.177051 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:12:25.177051 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:12:25.177051 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:12:25.177051 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:12:25.177051 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:12:25.177051 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:12:25.177051 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:12:25.177051 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:12:25.177051 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:12:25.177051 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 16:12:25.177051 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:12:25.177051 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 606/1208] 10.222.0.62 () {56 vars in 1102 bytes} [Fri May 27 16:12:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:12:25.180069 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcfd3ad-026e-431e-8915-7e2b398ffbaa None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:12:25.220032 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:12:25.278303 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcfd3ad-026e-431e-8915-7e2b398ffbaa None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:12:25.310752 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af04bb97-8dc9-4180-a02d-5d58424a5249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:12:25.311414 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af04bb97-8dc9-4180-a02d-5d58424a5249 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:25.311697 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af04bb97-8dc9-4180-a02d-5d58424a5249 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:25.311973 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af04bb97-8dc9-4180-a02d-5d58424a5249 None admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:25.312720 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af04bb97-8dc9-4180-a02d-5d58424a5249 None admin] RBAC: Adding query filter params (name=service) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:12:25.313030 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af04bb97-8dc9-4180-a02d-5d58424a5249 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:12:25.314432 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af04bb97-8dc9-4180-a02d-5d58424a5249 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:12:25.322620 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 603/1209] 10.222.0.62 () {56 vars in 1103 bytes} [Fri May 27 16:12:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:12:25.329606 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c615c7-9762-4030-9b8f-06170390604b None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:12:25.378232 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:12:25.427519 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c615c7-9762-4030-9b8f-06170390604b None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:12:25.460143 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f5afe7-65f4-40ff-830f-d5ac294cac72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:12:25.460925 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5afe7-65f4-40ff-830f-d5ac294cac72 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:25.461243 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5afe7-65f4-40ff-830f-d5ac294cac72 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:25.461518 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5afe7-65f4-40ff-830f-d5ac294cac72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:25.471962 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f5afe7-65f4-40ff-830f-d5ac294cac72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:12:25.473388 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f5afe7-65f4-40ff-830f-d5ac294cac72 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:12:25.491373 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-d0f5afe7-65f4-40ff-830f-d5ac294cac72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:12:25.491373 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:12:25.491373 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:12:25.491373 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:12:25.491373 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:12:25.491373 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:12:25.491373 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:12:25.491373 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:12:25.491373 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:12:25.491373 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:12:25.491373 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:12:25.491373 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:12:25.491373 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:12:25.491373 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:12:25.491373 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:12:25.492466 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:12:25.492466 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:12:25.492466 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:12:25.492466 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:12:25.492466 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:12:25.492466 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:12:25.492466 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:12:25.492466 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:12:25.492466 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:12:25.492466 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:12:25.492466 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:12:25.492466 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:12:25.492466 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:12:25.492466 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:12:25.492466 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:12:25.492466 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:12:25.492466 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:12:25.493758 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:12:25.493758 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:12:25.493758 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:12:25.493758 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:12:25.493758 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 607/1210] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:12:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:12:25.498391 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af04bb97-8dc9-4180-a02d-5d58424a5249 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:12:25.594563 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:12:25.597407 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af04bb97-8dc9-4180-a02d-5d58424a5249 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:12:25.630042 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d759e40-ab00-4a31-9554-284ef339c09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:12:25.630727 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d759e40-ab00-4a31-9554-284ef339c09e None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:25.631018 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d759e40-ab00-4a31-9554-284ef339c09e None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:25.631296 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d759e40-ab00-4a31-9554-284ef339c09e None admin] PATH_INFO: `/v3/domains` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:25.632020 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d759e40-ab00-4a31-9554-284ef339c09e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:12:25.632329 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d759e40-ab00-4a31-9554-284ef339c09e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:12:25.634311 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d759e40-ab00-4a31-9554-284ef339c09e None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:12:25.645202 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 604/1211] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 16:12:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:12:25.650855 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f5afe7-65f4-40ff-830f-d5ac294cac72 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:12:25.748709 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f5afe7-65f4-40ff-830f-d5ac294cac72 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:12:25.750152 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:12:25.784409 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41f63a1-24c2-475a-b090-e095ca78a913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:12:25.785205 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f63a1-24c2-475a-b090-e095ca78a913 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:25.785481 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f63a1-24c2-475a-b090-e095ca78a913 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:25.785750 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f63a1-24c2-475a-b090-e095ca78a913 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:25.793818 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41f63a1-24c2-475a-b090-e095ca78a913 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:12:25.795293 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41f63a1-24c2-475a-b090-e095ca78a913 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:12:25.810894 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-d41f63a1-24c2-475a-b090-e095ca78a913 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 27 16:12:25.810894 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:12:25.810894 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:12:25.810894 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:12:25.810894 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:12:25.810894 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:12:25.810894 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:12:25.810894 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:12:25.810894 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:12:25.810894 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:12:25.810894 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:12:25.810894 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:12:25.810894 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 16:12:25.810894 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 16:12:25.810894 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 16:12:25.810894 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 16:12:25.816404 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:12:25.816404 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:12:25.816404 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 16:12:25.816404 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:12:25.816404 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 16:12:25.816404 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:12:25.816404 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:12:25.816404 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:12:25.816404 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:12:25.816404 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:12:25.816404 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:12:25.816404 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:12:25.816404 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:12:25.816404 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:12:25.816404 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:12:25.816404 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:12:25.816404 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:12:25.816404 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:12:25.817699 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:12:25.817699 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:12:25.817699 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 16:12:25.817699 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 16:12:25.817699 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 16:12:25.817699 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 16:12:25.817699 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 16:12:25.817699 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 16:12:25.817699 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 27 16:12:25.817699 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:12:25.817699 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 608/1212] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:12:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:12:25.818523 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d759e40-ab00-4a31-9554-284ef339c09e None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:12:25.917377 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d759e40-ab00-4a31-9554-284ef339c09e None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:12:25.950954 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a924a17-d6dc-4c77-aac3-bd896eb30a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:12:25.951632 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a924a17-d6dc-4c77-aac3-bd896eb30a9a None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:25.952939 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a924a17-d6dc-4c77-aac3-bd896eb30a9a None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:25.952939 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a924a17-d6dc-4c77-aac3-bd896eb30a9a None admin] PATH_INFO: `/v3/users` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:25.954002 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a924a17-d6dc-4c77-aac3-bd896eb30a9a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:12:25.954002 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a924a17-d6dc-4c77-aac3-bd896eb30a9a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:12:25.954741 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a924a17-d6dc-4c77-aac3-bd896eb30a9a None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:12:25.972059 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 605/1213] 10.222.0.62 () {56 vars in 1143 bytes} [Fri May 27 16:12:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:12:25.978275 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41f63a1-24c2-475a-b090-e095ca78a913 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:12:26.077745 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41f63a1-24c2-475a-b090-e095ca78a913 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:12:26.110840 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0990ca0-4e05-4ce5-bd94-86aade9d5e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:12:26.111485 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0990ca0-4e05-4ce5-bd94-86aade9d5e6f None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:26.111773 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0990ca0-4e05-4ce5-bd94-86aade9d5e6f None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:26.112052 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0990ca0-4e05-4ce5-bd94-86aade9d5e6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:26.143296 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:12:26.182500 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0990ca0-4e05-4ce5-bd94-86aade9d5e6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:12:26.183991 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0990ca0-4e05-4ce5-bd94-86aade9d5e6f None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:12:26.278759 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 609/1214] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 16:12:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 27 16:12:26.284732 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a924a17-d6dc-4c77-aac3-bd896eb30a9a None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:12:26.304143 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:12:26.384201 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a924a17-d6dc-4c77-aac3-bd896eb30a9a None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:12:26.417553 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6af0cf-65e6-4c8e-97aa-f1dd81046297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:12:26.418365 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6af0cf-65e6-4c8e-97aa-f1dd81046297 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:26.418651 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6af0cf-65e6-4c8e-97aa-f1dd81046297 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:26.418926 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6af0cf-65e6-4c8e-97aa-f1dd81046297 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:26.429127 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6af0cf-65e6-4c8e-97aa-f1dd81046297 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:12:26.430635 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6af0cf-65e6-4c8e-97aa-f1dd81046297 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:12:26.448564 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-6c6af0cf-65e6-4c8e-97aa-f1dd81046297 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:12:26.448564 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:12:26.448564 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:12:26.448564 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:12:26.448564 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:12:26.448564 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:12:26.448564 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:12:26.448564 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:12:26.448564 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:12:26.448564 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:12:26.448564 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:12:26.448564 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:12:26.448564 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:12:26.448564 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:12:26.448564 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:12:26.449570 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:12:26.449570 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:12:26.449570 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:12:26.449570 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:12:26.449570 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:12:26.449570 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:12:26.449570 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:12:26.449570 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:12:26.449570 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:12:26.449570 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:12:26.449570 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:12:26.449570 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:12:26.449570 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:12:26.449570 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:12:26.449570 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:12:26.449570 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:12:26.449570 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:12:26.450535 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:12:26.450535 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:12:26.450535 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:12:26.450535 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:12:26.450535 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 606/1215] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:12:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:12:26.455707 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0990ca0-4e05-4ce5-bd94-86aade9d5e6f None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:12:26.514881 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:12:26.552004 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0990ca0-4e05-4ce5-bd94-86aade9d5e6f None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:12:26.584051 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da54b41-55bb-4ac1-877a-33062469da89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:12:26.584705 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da54b41-55bb-4ac1-877a-33062469da89 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:26.584990 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da54b41-55bb-4ac1-877a-33062469da89 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:26.585268 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da54b41-55bb-4ac1-877a-33062469da89 None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:26.585984 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da54b41-55bb-4ac1-877a-33062469da89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:12:26.586329 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da54b41-55bb-4ac1-877a-33062469da89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:12:26.588238 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da54b41-55bb-4ac1-877a-33062469da89 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:12:26.598958 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 610/1216] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 16:12:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:12:26.605166 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6af0cf-65e6-4c8e-97aa-f1dd81046297 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:12:26.672788 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:12:26.702001 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6af0cf-65e6-4c8e-97aa-f1dd81046297 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:12:26.734770 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00eee3c-3505-4700-9fe2-255d4b45ea92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:12:26.735551 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00eee3c-3505-4700-9fe2-255d4b45ea92 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:26.735831 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00eee3c-3505-4700-9fe2-255d4b45ea92 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:26.736103 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00eee3c-3505-4700-9fe2-255d4b45ea92 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:26.742597 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00eee3c-3505-4700-9fe2-255d4b45ea92 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:12:26.744045 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00eee3c-3505-4700-9fe2-255d4b45ea92 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:12:26.757647 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-e00eee3c-3505-4700-9fe2-255d4b45ea92 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:12:26.757647 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:12:26.757647 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:12:26.757647 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:12:26.757647 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:12:26.757647 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:12:26.757647 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:12:26.757647 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:12:26.757647 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:12:26.757647 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:12:26.757647 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:12:26.757647 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:12:26.757647 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 16:12:26.757647 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 16:12:26.757647 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 16:12:26.759312 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 16:12:26.759312 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:12:26.759312 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:12:26.759312 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:12:26.759312 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:12:26.759312 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:12:26.759312 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:12:26.759312 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:12:26.759312 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:12:26.759312 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:12:26.759312 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:12:26.759312 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:12:26.759312 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:12:26.759312 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:12:26.759312 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:12:26.759312 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:12:26.759312 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:12:26.760368 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 16:12:26.760368 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 16:12:26.760368 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 16:12:26.760368 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 16:12:26.760368 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 16:12:26.760368 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 16:12:26.760368 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:12:26.760368 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:12:26.760368 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 607/1217] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 16:12:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:12:26.765280 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da54b41-55bb-4ac1-877a-33062469da89 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:12:26.862866 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da54b41-55bb-4ac1-877a-33062469da89 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:12:26.886619 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:12:26.898042 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a722ffb7-758a-47ea-8582-3b6db3610942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:12:26.898758 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722ffb7-758a-47ea-8582-3b6db3610942 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:26.899103 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722ffb7-758a-47ea-8582-3b6db3610942 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:26.899993 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722ffb7-758a-47ea-8582-3b6db3610942 None admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:26.900811 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a722ffb7-758a-47ea-8582-3b6db3610942 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:12:26.901151 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a722ffb7-758a-47ea-8582-3b6db3610942 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:12:26.902626 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a722ffb7-758a-47ea-8582-3b6db3610942 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:12:26.914340 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 611/1218] 10.222.0.62 () {56 vars in 1148 bytes} [Fri May 27 16:12:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:12:26.920703 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00eee3c-3505-4700-9fe2-255d4b45ea92 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:12:27.020736 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00eee3c-3505-4700-9fe2-255d4b45ea92 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:12:27.049078 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:12:27.054763 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d393eb-5e14-4a64-b909-028db1b257ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:12:27.055929 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d393eb-5e14-4a64-b909-028db1b257ef None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:27.056213 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d393eb-5e14-4a64-b909-028db1b257ef None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:27.056488 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d393eb-5e14-4a64-b909-028db1b257ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:27.057319 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d393eb-5e14-4a64-b909-028db1b257ef None admin] RBAC: Adding query filter params (role.id=1d9076bd231c43809cb971b6360e0c28, scope.project.id=d48d95a12587479ca5714f6ebd60dd9f, user.id=35d98c4a2af546d8b655d649d655f447) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:12:27.057631 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d393eb-5e14-4a64-b909-028db1b257ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:12:27.059082 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d393eb-5e14-4a64-b909-028db1b257ef None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:12:27.064456 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 608/1219] 10.222.0.62 () {56 vars in 1374 bytes} [Fri May 27 16:12:26 2022] GET /identity/v3/role_assignments?user.id=35d98c4a2af546d8b655d649d655f447&scope.project.id=d48d95a12587479ca5714f6ebd60dd9f&role.id=1d9076bd231c43809cb971b6360e0c28 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:12:29.220149 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f246d4b8-5100-4546-bbaa-c6107c71d6c9 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:29.220671 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f246d4b8-5100-4546-bbaa-c6107c71d6c9 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:29.220671 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f246d4b8-5100-4546-bbaa-c6107c71d6c9 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:29.222058 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 612/1220] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:12:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:12:29.227414 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d59f2c-fc8b-416c-8521-89385d13387f None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:29.227857 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d59f2c-fc8b-416c-8521-89385d13387f None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:29.230512 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d59f2c-fc8b-416c-8521-89385d13387f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:29.244818 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-e5d59f2c-fc8b-416c-8521-89385d13387f None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:12:29.246029 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-e5d59f2c-fc8b-416c-8521-89385d13387f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:12:29.313226 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 609/1221] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:12:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:12:29.336378 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f246d4b8-5100-4546-bbaa-c6107c71d6c9 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:12:29.437817 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f246d4b8-5100-4546-bbaa-c6107c71d6c9 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:12:29.470863 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859b5d31-204f-409a-b999-50ec77e2ebac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:12:29.471595 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b5d31-204f-409a-b999-50ec77e2ebac None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:29.471887 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b5d31-204f-409a-b999-50ec77e2ebac None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:29.472165 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b5d31-204f-409a-b999-50ec77e2ebac None admin] PATH_INFO: `/v3/roles/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:29.482097 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859b5d31-204f-409a-b999-50ec77e2ebac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:12:29.489886 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-859b5d31-204f-409a-b999-50ec77e2ebac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 16:12:29.489886 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:12:29.489886 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:12:29.489886 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:12:29.489886 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:12:29.489886 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:12:29.489886 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:12:29.489886 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:12:29.489886 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:12:29.489886 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:12:29.489886 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:12:29.489886 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:12:29.489886 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:12:29.489886 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:12:29.489886 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:12:29.489886 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:12:29.491082 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:12:29.491082 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:12:29.491082 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:12:29.491082 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:12:29.491082 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:12:29.491082 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:12:29.491082 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:12:29.491082 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:12:29.491082 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:12:29.491082 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:12:29.491082 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:12:29.491082 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:12:29.491082 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:12:29.491082 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:12:29.491082 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:12:29.491082 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:12:29.492149 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:12:29.492149 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:12:29.492149 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:12:29.492149 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:12:29.492149 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:12:29.492149 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:12:29.492149 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:12:29.492149 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:12:29.492149 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:12:29.492149 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:12:29.492149 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 16:12:29.492149 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:12:29.492149 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 613/1222] 10.222.0.62 () {56 vars in 1102 bytes} [Fri May 27 16:12:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:12:29.497500 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d59f2c-fc8b-416c-8521-89385d13387f None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:12:29.596977 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d59f2c-fc8b-416c-8521-89385d13387f None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:12:29.619830 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:12:29.630030 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c1549e-15e5-4782-9e31-642997d61984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:12:29.630724 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1549e-15e5-4782-9e31-642997d61984 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:29.631004 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1549e-15e5-4782-9e31-642997d61984 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:29.631277 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1549e-15e5-4782-9e31-642997d61984 None admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:29.632057 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c1549e-15e5-4782-9e31-642997d61984 None admin] RBAC: Adding query filter params (name=service) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:12:29.632359 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c1549e-15e5-4782-9e31-642997d61984 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:12:29.634325 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c1549e-15e5-4782-9e31-642997d61984 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:12:29.642318 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 610/1223] 10.222.0.62 () {56 vars in 1103 bytes} [Fri May 27 16:12:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:12:29.648283 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859b5d31-204f-409a-b999-50ec77e2ebac None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:12:29.690700 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:12:29.752067 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859b5d31-204f-409a-b999-50ec77e2ebac None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:12:29.779682 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4864e6f0-c94e-4eee-9f17-9fd9e710ea82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:12:29.780467 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4864e6f0-c94e-4eee-9f17-9fd9e710ea82 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:29.780757 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4864e6f0-c94e-4eee-9f17-9fd9e710ea82 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:29.781035 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4864e6f0-c94e-4eee-9f17-9fd9e710ea82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:29.792809 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4864e6f0-c94e-4eee-9f17-9fd9e710ea82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:12:29.794372 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4864e6f0-c94e-4eee-9f17-9fd9e710ea82 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:12:29.812040 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-4864e6f0-c94e-4eee-9f17-9fd9e710ea82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:12:29.812040 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:12:29.812040 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:12:29.812040 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:12:29.812040 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:12:29.812040 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:12:29.812040 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:12:29.812040 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:12:29.812040 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:12:29.812040 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:12:29.812040 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:12:29.812040 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:12:29.812040 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:12:29.812040 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:12:29.812040 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:12:29.813137 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:12:29.813137 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:12:29.813137 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:12:29.813137 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:12:29.813137 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:12:29.813137 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:12:29.813137 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:12:29.813137 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:12:29.813137 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:12:29.813137 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:12:29.813137 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:12:29.813137 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:12:29.813137 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:12:29.813137 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:12:29.813137 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:12:29.813137 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:12:29.813137 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:12:29.814111 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:12:29.814111 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:12:29.814111 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:12:29.814111 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:12:29.814111 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 614/1224] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:12:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:12:29.819253 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c1549e-15e5-4782-9e31-642997d61984 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:12:29.917787 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c1549e-15e5-4782-9e31-642997d61984 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:12:29.950660 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ac0192-b1a5-4e2f-920d-5be8dbb6a392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:12:29.951314 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac0192-b1a5-4e2f-920d-5be8dbb6a392 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:29.951594 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac0192-b1a5-4e2f-920d-5be8dbb6a392 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:29.951869 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac0192-b1a5-4e2f-920d-5be8dbb6a392 None admin] PATH_INFO: `/v3/domains` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:29.952589 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ac0192-b1a5-4e2f-920d-5be8dbb6a392 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:12:29.952902 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ac0192-b1a5-4e2f-920d-5be8dbb6a392 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:12:29.954279 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ac0192-b1a5-4e2f-920d-5be8dbb6a392 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:12:29.966719 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 611/1225] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 16:12:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:12:29.972410 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4864e6f0-c94e-4eee-9f17-9fd9e710ea82 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:12:30.064360 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:12:30.071364 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4864e6f0-c94e-4eee-9f17-9fd9e710ea82 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:12:30.103735 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0824e31b-43aa-4118-b918-8a821b0efbbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:12:30.105041 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0824e31b-43aa-4118-b918-8a821b0efbbd None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:30.105041 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0824e31b-43aa-4118-b918-8a821b0efbbd None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:30.105286 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0824e31b-43aa-4118-b918-8a821b0efbbd None admin] PATH_INFO: `/v3/users/placement` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:30.112270 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0824e31b-43aa-4118-b918-8a821b0efbbd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:12:30.113705 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0824e31b-43aa-4118-b918-8a821b0efbbd None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:12:30.128164 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-0824e31b-43aa-4118-b918-8a821b0efbbd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 27 16:12:30.128164 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:12:30.128164 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:12:30.128164 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:12:30.128164 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:12:30.128164 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:12:30.128164 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:12:30.128164 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:12:30.128164 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:12:30.128164 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:12:30.128164 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:12:30.128164 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:12:30.128164 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 16:12:30.128164 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 16:12:30.128164 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 16:12:30.128164 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 16:12:30.129216 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:12:30.129216 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:12:30.129216 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 16:12:30.129216 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:12:30.129216 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 16:12:30.129216 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:12:30.129216 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:12:30.129216 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:12:30.129216 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:12:30.129216 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:12:30.129216 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:12:30.129216 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:12:30.129216 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:12:30.129216 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:12:30.129216 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:12:30.129216 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:12:30.129216 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:12:30.129216 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:12:30.130174 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:12:30.130174 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:12:30.130174 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 16:12:30.130174 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 16:12:30.130174 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 16:12:30.130174 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 16:12:30.130174 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 16:12:30.130174 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 16:12:30.130174 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 27 16:12:30.130174 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:12:30.130174 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 615/1226] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:12:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:12:30.135815 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ac0192-b1a5-4e2f-920d-5be8dbb6a392 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:12:30.186015 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:12:30.236077 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ac0192-b1a5-4e2f-920d-5be8dbb6a392 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:12:30.269458 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e437ec-8fa1-428c-82e2-a82a9b05c7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:12:30.270122 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e437ec-8fa1-428c-82e2-a82a9b05c7ee None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:30.270452 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e437ec-8fa1-428c-82e2-a82a9b05c7ee None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:30.270749 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e437ec-8fa1-428c-82e2-a82a9b05c7ee None admin] PATH_INFO: `/v3/users` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:30.271570 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e437ec-8fa1-428c-82e2-a82a9b05c7ee None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:12:30.271882 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e437ec-8fa1-428c-82e2-a82a9b05c7ee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:12:30.273316 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e437ec-8fa1-428c-82e2-a82a9b05c7ee None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:12:30.289852 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 612/1227] 10.222.0.62 () {56 vars in 1143 bytes} [Fri May 27 16:12:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:12:30.295720 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0824e31b-43aa-4118-b918-8a821b0efbbd None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:12:30.395192 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0824e31b-43aa-4118-b918-8a821b0efbbd None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:12:30.428107 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef72046c-1a35-4941-a3a0-f8a712697bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:12:30.428887 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef72046c-1a35-4941-a3a0-f8a712697bc4 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:30.429170 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef72046c-1a35-4941-a3a0-f8a712697bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:30.429445 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef72046c-1a35-4941-a3a0-f8a712697bc4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:30.440218 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef72046c-1a35-4941-a3a0-f8a712697bc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:12:30.441657 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef72046c-1a35-4941-a3a0-f8a712697bc4 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:12:30.459347 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-ef72046c-1a35-4941-a3a0-f8a712697bc4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:12:30.459347 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:12:30.459347 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:12:30.459347 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:12:30.459347 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:12:30.459347 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:12:30.459347 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:12:30.459347 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:12:30.459347 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:12:30.459347 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:12:30.459347 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:12:30.459347 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:12:30.459347 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:12:30.459347 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:12:30.459347 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:12:30.460378 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:12:30.460378 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:12:30.460378 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:12:30.460378 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:12:30.460378 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:12:30.460378 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:12:30.460378 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:12:30.460378 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:12:30.460378 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:12:30.460378 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:12:30.460378 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:12:30.460378 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:12:30.460378 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:12:30.460378 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:12:30.460378 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:12:30.460378 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:12:30.460378 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:12:30.461430 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:12:30.461430 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:12:30.461430 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:12:30.461430 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:12:30.461430 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 616/1228] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:12:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:12:30.466209 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e437ec-8fa1-428c-82e2-a82a9b05c7ee None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:12:30.564595 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e437ec-8fa1-428c-82e2-a82a9b05c7ee None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:12:30.566926 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:12:30.597102 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79286f0e-c30e-440e-a2d2-883831ae618c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:12:30.597754 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79286f0e-c30e-440e-a2d2-883831ae618c None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:30.602848 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79286f0e-c30e-440e-a2d2-883831ae618c None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:30.602848 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79286f0e-c30e-440e-a2d2-883831ae618c None admin] PATH_INFO: `/v3/domains` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:30.602848 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79286f0e-c30e-440e-a2d2-883831ae618c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:12:30.602848 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79286f0e-c30e-440e-a2d2-883831ae618c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:12:30.602848 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79286f0e-c30e-440e-a2d2-883831ae618c None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:12:30.612105 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 613/1229] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 16:12:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:12:30.618396 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef72046c-1a35-4941-a3a0-f8a712697bc4 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:12:30.627756 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:12:30.717074 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef72046c-1a35-4941-a3a0-f8a712697bc4 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:12:30.750187 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978dc9c0-f21b-4214-b546-cd66b35b4244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:12:30.751033 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978dc9c0-f21b-4214-b546-cd66b35b4244 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:30.751321 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978dc9c0-f21b-4214-b546-cd66b35b4244 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:30.751602 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978dc9c0-f21b-4214-b546-cd66b35b4244 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:30.758091 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978dc9c0-f21b-4214-b546-cd66b35b4244 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:12:30.759597 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978dc9c0-f21b-4214-b546-cd66b35b4244 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:12:30.773566 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-978dc9c0-f21b-4214-b546-cd66b35b4244 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:12:30.773566 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:12:30.773566 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:12:30.773566 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:12:30.773566 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:12:30.773566 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:12:30.773566 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:12:30.773566 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:12:30.773566 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:12:30.773566 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:12:30.773566 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:12:30.773566 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:12:30.773566 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 16:12:30.773566 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 16:12:30.773566 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 16:12:30.774653 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 16:12:30.774653 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:12:30.774653 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:12:30.774653 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:12:30.774653 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:12:30.774653 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:12:30.774653 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:12:30.774653 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:12:30.774653 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:12:30.774653 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:12:30.774653 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:12:30.774653 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:12:30.774653 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:12:30.774653 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:12:30.774653 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:12:30.774653 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:12:30.774653 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:12:30.775619 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 16:12:30.775619 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 16:12:30.775619 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 16:12:30.775619 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 16:12:30.775619 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 16:12:30.775619 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 16:12:30.775619 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:12:30.775619 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:12:30.775619 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 617/1230] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 16:12:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:12:30.780591 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79286f0e-c30e-440e-a2d2-883831ae618c None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:12:30.880483 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79286f0e-c30e-440e-a2d2-883831ae618c None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:12:30.913437 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c8c4be-4366-422b-954e-3f037dc46b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:12:30.914092 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c8c4be-4366-422b-954e-3f037dc46b9e None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:30.915051 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c8c4be-4366-422b-954e-3f037dc46b9e None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:30.915341 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c8c4be-4366-422b-954e-3f037dc46b9e None admin] PATH_INFO: `/v3/projects` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:30.916380 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c8c4be-4366-422b-954e-3f037dc46b9e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:12:30.916697 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c8c4be-4366-422b-954e-3f037dc46b9e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:12:30.918131 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c8c4be-4366-422b-954e-3f037dc46b9e None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:12:30.929978 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 614/1231] 10.222.0.62 () {56 vars in 1148 bytes} [Fri May 27 16:12:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:12:30.936090 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978dc9c0-f21b-4214-b546-cd66b35b4244 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:12:31.000910 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:12:31.033890 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978dc9c0-f21b-4214-b546-cd66b35b4244 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:12:31.067153 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0679dd1c-3d09-4742-ba76-2cf017f110bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:12:31.068038 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0679dd1c-3d09-4742-ba76-2cf017f110bf None admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:31.068323 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0679dd1c-3d09-4742-ba76-2cf017f110bf None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:31.068598 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0679dd1c-3d09-4742-ba76-2cf017f110bf None admin] PATH_INFO: `/v3/projects/d48d95a12587479ca5714f6ebd60dd9f/users/35d98c4a2af546d8b655d649d655f447/roles/1d9076bd231c43809cb971b6360e0c28` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:31.083282 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0679dd1c-3d09-4742-ba76-2cf017f110bf None admin] RBAC: Authorizing `identity:create_grant(project_id=d48d95a12587479ca5714f6ebd60dd9f, user_id=35d98c4a2af546d8b655d649d655f447, role_id=1d9076bd231c43809cb971b6360e0c28)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:12:31.084730 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0679dd1c-3d09-4742-ba76-2cf017f110bf None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:12:31.159454 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 618/1232] 10.222.0.62 () {58 vars in 1439 bytes} [Fri May 27 16:12:30 2022] PUT /identity/v3/projects/d48d95a12587479ca5714f6ebd60dd9f/users/35d98c4a2af546d8b655d649d655f447/roles/1d9076bd231c43809cb971b6360e0c28 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:12:33.512743 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56001e62-d844-42a8-a297-0bc6d5c0c4de None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:33.513274 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56001e62-d844-42a8-a297-0bc6d5c0c4de None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:33.513274 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56001e62-d844-42a8-a297-0bc6d5c0c4de None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:33.514695 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 615/1233] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:12:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:12:33.520185 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091685ca-20d8-4980-adba-9e7f9def15d6 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:33.520615 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091685ca-20d8-4980-adba-9e7f9def15d6 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:33.520751 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091685ca-20d8-4980-adba-9e7f9def15d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:33.537499 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-091685ca-20d8-4980-adba-9e7f9def15d6 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:12:33.538726 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-091685ca-20d8-4980-adba-9e7f9def15d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:12:33.603935 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 619/1234] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:12:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:12:33.626818 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56001e62-d844-42a8-a297-0bc6d5c0c4de None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:12:33.652489 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:12:33.725923 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56001e62-d844-42a8-a297-0bc6d5c0c4de None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:12:33.758459 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed4d011-d3a0-4028-9a0b-77d367c21151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:12:33.759255 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed4d011-d3a0-4028-9a0b-77d367c21151 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:33.760942 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed4d011-d3a0-4028-9a0b-77d367c21151 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:33.760942 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed4d011-d3a0-4028-9a0b-77d367c21151 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:33.769864 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed4d011-d3a0-4028-9a0b-77d367c21151 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:12:33.778154 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-1ed4d011-d3a0-4028-9a0b-77d367c21151 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 16:12:33.778154 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:12:33.778154 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:12:33.778154 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:12:33.778154 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:12:33.778154 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:12:33.778154 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:12:33.778154 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:12:33.778154 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:12:33.778154 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:12:33.778154 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:12:33.778154 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:12:33.778154 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:12:33.778154 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:12:33.778154 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:12:33.778154 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:12:33.779271 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:12:33.779271 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:12:33.779271 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:12:33.779271 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:12:33.779271 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:12:33.779271 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:12:33.779271 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:12:33.779271 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:12:33.779271 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:12:33.779271 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:12:33.779271 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:12:33.779271 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:12:33.779271 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:12:33.779271 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:12:33.779271 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:12:33.779271 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:12:33.780237 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:12:33.780237 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:12:33.780237 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:12:33.780237 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:12:33.780237 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:12:33.780237 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:12:33.780237 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:12:33.780237 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:12:33.780237 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:12:33.780237 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:12:33.780237 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 16:12:33.780237 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:12:33.780237 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 616/1235] 10.222.0.62 () {56 vars in 1102 bytes} [Fri May 27 16:12:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:12:33.785306 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091685ca-20d8-4980-adba-9e7f9def15d6 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:12:33.831420 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:12:33.884478 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091685ca-20d8-4980-adba-9e7f9def15d6 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:12:33.917135 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2178ac7-e9a9-4546-a1f9-9d174bcbec91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:12:33.917845 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2178ac7-e9a9-4546-a1f9-9d174bcbec91 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:33.918132 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2178ac7-e9a9-4546-a1f9-9d174bcbec91 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:33.918449 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2178ac7-e9a9-4546-a1f9-9d174bcbec91 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:33.919195 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2178ac7-e9a9-4546-a1f9-9d174bcbec91 None admin] RBAC: Adding query filter params (name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:12:33.919506 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2178ac7-e9a9-4546-a1f9-9d174bcbec91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:12:33.920872 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2178ac7-e9a9-4546-a1f9-9d174bcbec91 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:12:33.929105 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 620/1236] 10.222.0.62 () {56 vars in 1103 bytes} [Fri May 27 16:12:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:12:33.935389 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed4d011-d3a0-4028-9a0b-77d367c21151 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:12:34.016813 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:12:34.032330 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed4d011-d3a0-4028-9a0b-77d367c21151 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:12:34.065744 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5267413-5c65-4442-a6c6-f634271be826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:12:34.066551 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5267413-5c65-4442-a6c6-f634271be826 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:34.066835 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5267413-5c65-4442-a6c6-f634271be826 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:34.067109 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5267413-5c65-4442-a6c6-f634271be826 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:34.077670 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5267413-5c65-4442-a6c6-f634271be826 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:12:34.079151 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5267413-5c65-4442-a6c6-f634271be826 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:12:34.096379 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-a5267413-5c65-4442-a6c6-f634271be826 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:12:34.096379 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:12:34.096379 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:12:34.096379 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:12:34.096379 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:12:34.096379 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:12:34.096379 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:12:34.096379 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:12:34.096379 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:12:34.096379 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:12:34.096379 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:12:34.096379 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:12:34.096379 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:12:34.096379 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:12:34.096379 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:12:34.097530 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:12:34.097530 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:12:34.097530 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:12:34.097530 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:12:34.097530 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:12:34.097530 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:12:34.097530 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:12:34.097530 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:12:34.097530 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:12:34.097530 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:12:34.097530 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:12:34.097530 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:12:34.097530 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:12:34.097530 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:12:34.097530 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:12:34.097530 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:12:34.097530 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:12:34.098656 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:12:34.098656 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:12:34.098656 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:12:34.098656 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:12:34.098656 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 617/1237] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:12:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:12:34.103219 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2178ac7-e9a9-4546-a1f9-9d174bcbec91 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:12:34.202100 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2178ac7-e9a9-4546-a1f9-9d174bcbec91 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:12:34.211111 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:12:34.234858 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cdfc79-5b7b-4db6-8072-ab8e29440e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:12:34.235511 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cdfc79-5b7b-4db6-8072-ab8e29440e44 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:34.235800 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cdfc79-5b7b-4db6-8072-ab8e29440e44 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:34.236083 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cdfc79-5b7b-4db6-8072-ab8e29440e44 None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:34.236799 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cdfc79-5b7b-4db6-8072-ab8e29440e44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:12:34.237112 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cdfc79-5b7b-4db6-8072-ab8e29440e44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:12:34.238584 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cdfc79-5b7b-4db6-8072-ab8e29440e44 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:12:34.249938 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 621/1238] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 16:12:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:12:34.255590 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5267413-5c65-4442-a6c6-f634271be826 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:12:34.353639 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5267413-5c65-4442-a6c6-f634271be826 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:12:34.387395 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a54d69-d473-4d43-8755-e2afb8fd126f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:12:34.388199 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a54d69-d473-4d43-8755-e2afb8fd126f None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:34.388515 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a54d69-d473-4d43-8755-e2afb8fd126f None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:34.388794 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a54d69-d473-4d43-8755-e2afb8fd126f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:34.391506 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:12:34.395917 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a54d69-d473-4d43-8755-e2afb8fd126f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:12:34.397413 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a54d69-d473-4d43-8755-e2afb8fd126f None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:12:34.412546 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-16a54d69-d473-4d43-8755-e2afb8fd126f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 27 16:12:34.412546 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:12:34.412546 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:12:34.412546 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:12:34.412546 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:12:34.412546 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:12:34.412546 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:12:34.412546 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:12:34.412546 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:12:34.412546 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:12:34.412546 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:12:34.412546 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:12:34.412546 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 16:12:34.412546 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 16:12:34.412546 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 16:12:34.412546 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 16:12:34.413777 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:12:34.413777 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:12:34.413777 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 16:12:34.413777 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:12:34.413777 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 16:12:34.413777 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:12:34.413777 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:12:34.413777 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:12:34.413777 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:12:34.413777 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:12:34.413777 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:12:34.413777 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:12:34.413777 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:12:34.413777 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:12:34.413777 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:12:34.413777 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:12:34.413777 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:12:34.413777 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:12:34.415465 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:12:34.415465 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:12:34.415465 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 16:12:34.415465 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 16:12:34.415465 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 16:12:34.415465 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 16:12:34.415465 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 16:12:34.415465 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 16:12:34.415465 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 27 16:12:34.415465 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:12:34.415465 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 618/1239] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:12:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:12:34.420305 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cdfc79-5b7b-4db6-8072-ab8e29440e44 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:12:34.519840 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cdfc79-5b7b-4db6-8072-ab8e29440e44 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:12:34.553161 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00004161-68b0-4615-8d76-868e33339804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:12:34.553831 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00004161-68b0-4615-8d76-868e33339804 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:34.554117 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00004161-68b0-4615-8d76-868e33339804 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:34.554430 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00004161-68b0-4615-8d76-868e33339804 None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:34.555906 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00004161-68b0-4615-8d76-868e33339804 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:12:34.556221 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00004161-68b0-4615-8d76-868e33339804 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:12:34.557674 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00004161-68b0-4615-8d76-868e33339804 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:12:34.574444 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 622/1240] 10.222.0.62 () {56 vars in 1143 bytes} [Fri May 27 16:12:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:12:34.580210 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a54d69-d473-4d43-8755-e2afb8fd126f None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:12:34.680288 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a54d69-d473-4d43-8755-e2afb8fd126f None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:12:34.713923 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e189bb-5f3a-41de-ad68-3e5adf646d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:12:34.714589 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e189bb-5f3a-41de-ad68-3e5adf646d67 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:34.714875 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e189bb-5f3a-41de-ad68-3e5adf646d67 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:34.715151 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e189bb-5f3a-41de-ad68-3e5adf646d67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:34.773260 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:12:34.780106 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e189bb-5f3a-41de-ad68-3e5adf646d67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:12:34.781671 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e189bb-5f3a-41de-ad68-3e5adf646d67 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:12:34.880272 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 619/1241] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 16:12:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 16:12:34.886788 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00004161-68b0-4615-8d76-868e33339804 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:12:34.914846 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:12:34.984107 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00004161-68b0-4615-8d76-868e33339804 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:12:35.017468 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdcfc8f-afbc-4c0c-ae24-1466407ae64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:12:35.018330 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdcfc8f-afbc-4c0c-ae24-1466407ae64e None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:35.018571 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdcfc8f-afbc-4c0c-ae24-1466407ae64e None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:35.018850 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdcfc8f-afbc-4c0c-ae24-1466407ae64e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:35.029493 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdcfc8f-afbc-4c0c-ae24-1466407ae64e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:12:35.030983 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdcfc8f-afbc-4c0c-ae24-1466407ae64e None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:12:35.049115 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-2cdcfc8f-afbc-4c0c-ae24-1466407ae64e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:12:35.049115 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:12:35.049115 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:12:35.049115 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:12:35.049115 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:12:35.049115 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:12:35.049115 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:12:35.049115 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:12:35.049115 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:12:35.049115 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:12:35.049115 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:12:35.049115 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:12:35.049115 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:12:35.049115 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:12:35.049115 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:12:35.050288 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:12:35.050288 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:12:35.050288 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:12:35.050288 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:12:35.050288 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:12:35.050288 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:12:35.050288 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:12:35.050288 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:12:35.050288 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:12:35.050288 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:12:35.050288 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:12:35.050288 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:12:35.050288 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:12:35.050288 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:12:35.050288 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:12:35.050288 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:12:35.050288 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:12:35.051413 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:12:35.051413 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:12:35.051413 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:12:35.051413 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:12:35.051413 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 623/1242] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:12:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:12:35.056026 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e189bb-5f3a-41de-ad68-3e5adf646d67 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:12:35.154943 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:12:35.170819 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e189bb-5f3a-41de-ad68-3e5adf646d67 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:12:35.204285 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3bf32d-9e01-40c2-9092-15195dc1780f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:12:35.204943 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3bf32d-9e01-40c2-9092-15195dc1780f None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:35.205230 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3bf32d-9e01-40c2-9092-15195dc1780f None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:35.205512 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3bf32d-9e01-40c2-9092-15195dc1780f None admin] PATH_INFO: `/v3/domains` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:35.206436 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3bf32d-9e01-40c2-9092-15195dc1780f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:12:35.206630 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3bf32d-9e01-40c2-9092-15195dc1780f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:12:35.208015 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3bf32d-9e01-40c2-9092-15195dc1780f None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:12:35.220353 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 620/1243] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 16:12:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:12:35.226056 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdcfc8f-afbc-4c0c-ae24-1466407ae64e None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:12:35.303179 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:12:35.325656 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdcfc8f-afbc-4c0c-ae24-1466407ae64e None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:12:35.357575 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40228566-9781-4fa5-9906-ed4da6f13343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:12:35.358377 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40228566-9781-4fa5-9906-ed4da6f13343 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:35.358661 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40228566-9781-4fa5-9906-ed4da6f13343 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:35.358936 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40228566-9781-4fa5-9906-ed4da6f13343 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:35.365294 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40228566-9781-4fa5-9906-ed4da6f13343 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:12:35.366754 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40228566-9781-4fa5-9906-ed4da6f13343 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:12:35.380690 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-40228566-9781-4fa5-9906-ed4da6f13343 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:12:35.380690 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:12:35.380690 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:12:35.380690 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:12:35.380690 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:12:35.380690 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:12:35.380690 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:12:35.380690 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:12:35.380690 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:12:35.380690 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:12:35.380690 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:12:35.380690 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:12:35.380690 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 16:12:35.380690 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 16:12:35.380690 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 16:12:35.381647 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 16:12:35.381647 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:12:35.381647 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:12:35.381647 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:12:35.381647 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:12:35.381647 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:12:35.381647 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:12:35.381647 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:12:35.381647 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:12:35.381647 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:12:35.381647 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:12:35.381647 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:12:35.381647 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:12:35.381647 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:12:35.381647 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:12:35.381647 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:12:35.381647 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:12:35.383505 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 16:12:35.383505 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 16:12:35.383505 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 16:12:35.383505 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 16:12:35.383505 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 16:12:35.383505 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 16:12:35.383505 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:12:35.383505 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:12:35.383505 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 624/1244] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 16:12:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:12:35.388426 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3bf32d-9e01-40c2-9092-15195dc1780f None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:12:35.489092 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3bf32d-9e01-40c2-9092-15195dc1780f None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:12:35.523605 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5d8c0b-eb66-4cbe-8451-d72efd087aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:12:35.524262 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d8c0b-eb66-4cbe-8451-d72efd087aea None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:35.524550 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d8c0b-eb66-4cbe-8451-d72efd087aea None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:35.524830 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d8c0b-eb66-4cbe-8451-d72efd087aea None admin] PATH_INFO: `/v3/projects` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:35.525618 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5d8c0b-eb66-4cbe-8451-d72efd087aea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:12:35.525930 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5d8c0b-eb66-4cbe-8451-d72efd087aea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:12:35.527395 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5d8c0b-eb66-4cbe-8451-d72efd087aea None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:12:35.539249 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 621/1245] 10.222.0.62 () {56 vars in 1148 bytes} [Fri May 27 16:12:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:12:35.546241 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40228566-9781-4fa5-9906-ed4da6f13343 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:12:35.643925 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40228566-9781-4fa5-9906-ed4da6f13343 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:12:35.676323 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f6101b-8765-4f1f-847e-aa6666315330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:12:35.676963 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6101b-8765-4f1f-847e-aa6666315330 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:35.677248 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6101b-8765-4f1f-847e-aa6666315330 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:35.677525 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6101b-8765-4f1f-847e-aa6666315330 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:35.678375 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f6101b-8765-4f1f-847e-aa6666315330 None admin] RBAC: Adding query filter params (role.id=1d9076bd231c43809cb971b6360e0c28, scope.project.id=d48d95a12587479ca5714f6ebd60dd9f, user.id=35d98c4a2af546d8b655d649d655f447) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:12:35.678691 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f6101b-8765-4f1f-847e-aa6666315330 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:12:35.680683 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f6101b-8765-4f1f-847e-aa6666315330 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:12:35.686492 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 625/1246] 10.222.0.62 () {56 vars in 1374 bytes} [Fri May 27 16:12:35 2022] GET /identity/v3/role_assignments?user.id=35d98c4a2af546d8b655d649d655f447&scope.project.id=d48d95a12587479ca5714f6ebd60dd9f&role.id=1d9076bd231c43809cb971b6360e0c28 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:12:37.946381 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d658136d-abde-466c-aceb-d3148f1735b6 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:37.946913 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d658136d-abde-466c-aceb-d3148f1735b6 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:37.946913 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d658136d-abde-466c-aceb-d3148f1735b6 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:37.948296 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 622/1247] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:12:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:12:37.953530 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b734d6c-3040-4586-9d4d-4a5b9cc183a1 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:37.954883 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b734d6c-3040-4586-9d4d-4a5b9cc183a1 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:37.954883 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b734d6c-3040-4586-9d4d-4a5b9cc183a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:37.959185 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:12:37.971382 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-1b734d6c-3040-4586-9d4d-4a5b9cc183a1 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:12:37.972560 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-1b734d6c-3040-4586-9d4d-4a5b9cc183a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:12:38.037346 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 626/1248] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:12:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:12:38.061693 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d658136d-abde-466c-aceb-d3148f1735b6 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:12:38.079797 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:12:38.160822 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d658136d-abde-466c-aceb-d3148f1735b6 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:12:38.195284 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f5ce4e-70a7-48d6-84e8-8296711bc9bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:12:38.196068 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f5ce4e-70a7-48d6-84e8-8296711bc9bd None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:38.196349 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f5ce4e-70a7-48d6-84e8-8296711bc9bd None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:38.196619 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f5ce4e-70a7-48d6-84e8-8296711bc9bd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:38.206742 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f5ce4e-70a7-48d6-84e8-8296711bc9bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:12:38.214380 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-c6f5ce4e-70a7-48d6-84e8-8296711bc9bd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:12:38.214380 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:12:38.214380 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:12:38.214380 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:12:38.214380 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:12:38.214380 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:12:38.214380 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:12:38.214380 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:12:38.214380 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:12:38.214380 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:12:38.214380 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:12:38.214380 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:12:38.214380 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:12:38.214380 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:12:38.214380 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:12:38.214380 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:12:38.215497 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:12:38.215497 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:12:38.215497 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:12:38.215497 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:12:38.215497 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:12:38.215497 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:12:38.215497 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:12:38.215497 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:12:38.215497 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:12:38.215497 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:12:38.215497 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:12:38.215497 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:12:38.215497 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:12:38.215497 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:12:38.215497 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:12:38.215497 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:12:38.216542 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:12:38.216542 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:12:38.216542 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:12:38.216542 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:12:38.216542 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:12:38.216542 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:12:38.216542 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:12:38.216542 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:12:38.216542 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:12:38.216542 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:12:38.216542 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:12:38.216542 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:12:38.216542 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 623/1249] 10.222.0.62 () {56 vars in 1096 bytes} [Fri May 27 16:12:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:12:38.221641 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b734d6c-3040-4586-9d4d-4a5b9cc183a1 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:12:38.318882 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b734d6c-3040-4586-9d4d-4a5b9cc183a1 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:12:38.347367 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:12:38.352661 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca18287-379a-4f1d-a3e5-ee1f2dec39ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:12:38.353322 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca18287-379a-4f1d-a3e5-ee1f2dec39ff None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:38.353607 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca18287-379a-4f1d-a3e5-ee1f2dec39ff None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:38.353886 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca18287-379a-4f1d-a3e5-ee1f2dec39ff None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:38.354670 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca18287-379a-4f1d-a3e5-ee1f2dec39ff None admin] RBAC: Adding query filter params (name=admin) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:12:38.354986 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca18287-379a-4f1d-a3e5-ee1f2dec39ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:12:38.356353 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca18287-379a-4f1d-a3e5-ee1f2dec39ff None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:12:38.364236 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 627/1250] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 16:12:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:12:38.369979 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f5ce4e-70a7-48d6-84e8-8296711bc9bd None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:12:38.447335 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:12:38.471584 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f5ce4e-70a7-48d6-84e8-8296711bc9bd None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:12:38.503943 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7c4253-9e61-47d7-9655-b06984d530d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:12:38.504727 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c4253-9e61-47d7-9655-b06984d530d8 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:38.505011 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c4253-9e61-47d7-9655-b06984d530d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:38.505289 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c4253-9e61-47d7-9655-b06984d530d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:38.515609 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7c4253-9e61-47d7-9655-b06984d530d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:12:38.517046 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7c4253-9e61-47d7-9655-b06984d530d8 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:12:38.534698 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-5e7c4253-9e61-47d7-9655-b06984d530d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:12:38.534698 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:12:38.534698 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:12:38.534698 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:12:38.534698 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:12:38.534698 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:12:38.534698 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:12:38.534698 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:12:38.534698 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:12:38.534698 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:12:38.534698 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:12:38.534698 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:12:38.534698 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:12:38.534698 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:12:38.534698 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:12:38.535789 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:12:38.535789 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:12:38.535789 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:12:38.535789 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:12:38.535789 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:12:38.535789 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:12:38.535789 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:12:38.535789 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:12:38.535789 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:12:38.535789 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:12:38.535789 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:12:38.535789 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:12:38.535789 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:12:38.535789 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:12:38.535789 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:12:38.535789 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:12:38.535789 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:12:38.536970 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:12:38.536970 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:12:38.536970 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:12:38.536970 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:12:38.538483 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 624/1251] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:12:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:12:38.542986 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca18287-379a-4f1d-a3e5-ee1f2dec39ff None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:12:38.640371 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca18287-379a-4f1d-a3e5-ee1f2dec39ff None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:12:38.674662 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5d1e64-f70d-4323-9084-39dc20edeaa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:12:38.675326 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d1e64-f70d-4323-9084-39dc20edeaa6 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:38.675615 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d1e64-f70d-4323-9084-39dc20edeaa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:38.675901 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d1e64-f70d-4323-9084-39dc20edeaa6 None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:38.676619 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5d1e64-f70d-4323-9084-39dc20edeaa6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:12:38.676931 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5d1e64-f70d-4323-9084-39dc20edeaa6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:12:38.678439 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5d1e64-f70d-4323-9084-39dc20edeaa6 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:12:38.690052 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 628/1252] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 16:12:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:12:38.696345 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7c4253-9e61-47d7-9655-b06984d530d8 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:12:38.794268 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7c4253-9e61-47d7-9655-b06984d530d8 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:12:38.818814 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:12:38.826783 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42addc8e-f45a-46e1-a0f1-4f0cec235bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:12:38.827574 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42addc8e-f45a-46e1-a0f1-4f0cec235bda None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:38.827857 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42addc8e-f45a-46e1-a0f1-4f0cec235bda None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:38.828137 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42addc8e-f45a-46e1-a0f1-4f0cec235bda None admin] PATH_INFO: `/v3/users/placement` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:38.835357 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42addc8e-f45a-46e1-a0f1-4f0cec235bda None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:12:38.837364 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42addc8e-f45a-46e1-a0f1-4f0cec235bda None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:12:38.851267 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-42addc8e-f45a-46e1-a0f1-4f0cec235bda None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 27 16:12:38.851267 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:12:38.851267 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:12:38.851267 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:12:38.851267 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:12:38.851267 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:12:38.851267 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:12:38.851267 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:12:38.851267 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:12:38.851267 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:12:38.851267 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:12:38.851267 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:12:38.851267 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 16:12:38.851267 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 16:12:38.851267 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 16:12:38.851267 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 16:12:38.853697 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:12:38.853697 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:12:38.853697 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 16:12:38.853697 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:12:38.853697 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 16:12:38.853697 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:12:38.853697 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:12:38.853697 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:12:38.853697 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:12:38.853697 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:12:38.853697 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:12:38.853697 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:12:38.853697 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:12:38.853697 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:12:38.853697 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:12:38.853697 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:12:38.853697 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:12:38.853697 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:12:38.854909 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:12:38.854909 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:12:38.854909 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 16:12:38.854909 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 16:12:38.854909 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 16:12:38.854909 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 16:12:38.854909 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 16:12:38.854909 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 16:12:38.854909 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 27 16:12:38.854909 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:12:38.854909 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 625/1253] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:12:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:12:38.858589 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5d1e64-f70d-4323-9084-39dc20edeaa6 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:12:38.916958 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:12:38.959621 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5d1e64-f70d-4323-9084-39dc20edeaa6 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:12:38.992054 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839d2fac-977b-49c6-8421-91cc84bdfb7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:12:38.994264 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d2fac-977b-49c6-8421-91cc84bdfb7c None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:38.994264 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d2fac-977b-49c6-8421-91cc84bdfb7c None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:38.994264 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d2fac-977b-49c6-8421-91cc84bdfb7c None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:38.994264 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839d2fac-977b-49c6-8421-91cc84bdfb7c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:12:38.994653 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839d2fac-977b-49c6-8421-91cc84bdfb7c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:12:38.995867 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839d2fac-977b-49c6-8421-91cc84bdfb7c None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:12:39.012676 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 629/1254] 10.222.0.62 () {56 vars in 1143 bytes} [Fri May 27 16:12:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:12:39.018502 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42addc8e-f45a-46e1-a0f1-4f0cec235bda None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:12:39.119689 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42addc8e-f45a-46e1-a0f1-4f0cec235bda None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:12:39.152594 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6095e0-5a35-422c-bd97-be6a1c9ced26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:12:39.153236 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6095e0-5a35-422c-bd97-be6a1c9ced26 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:39.153525 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6095e0-5a35-422c-bd97-be6a1c9ced26 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:39.153804 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6095e0-5a35-422c-bd97-be6a1c9ced26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:39.219065 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:12:39.230987 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6095e0-5a35-422c-bd97-be6a1c9ced26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:12:39.232459 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6095e0-5a35-422c-bd97-be6a1c9ced26 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:12:39.328325 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 626/1255] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 16:12:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 16:12:39.334749 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839d2fac-977b-49c6-8421-91cc84bdfb7c None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:12:39.433398 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839d2fac-977b-49c6-8421-91cc84bdfb7c None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:12:39.446638 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:12:39.467410 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3804cc1-6077-451e-8074-a2ab535ebf16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:12:39.468195 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3804cc1-6077-451e-8074-a2ab535ebf16 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:39.468482 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3804cc1-6077-451e-8074-a2ab535ebf16 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:39.468763 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3804cc1-6077-451e-8074-a2ab535ebf16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:39.479477 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3804cc1-6077-451e-8074-a2ab535ebf16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:12:39.480952 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3804cc1-6077-451e-8074-a2ab535ebf16 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:12:39.498626 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-e3804cc1-6077-451e-8074-a2ab535ebf16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:12:39.498626 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:12:39.498626 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:12:39.498626 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:12:39.498626 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:12:39.498626 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:12:39.498626 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:12:39.498626 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:12:39.498626 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:12:39.498626 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:12:39.498626 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:12:39.498626 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:12:39.498626 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:12:39.498626 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:12:39.498626 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:12:39.502623 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:12:39.502623 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:12:39.502623 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:12:39.502623 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:12:39.502623 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:12:39.502623 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:12:39.502623 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:12:39.502623 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:12:39.502623 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:12:39.502623 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:12:39.502623 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:12:39.502623 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:12:39.502623 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:12:39.502623 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:12:39.502623 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:12:39.502623 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:12:39.502623 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:12:39.503677 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:12:39.503677 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:12:39.503677 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:12:39.503677 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:12:39.503677 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 630/1256] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:12:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:12:39.505783 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6095e0-5a35-422c-bd97-be6a1c9ced26 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:12:39.591309 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:12:39.603391 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6095e0-5a35-422c-bd97-be6a1c9ced26 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:12:39.636538 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad6da09-6987-448c-ab18-a9b1a0214b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:12:39.637199 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad6da09-6987-448c-ab18-a9b1a0214b86 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:39.637512 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad6da09-6987-448c-ab18-a9b1a0214b86 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:39.637789 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad6da09-6987-448c-ab18-a9b1a0214b86 None admin] PATH_INFO: `/v3/domains` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:39.638557 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad6da09-6987-448c-ab18-a9b1a0214b86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:12:39.638867 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad6da09-6987-448c-ab18-a9b1a0214b86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:12:39.640235 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad6da09-6987-448c-ab18-a9b1a0214b86 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:12:39.651126 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 627/1257] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 16:12:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:12:39.656762 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3804cc1-6077-451e-8074-a2ab535ebf16 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:12:39.756984 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3804cc1-6077-451e-8074-a2ab535ebf16 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:12:39.789764 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebf5591-18e5-49b7-b0f8-9dad250d2122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:12:39.790572 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf5591-18e5-49b7-b0f8-9dad250d2122 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:39.791115 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf5591-18e5-49b7-b0f8-9dad250d2122 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:39.791392 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf5591-18e5-49b7-b0f8-9dad250d2122 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:39.798183 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebf5591-18e5-49b7-b0f8-9dad250d2122 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:12:39.799665 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebf5591-18e5-49b7-b0f8-9dad250d2122 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:12:39.813887 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-aebf5591-18e5-49b7-b0f8-9dad250d2122 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:12:39.813887 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:12:39.813887 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:12:39.813887 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:12:39.813887 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:12:39.813887 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:12:39.813887 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:12:39.813887 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:12:39.813887 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:12:39.813887 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:12:39.813887 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:12:39.813887 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:12:39.813887 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 16:12:39.813887 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 16:12:39.813887 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 16:12:39.815065 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 16:12:39.815065 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:12:39.815065 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:12:39.815065 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:12:39.815065 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:12:39.815065 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:12:39.815065 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:12:39.815065 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:12:39.815065 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:12:39.815065 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:12:39.815065 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:12:39.815065 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:12:39.815065 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:12:39.815065 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:12:39.815065 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:12:39.815065 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:12:39.815065 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:12:39.816031 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 16:12:39.816031 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 16:12:39.816031 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 16:12:39.816031 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 16:12:39.816031 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 16:12:39.816031 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 16:12:39.816031 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:12:39.816031 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:12:39.816031 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 631/1258] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 16:12:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:12:39.821033 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad6da09-6987-448c-ab18-a9b1a0214b86 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:12:39.921240 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad6da09-6987-448c-ab18-a9b1a0214b86 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:12:39.953761 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06afd30e-f2a1-42f5-822e-82bfadb8650d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:12:39.954448 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06afd30e-f2a1-42f5-822e-82bfadb8650d None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:39.954736 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06afd30e-f2a1-42f5-822e-82bfadb8650d None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:39.955015 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06afd30e-f2a1-42f5-822e-82bfadb8650d None admin] PATH_INFO: `/v3/projects` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:39.955804 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06afd30e-f2a1-42f5-822e-82bfadb8650d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:12:39.956115 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06afd30e-f2a1-42f5-822e-82bfadb8650d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:12:39.957549 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06afd30e-f2a1-42f5-822e-82bfadb8650d None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:12:39.969748 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 628/1259] 10.222.0.62 () {56 vars in 1148 bytes} [Fri May 27 16:12:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:12:39.975979 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebf5591-18e5-49b7-b0f8-9dad250d2122 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:12:40.002182 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:12:40.074662 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebf5591-18e5-49b7-b0f8-9dad250d2122 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:12:40.108598 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9113a7-05b4-4a6a-b96f-bf6359ff2c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:12:40.109240 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9113a7-05b4-4a6a-b96f-bf6359ff2c56 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:40.109527 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9113a7-05b4-4a6a-b96f-bf6359ff2c56 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:40.109806 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9113a7-05b4-4a6a-b96f-bf6359ff2c56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:40.110665 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9113a7-05b4-4a6a-b96f-bf6359ff2c56 None admin] RBAC: Adding query filter params (role.id=e04fe3eb1f714d74901ac83e33ea8a16, scope.project.id=d48d95a12587479ca5714f6ebd60dd9f, user.id=35d98c4a2af546d8b655d649d655f447) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:12:40.110979 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9113a7-05b4-4a6a-b96f-bf6359ff2c56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:12:40.112450 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9113a7-05b4-4a6a-b96f-bf6359ff2c56 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:12:40.117866 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 632/1260] 10.222.0.62 () {56 vars in 1374 bytes} [Fri May 27 16:12:39 2022] GET /identity/v3/role_assignments?user.id=35d98c4a2af546d8b655d649d655f447&scope.project.id=d48d95a12587479ca5714f6ebd60dd9f&role.id=e04fe3eb1f714d74901ac83e33ea8a16 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:12:42.290980 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a50ec03-17b4-4ac7-8f4a-1d330f351481 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:42.291482 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a50ec03-17b4-4ac7-8f4a-1d330f351481 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:42.291482 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a50ec03-17b4-4ac7-8f4a-1d330f351481 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:42.292829 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 629/1261] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:12:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:12:42.298156 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f4a9b0-42f9-4a89-b613-e1fcb27a187e None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:42.298615 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f4a9b0-42f9-4a89-b613-e1fcb27a187e None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:42.298743 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f4a9b0-42f9-4a89-b613-e1fcb27a187e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:42.315235 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-82f4a9b0-42f9-4a89-b613-e1fcb27a187e None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:12:42.316395 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-82f4a9b0-42f9-4a89-b613-e1fcb27a187e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:12:42.380271 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 633/1262] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:12:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 16:12:42.403028 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a50ec03-17b4-4ac7-8f4a-1d330f351481 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:12:42.413759 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:12:42.509478 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a50ec03-17b4-4ac7-8f4a-1d330f351481 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:12:42.543171 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea991e7-0fca-4b93-9bdb-e5e9333a0d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:12:42.543887 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea991e7-0fca-4b93-9bdb-e5e9333a0d84 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:42.544169 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea991e7-0fca-4b93-9bdb-e5e9333a0d84 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:42.544444 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea991e7-0fca-4b93-9bdb-e5e9333a0d84 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:42.554353 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea991e7-0fca-4b93-9bdb-e5e9333a0d84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:12:42.561978 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-3ea991e7-0fca-4b93-9bdb-e5e9333a0d84 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:12:42.561978 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:12:42.561978 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:12:42.561978 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:12:42.561978 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:12:42.561978 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:12:42.561978 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:12:42.561978 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:12:42.561978 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:12:42.561978 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:12:42.561978 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:12:42.561978 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:12:42.561978 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:12:42.561978 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:12:42.561978 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:12:42.561978 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:12:42.563173 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:12:42.563173 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:12:42.563173 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:12:42.563173 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:12:42.563173 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:12:42.563173 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:12:42.563173 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:12:42.563173 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:12:42.563173 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:12:42.563173 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:12:42.563173 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:12:42.563173 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:12:42.563173 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:12:42.563173 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:12:42.563173 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:12:42.563173 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:12:42.564107 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:12:42.564107 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:12:42.564107 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:12:42.564107 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:12:42.564107 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:12:42.564107 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:12:42.564107 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:12:42.564107 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:12:42.564107 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:12:42.564107 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:12:42.564107 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:12:42.564107 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:12:42.564107 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 630/1263] 10.222.0.62 () {56 vars in 1096 bytes} [Fri May 27 16:12:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:12:42.569128 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f4a9b0-42f9-4a89-b613-e1fcb27a187e None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:12:42.587867 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:12:42.666879 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f4a9b0-42f9-4a89-b613-e1fcb27a187e None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:12:42.699884 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0206146a-cd51-41c8-8129-080cda7f8f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:12:42.700580 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0206146a-cd51-41c8-8129-080cda7f8f98 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:42.700855 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0206146a-cd51-41c8-8129-080cda7f8f98 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:42.701137 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0206146a-cd51-41c8-8129-080cda7f8f98 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:42.701883 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0206146a-cd51-41c8-8129-080cda7f8f98 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:12:42.702195 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0206146a-cd51-41c8-8129-080cda7f8f98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:12:42.703611 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0206146a-cd51-41c8-8129-080cda7f8f98 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:12:42.712293 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 634/1264] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 16:12:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:12:42.718139 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea991e7-0fca-4b93-9bdb-e5e9333a0d84 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:12:42.784856 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:12:42.818610 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea991e7-0fca-4b93-9bdb-e5e9333a0d84 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:12:42.851128 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120e804b-8406-4e45-8212-f9df9b751b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:12:42.851919 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e804b-8406-4e45-8212-f9df9b751b7e None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:42.852203 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e804b-8406-4e45-8212-f9df9b751b7e None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:42.852483 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e804b-8406-4e45-8212-f9df9b751b7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:42.862906 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120e804b-8406-4e45-8212-f9df9b751b7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:12:42.864374 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120e804b-8406-4e45-8212-f9df9b751b7e None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:12:42.882596 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-120e804b-8406-4e45-8212-f9df9b751b7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:12:42.882596 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:12:42.882596 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:12:42.882596 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:12:42.882596 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:12:42.882596 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:12:42.882596 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:12:42.882596 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:12:42.882596 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:12:42.882596 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:12:42.882596 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:12:42.882596 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:12:42.882596 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:12:42.882596 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:12:42.882596 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:12:42.884280 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:12:42.884280 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:12:42.884280 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:12:42.884280 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:12:42.884280 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:12:42.884280 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:12:42.884280 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:12:42.884280 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:12:42.884280 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:12:42.884280 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:12:42.884280 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:12:42.884280 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:12:42.884280 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:12:42.884280 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:12:42.884280 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:12:42.884280 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:12:42.884280 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:12:42.889987 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:12:42.889987 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:12:42.889987 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:12:42.889987 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:12:42.889987 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 631/1265] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:12:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:12:42.890398 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0206146a-cd51-41c8-8129-080cda7f8f98 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:12:42.969787 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:12:42.988000 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0206146a-cd51-41c8-8129-080cda7f8f98 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:12:43.021069 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ace3a1d-024e-42b1-bb68-dd1b84b0f428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:12:43.021772 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace3a1d-024e-42b1-bb68-dd1b84b0f428 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:43.022063 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace3a1d-024e-42b1-bb68-dd1b84b0f428 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:43.022374 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace3a1d-024e-42b1-bb68-dd1b84b0f428 None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:43.023117 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ace3a1d-024e-42b1-bb68-dd1b84b0f428 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:12:43.023434 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ace3a1d-024e-42b1-bb68-dd1b84b0f428 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:12:43.024937 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ace3a1d-024e-42b1-bb68-dd1b84b0f428 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:12:43.036688 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 635/1266] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 16:12:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:12:43.042638 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120e804b-8406-4e45-8212-f9df9b751b7e None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:12:43.143427 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120e804b-8406-4e45-8212-f9df9b751b7e None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:12:43.162472 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:12:43.176076 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150e4050-f79c-4be8-8a88-cf861eb78d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:12:43.176875 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e4050-f79c-4be8-8a88-cf861eb78d5f None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:43.177162 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e4050-f79c-4be8-8a88-cf861eb78d5f None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:43.177441 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e4050-f79c-4be8-8a88-cf861eb78d5f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:43.185215 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150e4050-f79c-4be8-8a88-cf861eb78d5f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:12:43.186692 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150e4050-f79c-4be8-8a88-cf861eb78d5f None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:12:43.201232 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-150e4050-f79c-4be8-8a88-cf861eb78d5f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 27 16:12:43.201232 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:12:43.201232 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:12:43.201232 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:12:43.201232 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:12:43.201232 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:12:43.201232 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:12:43.201232 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:12:43.201232 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:12:43.201232 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:12:43.201232 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:12:43.201232 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:12:43.201232 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 16:12:43.201232 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 16:12:43.201232 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 16:12:43.201232 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 16:12:43.202279 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:12:43.202279 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:12:43.202279 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 16:12:43.202279 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:12:43.202279 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 16:12:43.202279 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:12:43.202279 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:12:43.202279 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:12:43.202279 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:12:43.202279 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:12:43.202279 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:12:43.202279 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:12:43.202279 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:12:43.202279 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:12:43.202279 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:12:43.202279 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:12:43.202279 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:12:43.202279 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:12:43.203632 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:12:43.203632 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:12:43.203632 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 16:12:43.203632 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 16:12:43.203632 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 16:12:43.203632 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 16:12:43.203632 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 16:12:43.203632 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 16:12:43.203632 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 27 16:12:43.203632 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:12:43.203632 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 632/1267] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:12:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:12:43.208322 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ace3a1d-024e-42b1-bb68-dd1b84b0f428 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:12:43.310168 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ace3a1d-024e-42b1-bb68-dd1b84b0f428 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:12:43.344075 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee9275-c98d-46c3-81fb-4b53a0446d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:12:43.344750 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee9275-c98d-46c3-81fb-4b53a0446d36 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:43.345037 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee9275-c98d-46c3-81fb-4b53a0446d36 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:43.345317 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee9275-c98d-46c3-81fb-4b53a0446d36 None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:43.346156 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cee9275-c98d-46c3-81fb-4b53a0446d36 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:12:43.346501 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cee9275-c98d-46c3-81fb-4b53a0446d36 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:12:43.347948 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cee9275-c98d-46c3-81fb-4b53a0446d36 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:12:43.360182 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:12:43.369454 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 636/1268] 10.222.0.62 () {56 vars in 1143 bytes} [Fri May 27 16:12:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:12:43.375447 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150e4050-f79c-4be8-8a88-cf861eb78d5f None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:12:43.475444 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150e4050-f79c-4be8-8a88-cf861eb78d5f None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:12:43.508663 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c1d7c-9fab-4d3e-90f6-2dc233511b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:12:43.509451 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c1d7c-9fab-4d3e-90f6-2dc233511b3d None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:43.509731 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c1d7c-9fab-4d3e-90f6-2dc233511b3d None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:43.510006 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c1d7c-9fab-4d3e-90f6-2dc233511b3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:43.523594 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514c1d7c-9fab-4d3e-90f6-2dc233511b3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:12:43.529969 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514c1d7c-9fab-4d3e-90f6-2dc233511b3d None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:12:43.542809 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-514c1d7c-9fab-4d3e-90f6-2dc233511b3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:12:43.542809 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:12:43.542809 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:12:43.542809 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:12:43.542809 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:12:43.542809 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:12:43.542809 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:12:43.542809 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:12:43.542809 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:12:43.542809 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:12:43.542809 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:12:43.542809 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:12:43.542809 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:12:43.542809 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:12:43.542809 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:12:43.543886 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:12:43.543886 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:12:43.543886 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:12:43.543886 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:12:43.543886 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:12:43.543886 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:12:43.543886 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:12:43.543886 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:12:43.543886 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:12:43.543886 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:12:43.543886 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:12:43.543886 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:12:43.543886 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:12:43.543886 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:12:43.543886 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:12:43.543886 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:12:43.543886 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:12:43.545140 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:12:43.545140 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:12:43.545140 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:12:43.545140 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:12:43.545140 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 633/1269] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:12:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:12:43.549771 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee9275-c98d-46c3-81fb-4b53a0446d36 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:12:43.648309 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee9275-c98d-46c3-81fb-4b53a0446d36 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:12:43.682714 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15efe78c-1dce-4309-8db9-058e523f4275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:12:43.683415 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15efe78c-1dce-4309-8db9-058e523f4275 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:43.683704 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15efe78c-1dce-4309-8db9-058e523f4275 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:43.683986 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15efe78c-1dce-4309-8db9-058e523f4275 None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:43.684707 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15efe78c-1dce-4309-8db9-058e523f4275 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:12:43.685021 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15efe78c-1dce-4309-8db9-058e523f4275 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:12:43.686424 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15efe78c-1dce-4309-8db9-058e523f4275 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:12:43.697775 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 637/1270] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 16:12:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:12:43.703464 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c1d7c-9fab-4d3e-90f6-2dc233511b3d None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:12:43.735524 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:12:43.802432 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c1d7c-9fab-4d3e-90f6-2dc233511b3d None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:12:43.835412 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7e7a95-f597-47c7-a04a-ef2c07c34c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:12:43.836799 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e7a95-f597-47c7-a04a-ef2c07c34c94 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:43.837085 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e7a95-f597-47c7-a04a-ef2c07c34c94 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:43.837360 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e7a95-f597-47c7-a04a-ef2c07c34c94 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:43.845998 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7e7a95-f597-47c7-a04a-ef2c07c34c94 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:12:43.848596 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7e7a95-f597-47c7-a04a-ef2c07c34c94 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:12:43.870756 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-9b7e7a95-f597-47c7-a04a-ef2c07c34c94 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:12:43.870756 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:12:43.870756 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:12:43.870756 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:12:43.870756 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:12:43.870756 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:12:43.870756 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:12:43.870756 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:12:43.870756 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:12:43.870756 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:12:43.870756 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:12:43.870756 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:12:43.870756 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 16:12:43.870756 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 16:12:43.870756 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 16:12:43.873431 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 16:12:43.873431 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:12:43.873431 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:12:43.873431 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:12:43.873431 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:12:43.873431 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:12:43.873431 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:12:43.873431 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:12:43.873431 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:12:43.873431 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:12:43.873431 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:12:43.873431 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:12:43.873431 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:12:43.873431 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:12:43.873431 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:12:43.873431 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:12:43.873431 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:12:43.875145 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 16:12:43.875145 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 16:12:43.875145 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 16:12:43.875145 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 16:12:43.875145 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 16:12:43.875145 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 16:12:43.875145 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:12:43.875145 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:12:43.875145 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 634/1271] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 16:12:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:12:43.879125 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15efe78c-1dce-4309-8db9-058e523f4275 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:12:43.938959 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:12:43.981436 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15efe78c-1dce-4309-8db9-058e523f4275 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:12:44.013887 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace86547-70db-484a-af76-136c5208e76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:12:44.014510 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace86547-70db-484a-af76-136c5208e76e None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:44.014845 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace86547-70db-484a-af76-136c5208e76e None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:44.015191 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace86547-70db-484a-af76-136c5208e76e None admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:44.016161 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace86547-70db-484a-af76-136c5208e76e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:12:44.016652 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace86547-70db-484a-af76-136c5208e76e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:12:44.018602 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace86547-70db-484a-af76-136c5208e76e None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:12:44.031845 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 638/1272] 10.222.0.62 () {56 vars in 1148 bytes} [Fri May 27 16:12:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:12:44.038357 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7e7a95-f597-47c7-a04a-ef2c07c34c94 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:12:44.128754 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:12:44.137618 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7e7a95-f597-47c7-a04a-ef2c07c34c94 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:12:44.170790 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6923409-0763-415a-87f9-11e51db27dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:12:44.171667 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6923409-0763-415a-87f9-11e51db27dad None admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:44.171955 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6923409-0763-415a-87f9-11e51db27dad None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:44.172236 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6923409-0763-415a-87f9-11e51db27dad None admin] PATH_INFO: `/v3/projects/d48d95a12587479ca5714f6ebd60dd9f/users/35d98c4a2af546d8b655d649d655f447/roles/e04fe3eb1f714d74901ac83e33ea8a16` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:44.174163 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6923409-0763-415a-87f9-11e51db27dad None admin] RBAC: Authorizing `identity:create_grant(project_id=d48d95a12587479ca5714f6ebd60dd9f, user_id=35d98c4a2af546d8b655d649d655f447, role_id=e04fe3eb1f714d74901ac83e33ea8a16)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:12:44.175712 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6923409-0763-415a-87f9-11e51db27dad None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:12:44.272355 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 635/1273] 10.222.0.62 () {58 vars in 1439 bytes} [Fri May 27 16:12:44 2022] PUT /identity/v3/projects/d48d95a12587479ca5714f6ebd60dd9f/users/35d98c4a2af546d8b655d649d655f447/roles/e04fe3eb1f714d74901ac83e33ea8a16 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:12:46.440523 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d289ccf-a6bc-4341-8417-d93f0054fa10 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:46.441075 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d289ccf-a6bc-4341-8417-d93f0054fa10 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:46.441075 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d289ccf-a6bc-4341-8417-d93f0054fa10 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:46.442497 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 639/1274] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:12:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:12:46.447708 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0227a-a4e0-40fb-ad25-b5648d7ab42b None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:46.448120 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0227a-a4e0-40fb-ad25-b5648d7ab42b None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:46.448296 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0227a-a4e0-40fb-ad25-b5648d7ab42b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:46.464691 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-28d0227a-a4e0-40fb-ad25-b5648d7ab42b None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:12:46.465948 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-28d0227a-a4e0-40fb-ad25-b5648d7ab42b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:12:46.531197 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 636/1275] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:12:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:12:46.557132 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d289ccf-a6bc-4341-8417-d93f0054fa10 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:12:46.657666 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d289ccf-a6bc-4341-8417-d93f0054fa10 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:12:46.675514 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:12:46.691738 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f946c93-5bd3-444c-b8f2-3c1738871fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:12:46.692468 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f946c93-5bd3-444c-b8f2-3c1738871fd3 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:46.692757 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f946c93-5bd3-444c-b8f2-3c1738871fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:46.693037 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f946c93-5bd3-444c-b8f2-3c1738871fd3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:46.702972 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f946c93-5bd3-444c-b8f2-3c1738871fd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:12:46.710647 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-5f946c93-5bd3-444c-b8f2-3c1738871fd3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:12:46.710647 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:12:46.710647 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:12:46.710647 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:12:46.710647 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:12:46.710647 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:12:46.710647 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:12:46.710647 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:12:46.710647 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:12:46.710647 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:12:46.710647 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:12:46.710647 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:12:46.710647 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:12:46.710647 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:12:46.710647 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:12:46.710647 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:12:46.712194 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:12:46.712194 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:12:46.712194 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:12:46.712194 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:12:46.712194 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:12:46.712194 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:12:46.712194 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:12:46.712194 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:12:46.712194 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:12:46.712194 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:12:46.712194 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:12:46.712194 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:12:46.712194 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:12:46.712194 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:12:46.712194 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:12:46.712194 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:12:46.713077 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:12:46.713077 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:12:46.713077 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:12:46.713077 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:12:46.713077 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:12:46.713077 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:12:46.713077 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:12:46.713077 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:12:46.713077 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:12:46.713077 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:12:46.713077 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:12:46.713077 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:12:46.713077 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 640/1276] 10.222.0.62 () {56 vars in 1096 bytes} [Fri May 27 16:12:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:12:46.718430 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d0227a-a4e0-40fb-ad25-b5648d7ab42b None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:12:46.798214 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:12:46.815346 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d0227a-a4e0-40fb-ad25-b5648d7ab42b None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:12:46.847707 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65011a0b-5090-4d57-b38d-28c09e790954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:12:46.848375 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65011a0b-5090-4d57-b38d-28c09e790954 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:46.848667 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65011a0b-5090-4d57-b38d-28c09e790954 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:46.848947 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65011a0b-5090-4d57-b38d-28c09e790954 None admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:46.849701 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65011a0b-5090-4d57-b38d-28c09e790954 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:12:46.850005 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65011a0b-5090-4d57-b38d-28c09e790954 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:12:46.851401 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65011a0b-5090-4d57-b38d-28c09e790954 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:12:46.860077 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 637/1277] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 16:12:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:12:46.865821 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f946c93-5bd3-444c-b8f2-3c1738871fd3 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:12:46.964521 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f946c93-5bd3-444c-b8f2-3c1738871fd3 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:12:46.996577 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7de330-0729-42ba-a324-61021fc1b7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:12:46.997370 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7de330-0729-42ba-a324-61021fc1b7b9 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:46.997659 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7de330-0729-42ba-a324-61021fc1b7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:46.997937 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7de330-0729-42ba-a324-61021fc1b7b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:47.009071 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7de330-0729-42ba-a324-61021fc1b7b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:12:47.010544 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7de330-0729-42ba-a324-61021fc1b7b9 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:12:47.028035 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-8f7de330-0729-42ba-a324-61021fc1b7b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:12:47.028035 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:12:47.028035 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:12:47.028035 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:12:47.028035 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:12:47.028035 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:12:47.028035 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:12:47.028035 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:12:47.028035 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:12:47.028035 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:12:47.028035 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:12:47.028035 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:12:47.028035 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:12:47.028035 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:12:47.028035 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:12:47.029110 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:12:47.029110 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:12:47.029110 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:12:47.029110 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:12:47.029110 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:12:47.029110 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:12:47.029110 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:12:47.029110 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:12:47.029110 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:12:47.029110 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:12:47.029110 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:12:47.029110 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:12:47.029110 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:12:47.029110 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:12:47.029110 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:12:47.029110 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:12:47.029110 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:12:47.030463 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:12:47.030463 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:12:47.030463 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:12:47.030463 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:12:47.030463 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 641/1278] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:12:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:12:47.035024 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65011a0b-5090-4d57-b38d-28c09e790954 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:12:47.131999 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65011a0b-5090-4d57-b38d-28c09e790954 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:12:47.165364 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7108c9f0-8577-4027-8fa9-da40fff3723b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:12:47.166312 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7108c9f0-8577-4027-8fa9-da40fff3723b None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:47.166598 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7108c9f0-8577-4027-8fa9-da40fff3723b None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:47.166876 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7108c9f0-8577-4027-8fa9-da40fff3723b None admin] PATH_INFO: `/v3/domains` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:47.167644 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7108c9f0-8577-4027-8fa9-da40fff3723b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:12:47.167956 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7108c9f0-8577-4027-8fa9-da40fff3723b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:12:47.169328 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7108c9f0-8577-4027-8fa9-da40fff3723b None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:12:47.180779 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 638/1279] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 16:12:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:12:47.186464 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7de330-0729-42ba-a324-61021fc1b7b9 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:12:47.217988 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:12:47.287875 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7de330-0729-42ba-a324-61021fc1b7b9 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:12:47.323035 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3092d3d2-29a9-4961-9bbd-bf13060ede56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:12:47.323835 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3092d3d2-29a9-4961-9bbd-bf13060ede56 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:47.324118 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3092d3d2-29a9-4961-9bbd-bf13060ede56 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:47.324397 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3092d3d2-29a9-4961-9bbd-bf13060ede56 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:47.331865 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3092d3d2-29a9-4961-9bbd-bf13060ede56 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:12:47.333311 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3092d3d2-29a9-4961-9bbd-bf13060ede56 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:12:47.347428 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-3092d3d2-29a9-4961-9bbd-bf13060ede56 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 27 16:12:47.347428 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:12:47.347428 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:12:47.347428 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:12:47.347428 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:12:47.347428 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:12:47.347428 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:12:47.347428 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:12:47.347428 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:12:47.347428 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:12:47.347428 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:12:47.347428 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:12:47.347428 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 16:12:47.347428 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 16:12:47.347428 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 16:12:47.347428 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 16:12:47.348360 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:12:47.348360 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:12:47.348360 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 16:12:47.348360 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:12:47.348360 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 16:12:47.348360 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:12:47.348360 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:12:47.348360 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:12:47.348360 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:12:47.348360 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:12:47.348360 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:12:47.348360 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:12:47.348360 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:12:47.348360 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:12:47.348360 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:12:47.348360 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:12:47.348360 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:12:47.348360 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:12:47.349441 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:12:47.349441 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:12:47.349441 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 16:12:47.349441 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 16:12:47.349441 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 16:12:47.349441 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 16:12:47.349441 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 16:12:47.349441 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 16:12:47.349441 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 27 16:12:47.349441 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:12:47.349441 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 642/1280] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:12:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:12:47.354474 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7108c9f0-8577-4027-8fa9-da40fff3723b None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:12:47.358217 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:12:47.453226 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7108c9f0-8577-4027-8fa9-da40fff3723b None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:12:47.485836 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2687806b-5a46-4f36-8fea-65acecd9541f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:12:47.486464 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2687806b-5a46-4f36-8fea-65acecd9541f None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:47.486748 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2687806b-5a46-4f36-8fea-65acecd9541f None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:47.487024 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2687806b-5a46-4f36-8fea-65acecd9541f None admin] PATH_INFO: `/v3/users` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:47.487845 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2687806b-5a46-4f36-8fea-65acecd9541f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:12:47.488152 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2687806b-5a46-4f36-8fea-65acecd9541f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:12:47.489575 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2687806b-5a46-4f36-8fea-65acecd9541f None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:12:47.506990 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 639/1281] 10.222.0.62 () {56 vars in 1143 bytes} [Fri May 27 16:12:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:12:47.513302 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3092d3d2-29a9-4961-9bbd-bf13060ede56 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:12:47.602477 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:12:47.611927 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3092d3d2-29a9-4961-9bbd-bf13060ede56 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:12:47.644655 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7ae694-d37c-4a1f-b5ca-d7eef28776e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:12:47.645287 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ae694-d37c-4a1f-b5ca-d7eef28776e6 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:47.645569 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ae694-d37c-4a1f-b5ca-d7eef28776e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:47.645843 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ae694-d37c-4a1f-b5ca-d7eef28776e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:47.711017 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7ae694-d37c-4a1f-b5ca-d7eef28776e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:12:47.712502 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7ae694-d37c-4a1f-b5ca-d7eef28776e6 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:12:47.800135 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:12:47.810534 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 643/1282] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 16:12:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 16:12:47.816504 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2687806b-5a46-4f36-8fea-65acecd9541f None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:12:47.878907 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:12:47.919465 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2687806b-5a46-4f36-8fea-65acecd9541f None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:12:47.951432 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5251102f-5eea-4856-9c1d-3eeb99b9a341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:12:47.952217 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5251102f-5eea-4856-9c1d-3eeb99b9a341 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:47.952504 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5251102f-5eea-4856-9c1d-3eeb99b9a341 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:47.952779 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5251102f-5eea-4856-9c1d-3eeb99b9a341 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:47.963001 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5251102f-5eea-4856-9c1d-3eeb99b9a341 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:12:47.964431 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5251102f-5eea-4856-9c1d-3eeb99b9a341 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:12:47.981957 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-5251102f-5eea-4856-9c1d-3eeb99b9a341 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:12:47.981957 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:12:47.981957 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:12:47.981957 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:12:47.981957 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:12:47.981957 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:12:47.981957 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:12:47.981957 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:12:47.981957 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:12:47.981957 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:12:47.981957 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:12:47.981957 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:12:47.981957 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:12:47.981957 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:12:47.981957 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:12:47.983083 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:12:47.983083 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:12:47.983083 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:12:47.983083 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:12:47.983083 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:12:47.983083 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:12:47.983083 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:12:47.983083 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:12:47.983083 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:12:47.983083 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:12:47.983083 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:12:47.983083 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:12:47.983083 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:12:47.983083 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:12:47.983083 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:12:47.983083 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:12:47.983083 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:12:47.984200 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:12:47.984200 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:12:47.984200 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:12:47.984200 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:12:47.984200 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 640/1283] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:12:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:12:47.989618 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7ae694-d37c-4a1f-b5ca-d7eef28776e6 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:12:48.085861 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7ae694-d37c-4a1f-b5ca-d7eef28776e6 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:12:48.119448 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8582112e-4506-4c46-852b-d4d292546590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:12:48.120139 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8582112e-4506-4c46-852b-d4d292546590 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:48.120425 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8582112e-4506-4c46-852b-d4d292546590 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:48.120705 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8582112e-4506-4c46-852b-d4d292546590 None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:48.121421 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8582112e-4506-4c46-852b-d4d292546590 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:12:48.121729 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8582112e-4506-4c46-852b-d4d292546590 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:12:48.123157 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8582112e-4506-4c46-852b-d4d292546590 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:12:48.134561 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 644/1284] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 16:12:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:12:48.140327 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5251102f-5eea-4856-9c1d-3eeb99b9a341 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:12:48.240705 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5251102f-5eea-4856-9c1d-3eeb99b9a341 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:12:48.254169 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:12:48.274136 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68bf689-a828-4a58-9418-ef8c990a8669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:12:48.274960 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68bf689-a828-4a58-9418-ef8c990a8669 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:48.275252 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68bf689-a828-4a58-9418-ef8c990a8669 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:48.275532 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68bf689-a828-4a58-9418-ef8c990a8669 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:48.282129 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68bf689-a828-4a58-9418-ef8c990a8669 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:12:48.283598 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68bf689-a828-4a58-9418-ef8c990a8669 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:12:48.298320 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application [None req-c68bf689-a828-4a58-9418-ef8c990a8669 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:12:48.298320 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:12:48.298320 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:12:48.298320 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:12:48.298320 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:12:48.298320 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:12:48.298320 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:12:48.298320 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:12:48.298320 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:12:48.298320 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:12:48.298320 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:12:48.298320 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:12:48.298320 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 16:12:48.298320 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 16:12:48.298320 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 16:12:48.299403 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 16:12:48.299403 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:12:48.299403 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:12:48.299403 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:12:48.299403 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:12:48.299403 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:12:48.299403 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:12:48.299403 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:12:48.299403 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application with Lock( May 27 16:12:48.299403 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:12:48.299403 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._enter() May 27 16:12:48.299403 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:12:48.299403 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:12:48.299403 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:12:48.299403 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.creator() May 27 16:12:48.299403 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:12:48.299403 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application created_value = creator( May 27 16:12:48.300561 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 16:12:48.300561 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 16:12:48.300561 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 16:12:48.300561 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 16:12:48.300561 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 16:12:48.300561 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 16:12:48.300561 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:12:48.300561 dv-cinder-840493-2-smb devstack@keystone.service[80288]: ERROR keystone.server.flask.application May 27 16:12:48.300561 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 641/1285] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 16:12:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:12:48.305687 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8582112e-4506-4c46-852b-d4d292546590 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:12:48.356291 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:12:48.403071 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8582112e-4506-4c46-852b-d4d292546590 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:12:48.435116 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508d8c10-94c5-4558-b620-b0268359f78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:12:48.435763 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d8c10-94c5-4558-b620-b0268359f78f None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:48.436044 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d8c10-94c5-4558-b620-b0268359f78f None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:48.436398 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d8c10-94c5-4558-b620-b0268359f78f None admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:48.437173 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508d8c10-94c5-4558-b620-b0268359f78f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:12:48.437481 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508d8c10-94c5-4558-b620-b0268359f78f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:12:48.438935 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508d8c10-94c5-4558-b620-b0268359f78f None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:12:48.450895 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 645/1286] 10.222.0.62 () {56 vars in 1148 bytes} [Fri May 27 16:12:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:12:48.457417 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68bf689-a828-4a58-9418-ef8c990a8669 None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:12:48.557708 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68bf689-a828-4a58-9418-ef8c990a8669 None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:12:48.592479 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6758ea47-7059-4121-a68c-872491cd0c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:12:48.593130 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6758ea47-7059-4121-a68c-872491cd0c1b None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:48.593421 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6758ea47-7059-4121-a68c-872491cd0c1b None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:48.593699 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6758ea47-7059-4121-a68c-872491cd0c1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:48.594562 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6758ea47-7059-4121-a68c-872491cd0c1b None admin] RBAC: Adding query filter params (role.id=e04fe3eb1f714d74901ac83e33ea8a16, scope.project.id=d48d95a12587479ca5714f6ebd60dd9f, user.id=35d98c4a2af546d8b655d649d655f447) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:12:48.594879 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6758ea47-7059-4121-a68c-872491cd0c1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:12:48.596299 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6758ea47-7059-4121-a68c-872491cd0c1b None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:12:48.602065 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 642/1287] 10.222.0.62 () {56 vars in 1374 bytes} [Fri May 27 16:12:48 2022] GET /identity/v3/role_assignments?user.id=35d98c4a2af546d8b655d649d655f447&scope.project.id=d48d95a12587479ca5714f6ebd60dd9f&role.id=e04fe3eb1f714d74901ac83e33ea8a16 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:12:50.802685 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de303ed-31c0-463b-9420-3299278f164e None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:50.803219 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de303ed-31c0-463b-9420-3299278f164e None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:50.803219 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de303ed-31c0-463b-9420-3299278f164e None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:50.804622 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 646/1288] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:12:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:12:50.809706 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ded0f-3b46-42cf-b75a-3f8a1b26668f None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:50.810152 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ded0f-3b46-42cf-b75a-3f8a1b26668f None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:50.810288 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ded0f-3b46-42cf-b75a-3f8a1b26668f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:50.827535 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-0c7ded0f-3b46-42cf-b75a-3f8a1b26668f None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:12:50.828756 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-0c7ded0f-3b46-42cf-b75a-3f8a1b26668f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:12:50.858898 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:12:50.895628 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 643/1289] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:12:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:12:50.918514 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de303ed-31c0-463b-9420-3299278f164e None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:12:51.024063 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de303ed-31c0-463b-9420-3299278f164e None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:12:51.034534 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:12:51.058864 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32e7e7d-3e95-49f5-925c-21886808bd2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:12:51.059594 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32e7e7d-3e95-49f5-925c-21886808bd2c None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:51.059876 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32e7e7d-3e95-49f5-925c-21886808bd2c None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:51.060180 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32e7e7d-3e95-49f5-925c-21886808bd2c None admin] PATH_INFO: `/v3/services/placement` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:51.060804 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32e7e7d-3e95-49f5-925c-21886808bd2c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:12:51.062164 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32e7e7d-3e95-49f5-925c-21886808bd2c None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:12:51.074508 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-a32e7e7d-3e95-49f5-925c-21886808bd2c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 27 16:12:51.074508 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:12:51.074508 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 16:12:51.074508 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 16:12:51.074508 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 16:12:51.074508 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 16:12:51.074508 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 16:12:51.074508 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:12:51.074508 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 27 16:12:51.074508 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:12:51.074508 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 16:12:51.074508 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:12:51.074508 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:12:51.074508 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:12:51.074508 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:12:51.074508 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:12:51.074508 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:12:51.075759 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:12:51.075759 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:12:51.075759 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:12:51.075759 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:12:51.075759 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:12:51.075759 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:12:51.075759 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 16:12:51.075759 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 16:12:51.075759 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 16:12:51.075759 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 16:12:51.075759 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:12:51.075759 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:12:51.075759 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:12:51.075759 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:12:51.075759 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:12:51.075759 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:12:51.076832 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:12:51.076832 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:12:51.076832 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:12:51.076832 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:12:51.076832 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:12:51.076832 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:12:51.076832 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:12:51.076832 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:12:51.076832 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:12:51.076832 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:12:51.076832 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 16:12:51.076832 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:12:51.076832 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 27 16:12:51.076832 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:12:51.076832 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 647/1290] 10.222.0.62 () {56 vars in 1117 bytes} [Fri May 27 16:12:50 2022] GET /identity/v3/services/placement => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:12:51.081805 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ded0f-3b46-42cf-b75a-3f8a1b26668f None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:12:51.180890 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ded0f-3b46-42cf-b75a-3f8a1b26668f None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:12:51.213927 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d05292-5224-4e00-a526-0645d38f1cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:12:51.214605 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d05292-5224-4e00-a526-0645d38f1cee None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:51.214893 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d05292-5224-4e00-a526-0645d38f1cee None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:51.215172 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d05292-5224-4e00-a526-0645d38f1cee None admin] PATH_INFO: `/v3/services` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:51.215875 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d05292-5224-4e00-a526-0645d38f1cee None admin] RBAC: Adding query filter params (name=placement) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:12:51.216181 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d05292-5224-4e00-a526-0645d38f1cee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:12:51.217545 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d05292-5224-4e00-a526-0645d38f1cee None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:12:51.222504 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 644/1291] 10.222.0.62 () {56 vars in 1116 bytes} [Fri May 27 16:12:51 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:12:51.228514 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32e7e7d-3e95-49f5-925c-21886808bd2c None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:12:51.331600 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32e7e7d-3e95-49f5-925c-21886808bd2c None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:12:51.369273 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7228672-12ae-43e1-91d2-56bfbced6a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:12:51.369938 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7228672-12ae-43e1-91d2-56bfbced6a5a None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:51.370228 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7228672-12ae-43e1-91d2-56bfbced6a5a None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:51.370544 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7228672-12ae-43e1-91d2-56bfbced6a5a None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:51.371247 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7228672-12ae-43e1-91d2-56bfbced6a5a None admin] RBAC: Adding query filter params (type=placement) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:12:51.371563 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7228672-12ae-43e1-91d2-56bfbced6a5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:12:51.372954 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7228672-12ae-43e1-91d2-56bfbced6a5a None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:12:51.377515 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 648/1292] 10.222.0.62 () {56 vars in 1116 bytes} [Fri May 27 16:12:51 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:12:53.560547 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b49df-d25e-4925-9220-9e5c05d0341c None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:53.561098 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b49df-d25e-4925-9220-9e5c05d0341c None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:53.561098 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b49df-d25e-4925-9220-9e5c05d0341c None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:53.562619 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 645/1293] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:12:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:12:53.567624 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df902b0-a94c-4e1f-bd98-df77bbf9f46d None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:53.568005 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df902b0-a94c-4e1f-bd98-df77bbf9f46d None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:53.568190 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df902b0-a94c-4e1f-bd98-df77bbf9f46d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:53.585496 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-4df902b0-a94c-4e1f-bd98-df77bbf9f46d None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:12:53.586723 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-4df902b0-a94c-4e1f-bd98-df77bbf9f46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:12:53.616074 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:12:53.653993 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 649/1294] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:12:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:12:53.677698 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0b49df-d25e-4925-9220-9e5c05d0341c None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:12:53.710040 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:12:53.777578 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0b49df-d25e-4925-9220-9e5c05d0341c None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:12:53.812858 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db941fec-d849-4d75-bcfb-bc2f3e680c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:12:53.813448 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db941fec-d849-4d75-bcfb-bc2f3e680c23 None admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:53.813729 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db941fec-d849-4d75-bcfb-bc2f3e680c23 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:53.814001 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db941fec-d849-4d75-bcfb-bc2f3e680c23 None admin] PATH_INFO: `/v3/services` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:53.814741 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db941fec-d849-4d75-bcfb-bc2f3e680c23 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:12:53.816094 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db941fec-d849-4d75-bcfb-bc2f3e680c23 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:12:53.920235 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 646/1295] 10.222.0.62 () {60 vars in 1141 bytes} [Fri May 27 16:12:53 2022] POST /identity/v3/services => generated 246 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:12:56.107632 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fca10e-86d5-4ec6-aa9e-821d165b70e4 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:56.108166 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fca10e-86d5-4ec6-aa9e-821d165b70e4 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:56.108166 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fca10e-86d5-4ec6-aa9e-821d165b70e4 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:56.109564 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 650/1296] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:12:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:12:56.114821 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7cd4c-1211-4d6f-b71e-80a1af0d90ef None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:56.115250 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7cd4c-1211-4d6f-b71e-80a1af0d90ef None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:56.115390 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7cd4c-1211-4d6f-b71e-80a1af0d90ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:56.135666 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-30b7cd4c-1211-4d6f-b71e-80a1af0d90ef None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:12:56.135666 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-30b7cd4c-1211-4d6f-b71e-80a1af0d90ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:12:56.204820 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 647/1297] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:12:56 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:12:56.227791 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fca10e-86d5-4ec6-aa9e-821d165b70e4 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:12:56.328014 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fca10e-86d5-4ec6-aa9e-821d165b70e4 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:12:56.361254 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceac2ed-ed6c-4b6e-8168-ca0791003c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:12:56.362077 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceac2ed-ed6c-4b6e-8168-ca0791003c88 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:56.362398 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceac2ed-ed6c-4b6e-8168-ca0791003c88 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:56.362685 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceac2ed-ed6c-4b6e-8168-ca0791003c88 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:56.363335 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceac2ed-ed6c-4b6e-8168-ca0791003c88 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:12:56.364711 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceac2ed-ed6c-4b6e-8168-ca0791003c88 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:12:56.377828 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-eceac2ed-ed6c-4b6e-8168-ca0791003c88 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 27 16:12:56.377828 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:12:56.377828 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 16:12:56.377828 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 16:12:56.377828 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 16:12:56.377828 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 16:12:56.377828 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 16:12:56.377828 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:12:56.377828 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 27 16:12:56.377828 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:12:56.377828 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 16:12:56.377828 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:12:56.377828 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:12:56.377828 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:12:56.377828 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:12:56.377828 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:12:56.377828 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:12:56.379162 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:12:56.379162 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:12:56.379162 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:12:56.379162 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:12:56.379162 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:12:56.379162 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:12:56.379162 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 16:12:56.379162 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 16:12:56.379162 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 16:12:56.379162 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 16:12:56.379162 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:12:56.379162 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:12:56.379162 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:12:56.379162 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:12:56.379162 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:12:56.379162 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:12:56.380028 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:12:56.380028 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:12:56.380028 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:12:56.380028 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:12:56.380028 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:12:56.380028 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:12:56.380028 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:12:56.380028 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:12:56.380028 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:12:56.380028 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:12:56.380028 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 16:12:56.380028 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:12:56.380028 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 27 16:12:56.380028 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:12:56.380028 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 651/1298] 10.222.0.62 () {56 vars in 1117 bytes} [Fri May 27 16:12:56 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:12:56.388887 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b7cd4c-1211-4d6f-b71e-80a1af0d90ef None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:12:56.404961 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:12:56.481971 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b7cd4c-1211-4d6f-b71e-80a1af0d90ef None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:12:56.515233 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0252905d-b975-4448-95dd-25c44e1ad45a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:12:56.515888 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0252905d-b975-4448-95dd-25c44e1ad45a None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:56.516169 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0252905d-b975-4448-95dd-25c44e1ad45a None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:56.516443 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0252905d-b975-4448-95dd-25c44e1ad45a None admin] PATH_INFO: `/v3/services` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:56.517195 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0252905d-b975-4448-95dd-25c44e1ad45a None admin] RBAC: Adding query filter params (name=placement) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:12:56.517502 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0252905d-b975-4448-95dd-25c44e1ad45a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:12:56.518957 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0252905d-b975-4448-95dd-25c44e1ad45a None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:12:56.523942 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 648/1299] 10.222.0.62 () {56 vars in 1116 bytes} [Fri May 27 16:12:56 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:12:56.530217 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceac2ed-ed6c-4b6e-8168-ca0791003c88 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:12:56.561517 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:12:56.628182 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceac2ed-ed6c-4b6e-8168-ca0791003c88 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:12:56.662889 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64c0b8e-26ce-42a2-a8c1-89219f7190c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:12:56.663560 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c0b8e-26ce-42a2-a8c1-89219f7190c5 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:56.663848 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c0b8e-26ce-42a2-a8c1-89219f7190c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:56.664130 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c0b8e-26ce-42a2-a8c1-89219f7190c5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:56.664924 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64c0b8e-26ce-42a2-a8c1-89219f7190c5 None admin] RBAC: Adding query filter params (interface=public, service_id=9a9136d4f1b84ec392454b17d65c8bea, region_id=RegionOne) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:12:56.665246 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64c0b8e-26ce-42a2-a8c1-89219f7190c5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:12:56.666994 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64c0b8e-26ce-42a2-a8c1-89219f7190c5 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:12:56.672008 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 652/1300] 10.222.0.62 () {56 vars in 1251 bytes} [Fri May 27 16:12:56 2022] GET /identity/v3/endpoints?service_id=9a9136d4f1b84ec392454b17d65c8bea&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:12:56.677571 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0252905d-b975-4448-95dd-25c44e1ad45a None admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:12:56.759182 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:12:56.776754 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0252905d-b975-4448-95dd-25c44e1ad45a None admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:12:56.810936 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47bef0b-bef1-42dc-b591-0319430b06cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:12:56.811797 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47bef0b-bef1-42dc-b591-0319430b06cb None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:56.812091 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47bef0b-bef1-42dc-b591-0319430b06cb None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:56.812373 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47bef0b-bef1-42dc-b591-0319430b06cb None admin] PATH_INFO: `/v3/services` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:56.813055 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47bef0b-bef1-42dc-b591-0319430b06cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:12:56.814448 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47bef0b-bef1-42dc-b591-0319430b06cb None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:12:56.821107 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 649/1301] 10.222.0.62 () {56 vars in 1087 bytes} [Fri May 27 16:12:56 2022] GET /identity/v3/services => generated 2191 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:12:59.037951 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a992a0e-8d54-4e11-9b7d-38d0ea8e7dc6 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:59.038520 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a992a0e-8d54-4e11-9b7d-38d0ea8e7dc6 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:59.038649 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a992a0e-8d54-4e11-9b7d-38d0ea8e7dc6 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:59.040467 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 653/1302] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:12:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:12:59.045840 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aebfef-b91b-4629-ba77-284fc5a7ffaf None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:59.046270 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aebfef-b91b-4629-ba77-284fc5a7ffaf None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:59.046441 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aebfef-b91b-4629-ba77-284fc5a7ffaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:59.063443 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-62aebfef-b91b-4629-ba77-284fc5a7ffaf None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:12:59.064624 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-62aebfef-b91b-4629-ba77-284fc5a7ffaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:12:59.132915 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 650/1303] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:12:59 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:12:59.155489 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a992a0e-8d54-4e11-9b7d-38d0ea8e7dc6 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:12:59.249174 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:12:59.255723 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a992a0e-8d54-4e11-9b7d-38d0ea8e7dc6 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:12:59.287754 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5debc010-6ea5-4502-a748-02ddff045e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:12:59.288545 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debc010-6ea5-4502-a748-02ddff045e68 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:59.288832 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debc010-6ea5-4502-a748-02ddff045e68 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:59.289109 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debc010-6ea5-4502-a748-02ddff045e68 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:59.290273 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5debc010-6ea5-4502-a748-02ddff045e68 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:12:59.291915 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5debc010-6ea5-4502-a748-02ddff045e68 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:12:59.303507 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-5debc010-6ea5-4502-a748-02ddff045e68 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 27 16:12:59.303507 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:12:59.303507 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 16:12:59.303507 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 16:12:59.303507 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 16:12:59.303507 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 16:12:59.303507 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 16:12:59.303507 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:12:59.303507 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 27 16:12:59.303507 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:12:59.303507 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 16:12:59.303507 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:12:59.303507 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:12:59.303507 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:12:59.303507 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:12:59.303507 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:12:59.303507 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:12:59.304707 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:12:59.304707 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:12:59.304707 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:12:59.304707 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:12:59.304707 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:12:59.304707 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:12:59.304707 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 16:12:59.304707 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 16:12:59.304707 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 16:12:59.304707 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 16:12:59.304707 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:12:59.304707 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:12:59.304707 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:12:59.304707 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:12:59.304707 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:12:59.304707 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:12:59.306284 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:12:59.306284 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 16:12:59.306284 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:12:59.306284 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 16:12:59.306284 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:12:59.306284 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:12:59.306284 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:12:59.306284 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 16:12:59.306284 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:12:59.306284 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 16:12:59.306284 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 16:12:59.306284 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:12:59.306284 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 27 16:12:59.306284 dv-cinder-840493-2-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 16:12:59.306284 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 654/1304] 10.222.0.62 () {56 vars in 1117 bytes} [Fri May 27 16:12:59 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:12:59.311275 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aebfef-b91b-4629-ba77-284fc5a7ffaf None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:12:59.385508 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:12:59.408132 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aebfef-b91b-4629-ba77-284fc5a7ffaf None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:12:59.451830 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fed03a-0383-4b40-8d8c-bf810f44f112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:12:59.452501 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fed03a-0383-4b40-8d8c-bf810f44f112 None admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:59.452790 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fed03a-0383-4b40-8d8c-bf810f44f112 None admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:59.453070 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fed03a-0383-4b40-8d8c-bf810f44f112 None admin] PATH_INFO: `/v3/services` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:59.453835 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fed03a-0383-4b40-8d8c-bf810f44f112 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:12:59.454143 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fed03a-0383-4b40-8d8c-bf810f44f112 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:12:59.455554 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fed03a-0383-4b40-8d8c-bf810f44f112 None admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:12:59.460597 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 651/1305] 10.222.0.62 () {56 vars in 1116 bytes} [Fri May 27 16:12:59 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:12:59.466907 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5debc010-6ea5-4502-a748-02ddff045e68 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:12:59.568589 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5debc010-6ea5-4502-a748-02ddff045e68 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:12:59.600852 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9662b4a2-14b9-47ca-a96b-c1e36cac235d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:12:59.601505 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9662b4a2-14b9-47ca-a96b-c1e36cac235d None admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:12:59.602382 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9662b4a2-14b9-47ca-a96b-c1e36cac235d None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:12:59.602663 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9662b4a2-14b9-47ca-a96b-c1e36cac235d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:12:59.603396 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9662b4a2-14b9-47ca-a96b-c1e36cac235d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:12:59.604757 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9662b4a2-14b9-47ca-a96b-c1e36cac235d None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:12:59.702332 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 655/1306] 10.222.0.62 () {60 vars in 1144 bytes} [Fri May 27 16:12:59 2022] POST /identity/v3/endpoints => generated 331 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:13:09.507367 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=30 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:13:09.697757 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:51.228269 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60219cb5-8996-4336-a7ba-aa222ebe8877 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:51.228856 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60219cb5-8996-4336-a7ba-aa222ebe8877 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:51.228856 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60219cb5-8996-4336-a7ba-aa222ebe8877 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:51.230568 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 652/1307] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:20:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:20:51.241923 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed933d6-37de-4049-9776-6f27e289d0f4 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:51.241923 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed933d6-37de-4049-9776-6f27e289d0f4 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:51.241923 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed933d6-37de-4049-9776-6f27e289d0f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:51.324707 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-2ed933d6-37de-4049-9776-6f27e289d0f4 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:20:51.326290 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-2ed933d6-37de-4049-9776-6f27e289d0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:20:51.453967 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 656/1308] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:20:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:20:51.491177 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5270c6c0-0cd9-4677-9822-0baba9067623 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:51.491838 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5270c6c0-0cd9-4677-9822-0baba9067623 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:51.492351 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5270c6c0-0cd9-4677-9822-0baba9067623 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:51.494203 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 653/1309] 10.222.0.62 () {54 vars in 964 bytes} [Fri May 27 16:20:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:20:51.500186 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7b944-8a36-41d9-a1d3-d9aba7f7b445 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:51.500479 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7b944-8a36-41d9-a1d3-d9aba7f7b445 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:51.500764 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7b944-8a36-41d9-a1d3-d9aba7f7b445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:51.644309 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-33f7b944-8a36-41d9-a1d3-d9aba7f7b445 None None] MFA Rules not processed for user `b367ccea28d540a0b24ec4e42ebfef65`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:20:51.645846 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-33f7b944-8a36-41d9-a1d3-d9aba7f7b445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:20:51.683555 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:51.820501 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 657/1310] 10.222.0.62 () {58 vars in 1061 bytes} [Fri May 27 16:20:51 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:20:51.830824 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5270c6c0-0cd9-4677-9822-0baba9067623 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:51.833157 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-5270c6c0-0cd9-4677-9822-0baba9067623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:20:52.017024 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5270c6c0-0cd9-4677-9822-0baba9067623 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:52.104570 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f19566-8b3b-47be-a6dd-3aa2c801c8b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:52.105446 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f19566-8b3b-47be-a6dd-3aa2c801c8b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:52.105967 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f19566-8b3b-47be-a6dd-3aa2c801c8b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:52.106394 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f19566-8b3b-47be-a6dd-3aa2c801c8b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:52.108232 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-54f19566-8b3b-47be-a6dd-3aa2c801c8b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:20:52.171027 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:52.235848 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f19566-8b3b-47be-a6dd-3aa2c801c8b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:52.237713 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f19566-8b3b-47be-a6dd-3aa2c801c8b0 service neutron] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:52.277442 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 654/1311] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:20:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 16:20:54.865930 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21472642-dbcf-4043-8f5d-c5ae1faf6cd4 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:54.866501 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21472642-dbcf-4043-8f5d-c5ae1faf6cd4 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:54.866901 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21472642-dbcf-4043-8f5d-c5ae1faf6cd4 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:54.868491 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 658/1312] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:20:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:20:54.875657 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd8fb6a-0eef-45e0-9e6e-2f44661627bc None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:54.876077 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd8fb6a-0eef-45e0-9e6e-2f44661627bc None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:54.876269 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd8fb6a-0eef-45e0-9e6e-2f44661627bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:55.002460 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-3cd8fb6a-0eef-45e0-9e6e-2f44661627bc None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:20:55.003722 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-3cd8fb6a-0eef-45e0-9e6e-2f44661627bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:20:55.104725 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 655/1313] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:20:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:20:55.142321 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21472642-dbcf-4043-8f5d-c5ae1faf6cd4 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:55.143969 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-21472642-dbcf-4043-8f5d-c5ae1faf6cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:20:55.252656 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21472642-dbcf-4043-8f5d-c5ae1faf6cd4 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:55.330724 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:55.333509 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94ce575-a4ae-4966-9d3b-f00a6083cc00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:55.334208 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ce575-a4ae-4966-9d3b-f00a6083cc00 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:55.334532 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ce575-a4ae-4966-9d3b-f00a6083cc00 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:55.334828 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ce575-a4ae-4966-9d3b-f00a6083cc00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:55.336614 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-e94ce575-a4ae-4966-9d3b-f00a6083cc00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:20:55.449489 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94ce575-a4ae-4966-9d3b-f00a6083cc00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:55.450965 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94ce575-a4ae-4966-9d3b-f00a6083cc00 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:55.469462 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 659/1314] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:20:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:20:58.266420 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621d09a-55ff-418b-be59-d4a730a18265 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:58.266955 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621d09a-55ff-418b-be59-d4a730a18265 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:58.266955 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621d09a-55ff-418b-be59-d4a730a18265 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:58.268249 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 656/1315] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:20:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:20:58.273366 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711dec6b-4251-42d0-b2d7-a3eabeb28641 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:58.273805 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711dec6b-4251-42d0-b2d7-a3eabeb28641 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:58.273930 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711dec6b-4251-42d0-b2d7-a3eabeb28641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:58.338981 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-711dec6b-4251-42d0-b2d7-a3eabeb28641 None None] MFA Rules not processed for user `13643c5d35d44115a5784bad3c8e4cf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:20:58.340199 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-711dec6b-4251-42d0-b2d7-a3eabeb28641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:20:58.391127 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:58.435160 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 660/1316] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:20:58 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:20:58.473978 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1621d09a-55ff-418b-be59-d4a730a18265 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:58.475706 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-1621d09a-55ff-418b-be59-d4a730a18265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:20:58.485960 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:58.580869 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1621d09a-55ff-418b-be59-d4a730a18265 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:58.654515 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d66d13a-c10e-4d10-9a63-1a93d99fa41f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:58.655156 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d66d13a-c10e-4d10-9a63-1a93d99fa41f service neutron] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:58.655443 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d66d13a-c10e-4d10-9a63-1a93d99fa41f service neutron] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:58.655726 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d66d13a-c10e-4d10-9a63-1a93d99fa41f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:58.657380 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-9d66d13a-c10e-4d10-9a63-1a93d99fa41f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:20:58.717851 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:58.763228 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d66d13a-c10e-4d10-9a63-1a93d99fa41f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:58.764654 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d66d13a-c10e-4d10-9a63-1a93d99fa41f service neutron] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:58.782898 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 657/1317] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:20:58 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:21:02.056917 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b1f7ab-aa30-4f1d-a89e-d9ec02acc12f None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:02.057446 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b1f7ab-aa30-4f1d-a89e-d9ec02acc12f None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:02.057446 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b1f7ab-aa30-4f1d-a89e-d9ec02acc12f None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:02.058875 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 661/1318] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:21:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:21:02.064057 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0502da22-9451-4e44-acb8-faf8c05dbebb None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:02.064501 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0502da22-9451-4e44-acb8-faf8c05dbebb None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:02.064606 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0502da22-9451-4e44-acb8-faf8c05dbebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:02.128225 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-0502da22-9451-4e44-acb8-faf8c05dbebb None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:21:02.129360 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-0502da22-9451-4e44-acb8-faf8c05dbebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:21:02.224749 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 658/1319] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:21:02 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:21:02.263363 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b1f7ab-aa30-4f1d-a89e-d9ec02acc12f None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:02.264902 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-72b1f7ab-aa30-4f1d-a89e-d9ec02acc12f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:21:02.366739 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b1f7ab-aa30-4f1d-a89e-d9ec02acc12f None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:02.439105 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd4c0f6-f779-4e15-a961-4d4bb90b2709 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:02.439681 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd4c0f6-f779-4e15-a961-4d4bb90b2709 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:02.439966 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd4c0f6-f779-4e15-a961-4d4bb90b2709 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:02.440241 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd4c0f6-f779-4e15-a961-4d4bb90b2709 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:02.441874 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-1fd4c0f6-f779-4e15-a961-4d4bb90b2709 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:21:02.449574 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:02.548875 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd4c0f6-f779-4e15-a961-4d4bb90b2709 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:02.550353 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd4c0f6-f779-4e15-a961-4d4bb90b2709 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:02.567895 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 662/1320] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:21:02 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:21:06.429934 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a55ee49-bf21-4d77-be85-4024ff736b1b None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:06.430516 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a55ee49-bf21-4d77-be85-4024ff736b1b None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:06.430516 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a55ee49-bf21-4d77-be85-4024ff736b1b None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:06.434749 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 659/1321] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:21:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:21:06.437856 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da11ca-5e98-406a-a069-e64823909906 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:06.438321 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da11ca-5e98-406a-a069-e64823909906 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:06.438457 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da11ca-5e98-406a-a069-e64823909906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:06.504548 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-30da11ca-5e98-406a-a069-e64823909906 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:21:06.505769 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-30da11ca-5e98-406a-a069-e64823909906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:21:06.563876 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:06.601613 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 663/1322] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:21:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:21:06.638018 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a55ee49-bf21-4d77-be85-4024ff736b1b None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:06.639595 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-1a55ee49-bf21-4d77-be85-4024ff736b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:21:06.659720 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:06.742618 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a55ee49-bf21-4d77-be85-4024ff736b1b None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:06.815033 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed831a1b-c61b-4e6e-95a3-6484e1a8903e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:06.815673 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed831a1b-c61b-4e6e-95a3-6484e1a8903e service neutron] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:06.815951 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed831a1b-c61b-4e6e-95a3-6484e1a8903e service neutron] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:06.816221 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed831a1b-c61b-4e6e-95a3-6484e1a8903e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:06.817846 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-ed831a1b-c61b-4e6e-95a3-6484e1a8903e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:21:06.892856 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:06.930197 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed831a1b-c61b-4e6e-95a3-6484e1a8903e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:06.932182 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed831a1b-c61b-4e6e-95a3-6484e1a8903e service neutron] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:06.950916 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 660/1323] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:21:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:21:09.204007 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fee853-faba-40ee-af27-36b62cca7519 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:09.204575 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fee853-faba-40ee-af27-36b62cca7519 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:09.204575 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fee853-faba-40ee-af27-36b62cca7519 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:09.206018 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 664/1324] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:21:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:21:09.211346 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437e4dc-7f78-4693-aaf8-84565e2b580e None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:09.211785 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437e4dc-7f78-4693-aaf8-84565e2b580e None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:09.211956 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437e4dc-7f78-4693-aaf8-84565e2b580e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:09.276373 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-0437e4dc-7f78-4693-aaf8-84565e2b580e None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:21:09.277560 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-0437e4dc-7f78-4693-aaf8-84565e2b580e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:21:09.375210 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 661/1325] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:21:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:21:09.426387 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca6875-a103-425a-85d1-a816c7a9e387 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:09.426685 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca6875-a103-425a-85d1-a816c7a9e387 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:09.426994 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca6875-a103-425a-85d1-a816c7a9e387 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:09.428394 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 665/1326] 10.222.0.62 () {54 vars in 964 bytes} [Fri May 27 16:21:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:21:09.435080 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c1999-d583-46bc-9cf3-275ca875b87c None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:09.435385 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c1999-d583-46bc-9cf3-275ca875b87c None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:09.435674 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c1999-d583-46bc-9cf3-275ca875b87c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:09.467140 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:09.513025 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-413c1999-d583-46bc-9cf3-275ca875b87c None None] MFA Rules not processed for user `b367ccea28d540a0b24ec4e42ebfef65`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:21:09.514233 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-413c1999-d583-46bc-9cf3-275ca875b87c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:21:09.598026 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 662/1327] 10.222.0.62 () {58 vars in 1061 bytes} [Fri May 27 16:21:09 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:21:09.607576 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ca6875-a103-425a-85d1-a816c7a9e387 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:09.609240 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-16ca6875-a103-425a-85d1-a816c7a9e387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:21:09.714662 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ca6875-a103-425a-85d1-a816c7a9e387 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:09.786530 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d92066-fac6-4122-80e1-cf998fce0910 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:09.787097 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d92066-fac6-4122-80e1-cf998fce0910 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:09.787383 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d92066-fac6-4122-80e1-cf998fce0910 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:09.787659 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d92066-fac6-4122-80e1-cf998fce0910 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:09.789288 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-36d92066-fac6-4122-80e1-cf998fce0910 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:21:09.806147 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:09.898794 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d92066-fac6-4122-80e1-cf998fce0910 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:09.900765 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d92066-fac6-4122-80e1-cf998fce0910 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:09.920323 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 666/1328] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:21:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:21:12.417309 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d84b18-ee73-433b-8acb-84df1081d493 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:12.417847 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d84b18-ee73-433b-8acb-84df1081d493 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:12.417847 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d84b18-ee73-433b-8acb-84df1081d493 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:12.419277 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 663/1329] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:21:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:21:12.424460 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e2bcc-5f98-4c97-9594-c1cb64d59b8a None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:12.424867 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e2bcc-5f98-4c97-9594-c1cb64d59b8a None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:12.425029 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e2bcc-5f98-4c97-9594-c1cb64d59b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:12.492615 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-8f1e2bcc-5f98-4c97-9594-c1cb64d59b8a None None] MFA Rules not processed for user `13643c5d35d44115a5784bad3c8e4cf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:21:12.493830 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-8f1e2bcc-5f98-4c97-9594-c1cb64d59b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:21:12.557776 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:12.589844 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 667/1330] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:21:12 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:21:12.626143 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d84b18-ee73-433b-8acb-84df1081d493 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:12.627719 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-c5d84b18-ee73-433b-8acb-84df1081d493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:21:12.732812 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d84b18-ee73-433b-8acb-84df1081d493 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:12.752806 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:12.804306 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff8fc4d-e54d-4e8c-800c-af126283dc32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:12.804956 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff8fc4d-e54d-4e8c-800c-af126283dc32 service neutron] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:12.805237 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff8fc4d-e54d-4e8c-800c-af126283dc32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:12.805512 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff8fc4d-e54d-4e8c-800c-af126283dc32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:12.808416 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-7ff8fc4d-e54d-4e8c-800c-af126283dc32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:21:12.919770 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff8fc4d-e54d-4e8c-800c-af126283dc32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:12.921214 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff8fc4d-e54d-4e8c-800c-af126283dc32 service neutron] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:12.939614 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 664/1331] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:21:12 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:21:15.785469 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6723ed9-2764-4b1b-b420-5d36dde0afdc None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:15.788815 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6723ed9-2764-4b1b-b420-5d36dde0afdc None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:15.788815 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6723ed9-2764-4b1b-b420-5d36dde0afdc None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:15.788815 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 668/1332] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:21:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:21:15.793850 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3052e0-940f-4e55-bc1b-d9efaee31ea5 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:15.794384 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3052e0-940f-4e55-bc1b-d9efaee31ea5 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:15.794506 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3052e0-940f-4e55-bc1b-d9efaee31ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:15.867175 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-4d3052e0-940f-4e55-bc1b-d9efaee31ea5 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:21:15.869194 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:15.869973 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-4d3052e0-940f-4e55-bc1b-d9efaee31ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:21:15.978398 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 665/1333] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:21:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:21:16.013400 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6723ed9-2764-4b1b-b420-5d36dde0afdc None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:16.015033 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-c6723ed9-2764-4b1b-b420-5d36dde0afdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:21:16.123953 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6723ed9-2764-4b1b-b420-5d36dde0afdc None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:16.199137 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ee81e-7b7c-459f-bf1e-1b2845651b00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:16.199788 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ee81e-7b7c-459f-bf1e-1b2845651b00 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:16.200100 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ee81e-7b7c-459f-bf1e-1b2845651b00 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:16.200379 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ee81e-7b7c-459f-bf1e-1b2845651b00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:16.202055 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-203ee81e-7b7c-459f-bf1e-1b2845651b00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:21:16.230384 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:16.311592 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203ee81e-7b7c-459f-bf1e-1b2845651b00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:16.312992 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203ee81e-7b7c-459f-bf1e-1b2845651b00 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:16.331064 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 669/1334] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:21:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:21:18.590114 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c92ccb8-57a3-48f2-88f3-63ae7c6d87e8 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:18.590728 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c92ccb8-57a3-48f2-88f3-63ae7c6d87e8 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:18.590728 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c92ccb8-57a3-48f2-88f3-63ae7c6d87e8 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:18.592033 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 666/1335] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:21:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:21:18.597341 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f25ac-07bf-4e0d-8ddd-3e54aaa2d6ee None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:18.597769 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f25ac-07bf-4e0d-8ddd-3e54aaa2d6ee None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:18.597938 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f25ac-07bf-4e0d-8ddd-3e54aaa2d6ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:18.662758 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-454f25ac-07bf-4e0d-8ddd-3e54aaa2d6ee None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:21:18.663962 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-454f25ac-07bf-4e0d-8ddd-3e54aaa2d6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:21:18.742974 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:18.765389 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 670/1336] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:21:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:21:18.805310 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c92ccb8-57a3-48f2-88f3-63ae7c6d87e8 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:18.806874 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-8c92ccb8-57a3-48f2-88f3-63ae7c6d87e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:21:18.910444 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c92ccb8-57a3-48f2-88f3-63ae7c6d87e8 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:18.939341 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:18.983853 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8534f8e0-d890-4ad8-996c-a3a418aae516 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:18.984490 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8534f8e0-d890-4ad8-996c-a3a418aae516 service neutron] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:18.984767 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8534f8e0-d890-4ad8-996c-a3a418aae516 service neutron] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:18.985038 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8534f8e0-d890-4ad8-996c-a3a418aae516 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:18.986761 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-8534f8e0-d890-4ad8-996c-a3a418aae516 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:21:19.095724 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8534f8e0-d890-4ad8-996c-a3a418aae516 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:19.097325 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8534f8e0-d890-4ad8-996c-a3a418aae516 service neutron] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:19.115702 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 667/1337] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:21:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:21:21.906419 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56611e0-580f-4263-bccc-4ec568b86cc5 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:21.906964 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56611e0-580f-4263-bccc-4ec568b86cc5 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:21.906964 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56611e0-580f-4263-bccc-4ec568b86cc5 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:21.908369 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 671/1338] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:21:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:21:21.913826 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97f8fb-e318-4acc-9476-f7f0c602cde1 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:21.914207 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97f8fb-e318-4acc-9476-f7f0c602cde1 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:21.914488 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97f8fb-e318-4acc-9476-f7f0c602cde1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:21.984079 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-1d97f8fb-e318-4acc-9476-f7f0c602cde1 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:21:21.985272 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-1d97f8fb-e318-4acc-9476-f7f0c602cde1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:21:21.993878 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:22.089984 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 668/1339] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:21:21 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:21:22.124458 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56611e0-580f-4263-bccc-4ec568b86cc5 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:22.126638 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-e56611e0-580f-4263-bccc-4ec568b86cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:21:22.224486 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56611e0-580f-4263-bccc-4ec568b86cc5 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:22.228087 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140df00c-c9fa-4307-b03a-569c7e61846e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:22.228727 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140df00c-c9fa-4307-b03a-569c7e61846e service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:22.229015 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140df00c-c9fa-4307-b03a-569c7e61846e service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:22.229298 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140df00c-c9fa-4307-b03a-569c7e61846e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:22.238468 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140df00c-c9fa-4307-b03a-569c7e61846e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:22.240094 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140df00c-c9fa-4307-b03a-569c7e61846e service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:22.249433 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 672/1340] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:21:22 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:21:26.869785 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6bf941-7ce6-4d49-ab9b-27e6be8e5629 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:26.874152 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6bf941-7ce6-4d49-ab9b-27e6be8e5629 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:26.874152 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6bf941-7ce6-4d49-ab9b-27e6be8e5629 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:26.874152 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 669/1341] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:21:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:21:26.876986 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f8e46-f62e-4929-9309-9d5227f680ff None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:26.877413 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f8e46-f62e-4929-9309-9d5227f680ff None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:26.877627 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f8e46-f62e-4929-9309-9d5227f680ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:26.907377 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-af5f8e46-f62e-4929-9309-9d5227f680ff None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:21:26.908569 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-af5f8e46-f62e-4929-9309-9d5227f680ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:21:26.986643 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 673/1342] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:21:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:21:27.026499 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6bf941-7ce6-4d49-ab9b-27e6be8e5629 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:27.037661 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6bf941-7ce6-4d49-ab9b-27e6be8e5629 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:27.041484 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024d4f29-daf8-4b79-ad15-cf35f569881c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:27.042115 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d4f29-daf8-4b79-ad15-cf35f569881c service neutron] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:27.042430 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d4f29-daf8-4b79-ad15-cf35f569881c service neutron] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:27.042707 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d4f29-daf8-4b79-ad15-cf35f569881c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:27.052857 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024d4f29-daf8-4b79-ad15-cf35f569881c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:27.054601 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024d4f29-daf8-4b79-ad15-cf35f569881c service neutron] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:27.065727 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 670/1343] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:21:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:21:30.311371 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f99d6-df6d-45cc-90e2-2a027c2a3c0e None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:30.311937 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f99d6-df6d-45cc-90e2-2a027c2a3c0e None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:30.311937 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f99d6-df6d-45cc-90e2-2a027c2a3c0e None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:30.313299 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 674/1344] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:21:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:21:30.318467 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d642e749-fef2-425f-922f-761e1849c1a2 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:30.318936 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d642e749-fef2-425f-922f-761e1849c1a2 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:30.319045 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d642e749-fef2-425f-922f-761e1849c1a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:30.337927 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-d642e749-fef2-425f-922f-761e1849c1a2 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:21:30.339154 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-d642e749-fef2-425f-922f-761e1849c1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:21:30.346930 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 671/1345] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:21:30 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:21:30.382687 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f99d6-df6d-45cc-90e2-2a027c2a3c0e None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:30.393744 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f99d6-df6d-45cc-90e2-2a027c2a3c0e None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:30.397299 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8da726-124f-492b-8345-65ce80434510 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:30.397994 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8da726-124f-492b-8345-65ce80434510 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:30.398439 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8da726-124f-492b-8345-65ce80434510 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:30.398786 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8da726-124f-492b-8345-65ce80434510 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:30.408400 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8da726-124f-492b-8345-65ce80434510 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:30.409813 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8da726-124f-492b-8345-65ce80434510 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:30.419262 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 675/1346] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:21:30 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:21:34.876225 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4b79ae-2254-4b48-878b-5d8c63818a32 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:34.876677 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4b79ae-2254-4b48-878b-5d8c63818a32 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:34.876770 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4b79ae-2254-4b48-878b-5d8c63818a32 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:34.878144 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 672/1347] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:21:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:21:34.884156 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e32a4-eb1d-46e7-8416-178f0625c8d8 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:34.884574 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e32a4-eb1d-46e7-8416-178f0625c8d8 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:34.884892 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e32a4-eb1d-46e7-8416-178f0625c8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:34.903504 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-ff2e32a4-eb1d-46e7-8416-178f0625c8d8 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:21:34.904685 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-ff2e32a4-eb1d-46e7-8416-178f0625c8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:21:34.912451 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 676/1348] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:21:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:21:34.949631 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4b79ae-2254-4b48-878b-5d8c63818a32 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:34.960251 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4b79ae-2254-4b48-878b-5d8c63818a32 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:34.964434 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f6af1d-3739-4874-baf9-11a56f3725b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:34.965014 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6af1d-3739-4874-baf9-11a56f3725b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:34.965297 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6af1d-3739-4874-baf9-11a56f3725b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:34.965574 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6af1d-3739-4874-baf9-11a56f3725b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:34.975072 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f6af1d-3739-4874-baf9-11a56f3725b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:34.976504 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f6af1d-3739-4874-baf9-11a56f3725b5 service neutron] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:34.986190 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 673/1349] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:21:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:21:40.454389 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d1f25-3f48-4ec8-8b2f-376448089c75 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:40.455268 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d1f25-3f48-4ec8-8b2f-376448089c75 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:40.455730 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d1f25-3f48-4ec8-8b2f-376448089c75 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:40.457614 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 677/1350] 10.222.0.62 () {54 vars in 921 bytes} [Fri May 27 16:21:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:21:40.463271 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ff285-f396-4f3f-8267-1572dad69f86 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:40.464122 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ff285-f396-4f3f-8267-1572dad69f86 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:40.464623 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ff285-f396-4f3f-8267-1572dad69f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:40.538337 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-0e9ff285-f396-4f3f-8267-1572dad69f86 None None] MFA Rules not processed for user `35d98c4a2af546d8b655d649d655f447`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:21:40.541419 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-0e9ff285-f396-4f3f-8267-1572dad69f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:21:40.597886 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:40.621868 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 674/1351] 10.222.0.62 () {58 vars in 1018 bytes} [Fri May 27 16:21:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:21:44.897385 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=98 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:44.914219 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac21a67-aefc-4689-af4e-7c837199ffe0 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:44.914523 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac21a67-aefc-4689-af4e-7c837199ffe0 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:44.914802 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac21a67-aefc-4689-af4e-7c837199ffe0 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:44.916252 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 678/1352] 10.222.0.62 () {54 vars in 921 bytes} [Fri May 27 16:21:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:21:44.921542 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f17f12-beeb-4586-977e-130e3e1d39cf None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:44.922543 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f17f12-beeb-4586-977e-130e3e1d39cf None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:44.923055 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f17f12-beeb-4586-977e-130e3e1d39cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:44.943124 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-c7f17f12-beeb-4586-977e-130e3e1d39cf None None] MFA Rules not processed for user `35d98c4a2af546d8b655d649d655f447`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:21:44.944699 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-c7f17f12-beeb-4586-977e-130e3e1d39cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:21:44.954725 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 675/1353] 10.222.0.62 () {58 vars in 1018 bytes} [Fri May 27 16:21:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:21:46.467881 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b43d4a-bcf0-45ad-8df5-e8dd9e522dcb None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:46.468488 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b43d4a-bcf0-45ad-8df5-e8dd9e522dcb None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:46.471206 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b43d4a-bcf0-45ad-8df5-e8dd9e522dcb None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:46.471206 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 679/1354] 10.222.0.62 () {54 vars in 921 bytes} [Fri May 27 16:21:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:21:46.475848 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c6431-c971-4d8e-bafd-6b9083e35ca3 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:46.476302 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c6431-c971-4d8e-bafd-6b9083e35ca3 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:46.478546 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c6431-c971-4d8e-bafd-6b9083e35ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:46.495556 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-df1c6431-c971-4d8e-bafd-6b9083e35ca3 None None] MFA Rules not processed for user `35d98c4a2af546d8b655d649d655f447`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:21:46.496739 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-df1c6431-c971-4d8e-bafd-6b9083e35ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:21:46.505243 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 676/1355] 10.222.0.62 () {58 vars in 1018 bytes} [Fri May 27 16:21:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:21:50.422409 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e1b31-013e-4769-9bc3-95952a9224d4 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:50.422987 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e1b31-013e-4769-9bc3-95952a9224d4 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:50.422987 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e1b31-013e-4769-9bc3-95952a9224d4 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:50.424619 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 680/1356] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:21:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:21:50.430019 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80af56-c2b5-41d4-a21e-fb8b6bf6a1eb None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:50.430504 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80af56-c2b5-41d4-a21e-fb8b6bf6a1eb None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:50.430618 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80af56-c2b5-41d4-a21e-fb8b6bf6a1eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:50.448712 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-3b80af56-c2b5-41d4-a21e-fb8b6bf6a1eb None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:21:50.449831 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-3b80af56-c2b5-41d4-a21e-fb8b6bf6a1eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:21:50.458141 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 677/1357] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:21:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:21:50.517000 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3220ab5f-2d19-4d9e-a2d7-8b5c39587f35 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:50.525393 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3220ab5f-2d19-4d9e-a2d7-8b5c39587f35 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:50.526374 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3220ab5f-2d19-4d9e-a2d7-8b5c39587f35 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:50.528827 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 681/1358] 10.222.0.62 () {54 vars in 961 bytes} [Fri May 27 16:21:50 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:21:50.536557 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db742671-7b67-4080-84d6-a657b56ebfd9 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:50.537517 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db742671-7b67-4080-84d6-a657b56ebfd9 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:50.538136 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db742671-7b67-4080-84d6-a657b56ebfd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:50.596847 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-db742671-7b67-4080-84d6-a657b56ebfd9 None None] MFA Rules not processed for user `cb13ad6d8b1e46029262556bff398796`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:21:50.598434 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-db742671-7b67-4080-84d6-a657b56ebfd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:21:50.701875 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 678/1359] 10.222.0.62 () {58 vars in 1058 bytes} [Fri May 27 16:21:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:21:50.709877 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3220ab5f-2d19-4d9e-a2d7-8b5c39587f35 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:50.725069 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3220ab5f-2d19-4d9e-a2d7-8b5c39587f35 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:50.730706 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca89b8e1-937f-4098-adb0-617b1f73ed95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb13ad6d8b1e46029262556bff398796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:50.731335 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca89b8e1-937f-4098-adb0-617b1f73ed95 service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:50.731618 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca89b8e1-937f-4098-adb0-617b1f73ed95 service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:50.731894 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca89b8e1-937f-4098-adb0-617b1f73ed95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:50.740125 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca89b8e1-937f-4098-adb0-617b1f73ed95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:50.741733 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca89b8e1-937f-4098-adb0-617b1f73ed95 service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:50.751745 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 682/1360] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:21:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 16:21:53.183206 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb1dc60-9bc1-4525-8f61-2cf7da47a905 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:53.183730 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb1dc60-9bc1-4525-8f61-2cf7da47a905 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:53.183730 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb1dc60-9bc1-4525-8f61-2cf7da47a905 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:53.185350 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 679/1361] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:21:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:21:53.190627 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23832e-f4c0-4c63-9d27-6a291779196b None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:53.191072 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23832e-f4c0-4c63-9d27-6a291779196b None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:53.191195 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23832e-f4c0-4c63-9d27-6a291779196b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:53.209719 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-4a23832e-f4c0-4c63-9d27-6a291779196b None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:21:53.212267 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-4a23832e-f4c0-4c63-9d27-6a291779196b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:21:53.222587 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 683/1362] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:21:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:21:53.265932 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb1dc60-9bc1-4525-8f61-2cf7da47a905 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:53.281684 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb1dc60-9bc1-4525-8f61-2cf7da47a905 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:53.287141 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0c2278-5714-413a-8456-e507be827555 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb13ad6d8b1e46029262556bff398796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:53.287904 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c2278-5714-413a-8456-e507be827555 service nova] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:53.288102 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c2278-5714-413a-8456-e507be827555 service nova] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:53.288463 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c2278-5714-413a-8456-e507be827555 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:53.297488 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0c2278-5714-413a-8456-e507be827555 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:53.299124 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0c2278-5714-413a-8456-e507be827555 service nova] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:53.310557 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 680/1363] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:21:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:21:56.026525 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6930f6c1-f91f-4c8b-a5ec-ab2de4730c2a None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:56.027309 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6930f6c1-f91f-4c8b-a5ec-ab2de4730c2a None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:56.027407 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6930f6c1-f91f-4c8b-a5ec-ab2de4730c2a None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:56.028722 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 684/1364] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:21:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:21:56.033840 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ab3f5-b75f-4b2d-a447-289a010c8c38 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:56.034289 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ab3f5-b75f-4b2d-a447-289a010c8c38 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:56.034432 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ab3f5-b75f-4b2d-a447-289a010c8c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:56.054912 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-420ab3f5-b75f-4b2d-a447-289a010c8c38 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:21:56.056258 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-420ab3f5-b75f-4b2d-a447-289a010c8c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:21:56.064372 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 681/1365] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:21:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:21:56.112838 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b362d306-688b-4516-b7ea-6dcb3629d7fd None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:56.113134 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b362d306-688b-4516-b7ea-6dcb3629d7fd None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:56.113438 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b362d306-688b-4516-b7ea-6dcb3629d7fd None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:56.114906 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 685/1366] 10.222.0.62 () {54 vars in 961 bytes} [Fri May 27 16:21:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:21:56.139339 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b69b9a-25af-45d0-9338-5a5576044c25 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:56.139339 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b69b9a-25af-45d0-9338-5a5576044c25 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:56.139339 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b69b9a-25af-45d0-9338-5a5576044c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:56.155291 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-e9b69b9a-25af-45d0-9338-5a5576044c25 None None] MFA Rules not processed for user `cb13ad6d8b1e46029262556bff398796`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:21:56.156821 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-e9b69b9a-25af-45d0-9338-5a5576044c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:21:56.168592 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 682/1367] 10.222.0.62 () {58 vars in 1058 bytes} [Fri May 27 16:21:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:21:56.177015 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b362d306-688b-4516-b7ea-6dcb3629d7fd None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:56.200006 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b362d306-688b-4516-b7ea-6dcb3629d7fd None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:56.202492 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfcf9ea-6e4e-4547-abb9-6fd933c7d24e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb13ad6d8b1e46029262556bff398796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:56.203154 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfcf9ea-6e4e-4547-abb9-6fd933c7d24e service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:56.203440 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfcf9ea-6e4e-4547-abb9-6fd933c7d24e service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:56.203719 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfcf9ea-6e4e-4547-abb9-6fd933c7d24e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:56.214017 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfcf9ea-6e4e-4547-abb9-6fd933c7d24e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:56.215672 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfcf9ea-6e4e-4547-abb9-6fd933c7d24e service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:56.230906 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 686/1368] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:21:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:21:58.692749 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0856bcd2-f282-46a8-9402-658d9f96575b None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:58.693304 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0856bcd2-f282-46a8-9402-658d9f96575b None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:58.693304 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0856bcd2-f282-46a8-9402-658d9f96575b None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:58.694802 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 683/1369] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:21:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:21:58.700887 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b0bce-bfd1-4349-a38e-6838e7346b87 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:58.701407 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b0bce-bfd1-4349-a38e-6838e7346b87 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:58.701683 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b0bce-bfd1-4349-a38e-6838e7346b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:58.723819 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-976b0bce-bfd1-4349-a38e-6838e7346b87 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:21:58.725477 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-976b0bce-bfd1-4349-a38e-6838e7346b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:21:58.735079 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 687/1370] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:21:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:21:58.781326 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0856bcd2-f282-46a8-9402-658d9f96575b None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:58.796483 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0856bcd2-f282-46a8-9402-658d9f96575b None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:58.801868 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41d2f4f-f3c3-44bb-998f-42959dc6c02d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb13ad6d8b1e46029262556bff398796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:58.802538 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d2f4f-f3c3-44bb-998f-42959dc6c02d service nova] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:58.802824 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d2f4f-f3c3-44bb-998f-42959dc6c02d service nova] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:58.803101 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d2f4f-f3c3-44bb-998f-42959dc6c02d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:58.811846 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41d2f4f-f3c3-44bb-998f-42959dc6c02d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:58.813432 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41d2f4f-f3c3-44bb-998f-42959dc6c02d service nova] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:58.824283 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 684/1371] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:21:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:21:58.868889 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6e2ee-da1b-421e-bf76-5e55c775a2f0 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:58.869626 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6e2ee-da1b-421e-bf76-5e55c775a2f0 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:58.869626 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6e2ee-da1b-421e-bf76-5e55c775a2f0 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:58.870875 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 688/1372] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:21:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:21:58.876846 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a984d620-58df-4dd8-ad8a-bb08a94f8229 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:58.877140 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a984d620-58df-4dd8-ad8a-bb08a94f8229 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:58.877599 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a984d620-58df-4dd8-ad8a-bb08a94f8229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:58.896798 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-a984d620-58df-4dd8-ad8a-bb08a94f8229 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:21:58.898094 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-a984d620-58df-4dd8-ad8a-bb08a94f8229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:21:58.906637 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 685/1373] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:21:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:21:59.187094 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea988acc-e811-427b-8acf-f30c33faabd7 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:59.187605 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea988acc-e811-427b-8acf-f30c33faabd7 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:59.187981 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea988acc-e811-427b-8acf-f30c33faabd7 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:59.189468 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 689/1374] 10.222.0.62 () {54 vars in 963 bytes} [Fri May 27 16:21:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:21:59.199483 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc644b40-82b2-4ac9-8a38-ec2500a01f67 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:59.199483 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc644b40-82b2-4ac9-8a38-ec2500a01f67 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:59.199483 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc644b40-82b2-4ac9-8a38-ec2500a01f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:59.253970 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-bc644b40-82b2-4ac9-8a38-ec2500a01f67 None None] MFA Rules not processed for user `d8693a1e72f14fdfb383f11e96330726`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:21:59.255331 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-bc644b40-82b2-4ac9-8a38-ec2500a01f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:21:59.260460 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:59.320243 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 686/1375] 10.222.0.62 () {58 vars in 1060 bytes} [Fri May 27 16:21:59 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:21:59.327780 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea988acc-e811-427b-8acf-f30c33faabd7 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:59.339859 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea988acc-e811-427b-8acf-f30c33faabd7 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:59.343379 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c888a15b-c651-492b-a3a6-960177190cd5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8693a1e72f14fdfb383f11e96330726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:59.344078 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888a15b-c651-492b-a3a6-960177190cd5 service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:59.344369 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888a15b-c651-492b-a3a6-960177190cd5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:59.344647 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888a15b-c651-492b-a3a6-960177190cd5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:59.354261 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c888a15b-c651-492b-a3a6-960177190cd5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:59.355751 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c888a15b-c651-492b-a3a6-960177190cd5 service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:59.365950 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 690/1376] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:21:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:22:01.264999 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff72b1-1f1c-48e1-ab69-3792b322e8c0 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:01.265532 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff72b1-1f1c-48e1-ab69-3792b322e8c0 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:01.265532 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff72b1-1f1c-48e1-ab69-3792b322e8c0 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:01.266933 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 687/1377] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:22:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:22:01.272291 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2313b5ed-c4fc-41bc-968e-35ae05010431 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:01.273348 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2313b5ed-c4fc-41bc-968e-35ae05010431 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:01.273477 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2313b5ed-c4fc-41bc-968e-35ae05010431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:01.291938 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-2313b5ed-c4fc-41bc-968e-35ae05010431 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:22:01.293139 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-2313b5ed-c4fc-41bc-968e-35ae05010431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:22:01.301083 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 691/1378] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:22:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:22:01.346317 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff72b1-1f1c-48e1-ab69-3792b322e8c0 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:22:01.360950 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff72b1-1f1c-48e1-ab69-3792b322e8c0 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:22:01.366683 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f17770-42a5-4d79-a489-9e32b82e8dc7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb13ad6d8b1e46029262556bff398796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:22:01.367326 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f17770-42a5-4d79-a489-9e32b82e8dc7 service nova] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:01.367613 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f17770-42a5-4d79-a489-9e32b82e8dc7 service nova] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:01.367892 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f17770-42a5-4d79-a489-9e32b82e8dc7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:01.376439 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f17770-42a5-4d79-a489-9e32b82e8dc7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:22:01.378055 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f17770-42a5-4d79-a489-9e32b82e8dc7 service nova] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:22:01.388338 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 688/1379] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:22:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:22:03.781361 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c25a455-1d29-410f-a1fd-dc699a2f46ba None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:03.781884 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c25a455-1d29-410f-a1fd-dc699a2f46ba None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:03.782117 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c25a455-1d29-410f-a1fd-dc699a2f46ba None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:03.784038 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 692/1380] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:22:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:22:03.789660 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec84b8-8944-4b73-b954-1331f22f0bc0 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:03.790075 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec84b8-8944-4b73-b954-1331f22f0bc0 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:03.790386 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec84b8-8944-4b73-b954-1331f22f0bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:03.809095 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-79ec84b8-8944-4b73-b954-1331f22f0bc0 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:22:03.810297 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-79ec84b8-8944-4b73-b954-1331f22f0bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:22:03.818551 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 689/1381] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:22:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:22:03.861647 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c25a455-1d29-410f-a1fd-dc699a2f46ba None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:22:03.881091 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c25a455-1d29-410f-a1fd-dc699a2f46ba None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:22:03.887058 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf53920-b885-4b53-adf7-daa62564dccb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb13ad6d8b1e46029262556bff398796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:22:03.887694 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf53920-b885-4b53-adf7-daa62564dccb service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:03.887978 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf53920-b885-4b53-adf7-daa62564dccb service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:03.888256 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf53920-b885-4b53-adf7-daa62564dccb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:03.897008 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf53920-b885-4b53-adf7-daa62564dccb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:22:03.899149 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf53920-b885-4b53-adf7-daa62564dccb service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:22:03.909436 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 693/1382] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:22:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:22:06.334131 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0ebfb-6f25-4be3-ba03-4121ac03e0eb None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:06.335451 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0ebfb-6f25-4be3-ba03-4121ac03e0eb None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:06.335451 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0ebfb-6f25-4be3-ba03-4121ac03e0eb None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:06.336682 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 690/1383] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:22:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:22:06.347552 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0907b142-5d28-419a-8f71-8cab0dea0684 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:06.347552 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0907b142-5d28-419a-8f71-8cab0dea0684 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:06.347552 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0907b142-5d28-419a-8f71-8cab0dea0684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:06.363437 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-0907b142-5d28-419a-8f71-8cab0dea0684 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:22:06.364633 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-0907b142-5d28-419a-8f71-8cab0dea0684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:22:06.372751 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 694/1384] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:22:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:22:06.414100 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d0ebfb-6f25-4be3-ba03-4121ac03e0eb None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:22:06.428997 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d0ebfb-6f25-4be3-ba03-4121ac03e0eb None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:22:06.434700 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4158ee7-ba8d-48eb-b5e5-a56732ce3767 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb13ad6d8b1e46029262556bff398796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:22:06.435525 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4158ee7-ba8d-48eb-b5e5-a56732ce3767 service nova] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:06.435977 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4158ee7-ba8d-48eb-b5e5-a56732ce3767 service nova] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:06.436405 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4158ee7-ba8d-48eb-b5e5-a56732ce3767 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:06.445711 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4158ee7-ba8d-48eb-b5e5-a56732ce3767 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:22:06.447537 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4158ee7-ba8d-48eb-b5e5-a56732ce3767 service nova] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:22:06.457554 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 691/1385] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:22:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:22:08.668276 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ac953-19ea-47c0-94a0-93781b5fcde7 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:08.668847 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ac953-19ea-47c0-94a0-93781b5fcde7 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:08.669052 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ac953-19ea-47c0-94a0-93781b5fcde7 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:08.670866 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 695/1386] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:22:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 16:22:08.677534 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56269962-37e2-49d6-8487-1c04b87d812c None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:08.677950 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56269962-37e2-49d6-8487-1c04b87d812c None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:08.678377 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56269962-37e2-49d6-8487-1c04b87d812c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:08.697126 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-56269962-37e2-49d6-8487-1c04b87d812c None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:22:08.698350 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-56269962-37e2-49d6-8487-1c04b87d812c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:22:08.706848 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 692/1387] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:22:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:22:08.765420 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4ac953-19ea-47c0-94a0-93781b5fcde7 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:22:08.783985 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4ac953-19ea-47c0-94a0-93781b5fcde7 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:22:08.790758 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e7434-0b78-443b-b5b9-4282dbb266b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb13ad6d8b1e46029262556bff398796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:22:08.791602 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e7434-0b78-443b-b5b9-4282dbb266b8 service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:08.791967 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e7434-0b78-443b-b5b9-4282dbb266b8 service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:08.792328 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e7434-0b78-443b-b5b9-4282dbb266b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:08.802999 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4e7434-0b78-443b-b5b9-4282dbb266b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:22:08.805315 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4e7434-0b78-443b-b5b9-4282dbb266b8 service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:22:08.818192 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 696/1388] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:22:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:22:11.839910 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c57cc7-3d5b-4dcc-b99c-c658cdbca220 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:11.840495 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c57cc7-3d5b-4dcc-b99c-c658cdbca220 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:11.840495 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c57cc7-3d5b-4dcc-b99c-c658cdbca220 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:11.844810 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 693/1389] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:22:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:22:11.851581 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d5973f-efb2-4805-82b4-5910d53bfea4 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:11.852085 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d5973f-efb2-4805-82b4-5910d53bfea4 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:11.852202 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d5973f-efb2-4805-82b4-5910d53bfea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:11.873499 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-35d5973f-efb2-4805-82b4-5910d53bfea4 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:22:11.874736 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-35d5973f-efb2-4805-82b4-5910d53bfea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:22:11.884259 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 697/1390] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:22:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:22:11.939355 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c57cc7-3d5b-4dcc-b99c-c658cdbca220 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:22:11.954113 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c57cc7-3d5b-4dcc-b99c-c658cdbca220 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:22:11.960040 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570ac9c0-37c6-4781-9143-bc1f51b7d00b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb13ad6d8b1e46029262556bff398796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:22:11.960681 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ac9c0-37c6-4781-9143-bc1f51b7d00b service nova] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:11.960962 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ac9c0-37c6-4781-9143-bc1f51b7d00b service nova] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:11.961242 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ac9c0-37c6-4781-9143-bc1f51b7d00b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:11.969582 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570ac9c0-37c6-4781-9143-bc1f51b7d00b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:22:11.971193 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570ac9c0-37c6-4781-9143-bc1f51b7d00b service nova] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:22:11.981320 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 694/1391] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:22:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:22:14.383709 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b6601-2b2d-496a-bc9b-cb5b2cbfa0c9 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:14.384331 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b6601-2b2d-496a-bc9b-cb5b2cbfa0c9 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:14.384331 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b6601-2b2d-496a-bc9b-cb5b2cbfa0c9 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:14.385706 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 698/1392] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:22:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:22:14.391088 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826e0e6-6f83-424f-a51d-cd0493659ffb None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:14.391559 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826e0e6-6f83-424f-a51d-cd0493659ffb None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:14.391784 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826e0e6-6f83-424f-a51d-cd0493659ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:14.410533 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-c826e0e6-6f83-424f-a51d-cd0493659ffb None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:22:14.411735 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-c826e0e6-6f83-424f-a51d-cd0493659ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:22:14.420068 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 695/1393] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:22:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:22:14.463667 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b6601-2b2d-496a-bc9b-cb5b2cbfa0c9 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:22:14.479976 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b6601-2b2d-496a-bc9b-cb5b2cbfa0c9 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:22:14.485392 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1bdf64-f110-4a5a-9da4-0b869a17108f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb13ad6d8b1e46029262556bff398796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:22:14.486027 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1bdf64-f110-4a5a-9da4-0b869a17108f service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:14.486340 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1bdf64-f110-4a5a-9da4-0b869a17108f service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:14.486623 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1bdf64-f110-4a5a-9da4-0b869a17108f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:14.494893 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1bdf64-f110-4a5a-9da4-0b869a17108f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:22:14.496505 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1bdf64-f110-4a5a-9da4-0b869a17108f service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:22:14.506188 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 699/1394] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:22:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:22:15.271855 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e68d8-346f-43c0-948f-53b4f63cb701 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:15.272146 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e68d8-346f-43c0-948f-53b4f63cb701 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:15.272430 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e68d8-346f-43c0-948f-53b4f63cb701 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:15.273810 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 696/1395] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:22:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:22:15.279719 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b413b-fa77-4d97-9909-57b4fb1a1aaf None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:15.280015 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b413b-fa77-4d97-9909-57b4fb1a1aaf None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:15.280300 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b413b-fa77-4d97-9909-57b4fb1a1aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:15.286477 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=52 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:22:15.299079 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-088b413b-fa77-4d97-9909-57b4fb1a1aaf None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:22:15.300279 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-088b413b-fa77-4d97-9909-57b4fb1a1aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:22:15.308851 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 700/1396] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:22:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:22:15.364170 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e5b20-b6a0-4454-bfe6-ee1dfae47b40 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:15.364463 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e5b20-b6a0-4454-bfe6-ee1dfae47b40 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:15.364745 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e5b20-b6a0-4454-bfe6-ee1dfae47b40 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:15.366832 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 697/1397] 10.222.0.62 () {54 vars in 962 bytes} [Fri May 27 16:22:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:22:15.371908 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079496f6-d091-4c8b-9617-0c23493fa8ba None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:15.372207 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079496f6-d091-4c8b-9617-0c23493fa8ba None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:15.372492 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079496f6-d091-4c8b-9617-0c23493fa8ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:15.422129 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-079496f6-d091-4c8b-9617-0c23493fa8ba None None] MFA Rules not processed for user `2b072079733049e8ac204ebe5cc635ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:22:15.429489 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-079496f6-d091-4c8b-9617-0c23493fa8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:22:15.485488 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 701/1398] 10.222.0.62 () {58 vars in 1059 bytes} [Fri May 27 16:22:15 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:22:15.493885 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e5b20-b6a0-4454-bfe6-ee1dfae47b40 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:22:15.505451 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e5b20-b6a0-4454-bfe6-ee1dfae47b40 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:22:15.509121 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875d31f4-0492-41a6-ad06-d85d88c0d2d3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b072079733049e8ac204ebe5cc635ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:22:15.509844 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d31f4-0492-41a6-ad06-d85d88c0d2d3 service glance] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:15.510198 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d31f4-0492-41a6-ad06-d85d88c0d2d3 service glance] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:15.510569 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d31f4-0492-41a6-ad06-d85d88c0d2d3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:15.519520 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875d31f4-0492-41a6-ad06-d85d88c0d2d3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:22:15.520952 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875d31f4-0492-41a6-ad06-d85d88c0d2d3 service glance] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:22:15.531062 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 698/1399] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:22:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 16:22:16.282021 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d9a440-7bfb-4e50-bf3e-53ae97d01280 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:16.282350 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d9a440-7bfb-4e50-bf3e-53ae97d01280 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:16.282632 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d9a440-7bfb-4e50-bf3e-53ae97d01280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:16.332616 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-22d9a440-7bfb-4e50-bf3e-53ae97d01280 None None] MFA Rules not processed for user `eb50bf5f39b04ab689b55f46d3dd2640`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:22:16.333803 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-22d9a440-7bfb-4e50-bf3e-53ae97d01280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:22:16.404432 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 702/1400] 10.222.0.62 () {58 vars in 1009 bytes} [Fri May 27 16:22:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:22:16.448256 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e284627c-9e17-4807-8048-676d98c5662f None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:16.448626 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e284627c-9e17-4807-8048-676d98c5662f None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:16.448978 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e284627c-9e17-4807-8048-676d98c5662f None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:16.450499 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 699/1401] 10.222.0.62 () {54 vars in 942 bytes} [Fri May 27 16:22:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:22:16.457852 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51483616-42fb-403c-86de-0dadecc3b3f2 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:16.458391 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51483616-42fb-403c-86de-0dadecc3b3f2 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:16.458527 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51483616-42fb-403c-86de-0dadecc3b3f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:16.511220 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-51483616-42fb-403c-86de-0dadecc3b3f2 None None] MFA Rules not processed for user `e8e6ec55445045fcac5623b9b6ffa9ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:22:16.512493 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-51483616-42fb-403c-86de-0dadecc3b3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:22:16.526440 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:22:16.587750 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 703/1402] 10.222.0.62 () {58 vars in 1039 bytes} [Fri May 27 16:22:16 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:22:16.597159 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e284627c-9e17-4807-8048-676d98c5662f None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:22:16.616268 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e284627c-9e17-4807-8048-676d98c5662f None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:22:16.623938 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9eda74-a8bb-4ec7-96cd-858fdaa0966b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8e6ec55445045fcac5623b9b6ffa9ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:22:16.624771 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9eda74-a8bb-4ec7-96cd-858fdaa0966b service swift] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:16.625148 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9eda74-a8bb-4ec7-96cd-858fdaa0966b service swift] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:16.625493 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9eda74-a8bb-4ec7-96cd-858fdaa0966b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:16.636823 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9eda74-a8bb-4ec7-96cd-858fdaa0966b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:22:16.638848 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9eda74-a8bb-4ec7-96cd-858fdaa0966b service swift] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:22:16.648040 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 700/1403] 10.222.0.62 () {60 vars in 1384 bytes} [Fri May 27 16:22:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 27 16:22:16.875712 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12bfcbf-cdbb-4f9a-8378-a83d776f5549 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:16.876013 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12bfcbf-cdbb-4f9a-8378-a83d776f5549 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:16.876301 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12bfcbf-cdbb-4f9a-8378-a83d776f5549 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:16.877760 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 704/1404] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:22:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:22:16.883457 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca70a182-1c28-4e34-afe7-23160c425e96 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:16.883752 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca70a182-1c28-4e34-afe7-23160c425e96 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:16.884040 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca70a182-1c28-4e34-afe7-23160c425e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:16.902566 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-ca70a182-1c28-4e34-afe7-23160c425e96 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:22:16.903989 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-ca70a182-1c28-4e34-afe7-23160c425e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:22:16.912224 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 701/1405] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:22:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:22:16.956343 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12bfcbf-cdbb-4f9a-8378-a83d776f5549 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:22:16.971800 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12bfcbf-cdbb-4f9a-8378-a83d776f5549 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:22:16.977387 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76295ee4-a0bc-4d27-811e-a122832e4de7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb13ad6d8b1e46029262556bff398796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:22:16.978036 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76295ee4-a0bc-4d27-811e-a122832e4de7 service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:16.978381 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76295ee4-a0bc-4d27-811e-a122832e4de7 service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:16.978669 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76295ee4-a0bc-4d27-811e-a122832e4de7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:16.987027 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76295ee4-a0bc-4d27-811e-a122832e4de7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:22:16.988608 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76295ee4-a0bc-4d27-811e-a122832e4de7 service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:22:16.998050 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 705/1406] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:22:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:22:19.467690 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e28323-53f7-499d-be9b-0dc370f0e513 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:19.468210 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e28323-53f7-499d-be9b-0dc370f0e513 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:19.468326 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e28323-53f7-499d-be9b-0dc370f0e513 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:19.469623 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 702/1407] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:22:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:22:19.475783 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac473c-08da-455b-bd05-785fa0ef2aab None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:19.476580 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac473c-08da-455b-bd05-785fa0ef2aab None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:19.476862 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac473c-08da-455b-bd05-785fa0ef2aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:19.495478 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-1cac473c-08da-455b-bd05-785fa0ef2aab None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:22:19.496391 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-1cac473c-08da-455b-bd05-785fa0ef2aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:22:19.506278 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 706/1408] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:22:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:22:19.549508 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e28323-53f7-499d-be9b-0dc370f0e513 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:22:19.566912 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e28323-53f7-499d-be9b-0dc370f0e513 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:22:19.572512 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fddd2b7-a2c4-44a1-88a3-9012c9fb9445 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb13ad6d8b1e46029262556bff398796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:22:19.573257 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fddd2b7-a2c4-44a1-88a3-9012c9fb9445 service nova] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:19.573544 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fddd2b7-a2c4-44a1-88a3-9012c9fb9445 service nova] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:19.573819 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fddd2b7-a2c4-44a1-88a3-9012c9fb9445 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:19.585233 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fddd2b7-a2c4-44a1-88a3-9012c9fb9445 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:22:19.588968 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fddd2b7-a2c4-44a1-88a3-9012c9fb9445 service nova] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:22:19.600369 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 703/1409] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:22:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:22:29.489363 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=33 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:22:29.889867 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=71 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:22:41.956525 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d9107e-ea05-47db-8866-7dbf7d49f6f1 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:41.957119 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d9107e-ea05-47db-8866-7dbf7d49f6f1 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:41.957119 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d9107e-ea05-47db-8866-7dbf7d49f6f1 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:41.958670 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 707/1410] 10.222.0.62 () {54 vars in 918 bytes} [Fri May 27 16:22:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 16:22:41.963845 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e98ab-d89f-4640-8b2a-323f959a1e63 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:41.964256 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e98ab-d89f-4640-8b2a-323f959a1e63 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:41.964402 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e98ab-d89f-4640-8b2a-323f959a1e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:41.982117 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-765e98ab-d89f-4640-8b2a-323f959a1e63 None None] MFA Rules not processed for user `35d98c4a2af546d8b655d649d655f447`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:22:41.983327 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-765e98ab-d89f-4640-8b2a-323f959a1e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:22:41.992312 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 704/1411] 10.222.0.62 () {58 vars in 1015 bytes} [Fri May 27 16:22:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:22:42.007004 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9749fb8-aa03-4101-8480-5afa85ecbf00 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:42.007294 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9749fb8-aa03-4101-8480-5afa85ecbf00 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:42.007574 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9749fb8-aa03-4101-8480-5afa85ecbf00 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:42.008988 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 708/1412] 10.222.0.62 () {54 vars in 918 bytes} [Fri May 27 16:22:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:22:42.014057 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef4732-5259-4dce-a1fd-712b5465a0be None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:42.014375 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef4732-5259-4dce-a1fd-712b5465a0be None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:42.014662 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef4732-5259-4dce-a1fd-712b5465a0be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:42.034014 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-a7ef4732-5259-4dce-a1fd-712b5465a0be None None] MFA Rules not processed for user `cb13ad6d8b1e46029262556bff398796`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:22:42.035255 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-a7ef4732-5259-4dce-a1fd-712b5465a0be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:22:42.047161 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 705/1413] 10.222.0.62 () {58 vars in 1015 bytes} [Fri May 27 16:22:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:22:44.727900 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f2be3e-385b-436c-afa7-a628a8ffa59e None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:44.728475 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f2be3e-385b-436c-afa7-a628a8ffa59e None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:44.728475 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f2be3e-385b-436c-afa7-a628a8ffa59e None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:44.729816 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 709/1414] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 16:22:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:22:44.735156 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1936c1-4e84-4b1a-a65e-479a8343ff57 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:44.735540 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1936c1-4e84-4b1a-a65e-479a8343ff57 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:44.735739 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1936c1-4e84-4b1a-a65e-479a8343ff57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:44.753185 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-0b1936c1-4e84-4b1a-a65e-479a8343ff57 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:22:44.754408 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-0b1936c1-4e84-4b1a-a65e-479a8343ff57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:22:44.762633 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 706/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 16:22:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:22:44.804791 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f2be3e-385b-436c-afa7-a628a8ffa59e None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:22:44.819316 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f2be3e-385b-436c-afa7-a628a8ffa59e None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:22:44.824685 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1470c791-24bb-4a46-8b5c-0f69dcc7801e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb13ad6d8b1e46029262556bff398796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:22:44.825381 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1470c791-24bb-4a46-8b5c-0f69dcc7801e service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:44.825663 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1470c791-24bb-4a46-8b5c-0f69dcc7801e service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:44.825939 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1470c791-24bb-4a46-8b5c-0f69dcc7801e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:44.834632 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1470c791-24bb-4a46-8b5c-0f69dcc7801e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:22:44.836197 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1470c791-24bb-4a46-8b5c-0f69dcc7801e service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:22:44.845580 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 710/1416] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:22:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:22:45.818624 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25c59cb-7bc5-41c9-8f98-c88f9caa3864 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:45.819152 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25c59cb-7bc5-41c9-8f98-c88f9caa3864 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:45.819152 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25c59cb-7bc5-41c9-8f98-c88f9caa3864 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:45.820454 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 707/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 16:22:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:22:45.825416 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac0e6b-cd02-44b6-8fd5-250de2d61fa8 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:45.825863 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac0e6b-cd02-44b6-8fd5-250de2d61fa8 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:45.826015 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac0e6b-cd02-44b6-8fd5-250de2d61fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:45.844659 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-d7ac0e6b-cd02-44b6-8fd5-250de2d61fa8 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:22:45.845856 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-d7ac0e6b-cd02-44b6-8fd5-250de2d61fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:22:45.854337 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 711/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 16:22:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:22:46.015485 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25c59cb-7bc5-41c9-8f98-c88f9caa3864 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:22:46.030687 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25c59cb-7bc5-41c9-8f98-c88f9caa3864 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:22:46.036676 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a98b1b-b488-49c2-a9a4-f72f9c0fadb1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb13ad6d8b1e46029262556bff398796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:22:46.037403 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a98b1b-b488-49c2-a9a4-f72f9c0fadb1 service nova] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:46.037688 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a98b1b-b488-49c2-a9a4-f72f9c0fadb1 service nova] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:46.037970 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a98b1b-b488-49c2-a9a4-f72f9c0fadb1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:46.046287 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a98b1b-b488-49c2-a9a4-f72f9c0fadb1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:22:46.047888 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a98b1b-b488-49c2-a9a4-f72f9c0fadb1 service nova] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:22:46.057322 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 708/1419] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:22:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:22:46.983579 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5dbac7-f706-4e25-ac1f-519fd430c941 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:46.984140 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5dbac7-f706-4e25-ac1f-519fd430c941 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:46.984140 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5dbac7-f706-4e25-ac1f-519fd430c941 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:46.985530 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 712/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 16:22:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:22:46.990762 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5a3974-fc67-4dff-881e-6c1845abcf59 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:46.991210 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5a3974-fc67-4dff-881e-6c1845abcf59 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:46.991325 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5a3974-fc67-4dff-881e-6c1845abcf59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:47.009404 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-1f5a3974-fc67-4dff-881e-6c1845abcf59 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:22:47.010625 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-1f5a3974-fc67-4dff-881e-6c1845abcf59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:22:47.018221 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 709/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 16:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:22:47.172122 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5dbac7-f706-4e25-ac1f-519fd430c941 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:22:47.186454 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5dbac7-f706-4e25-ac1f-519fd430c941 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:22:47.191721 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2c01a5-c44d-4612-8c5f-257135d1497d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb13ad6d8b1e46029262556bff398796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:22:47.192920 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2c01a5-c44d-4612-8c5f-257135d1497d service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:47.193201 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2c01a5-c44d-4612-8c5f-257135d1497d service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:47.193478 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2c01a5-c44d-4612-8c5f-257135d1497d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:47.201354 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2c01a5-c44d-4612-8c5f-257135d1497d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:22:47.203053 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2c01a5-c44d-4612-8c5f-257135d1497d service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:22:47.212450 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 713/1422] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:22:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:22:48.108875 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb3bf4-2df4-4ce0-840f-9dd5870f12f8 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:48.109429 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb3bf4-2df4-4ce0-840f-9dd5870f12f8 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:48.109429 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb3bf4-2df4-4ce0-840f-9dd5870f12f8 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:48.110867 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 710/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 16:22:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:22:48.115865 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871285f-9187-4e3d-be6f-f9f573c6d1c3 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:48.116265 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871285f-9187-4e3d-be6f-f9f573c6d1c3 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:48.116439 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871285f-9187-4e3d-be6f-f9f573c6d1c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:48.134156 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-3871285f-9187-4e3d-be6f-f9f573c6d1c3 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:22:48.135314 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-3871285f-9187-4e3d-be6f-f9f573c6d1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:22:48.143333 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 714/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 16:22:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:22:48.295265 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb3bf4-2df4-4ce0-840f-9dd5870f12f8 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:22:48.309618 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb3bf4-2df4-4ce0-840f-9dd5870f12f8 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:22:48.315008 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd1a33f-53a2-4780-9e76-d49028e4abd2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb13ad6d8b1e46029262556bff398796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:22:48.315640 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1a33f-53a2-4780-9e76-d49028e4abd2 service nova] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:48.315928 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1a33f-53a2-4780-9e76-d49028e4abd2 service nova] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:48.316208 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1a33f-53a2-4780-9e76-d49028e4abd2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:48.325271 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd1a33f-53a2-4780-9e76-d49028e4abd2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:22:48.326894 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd1a33f-53a2-4780-9e76-d49028e4abd2 service nova] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:22:48.337762 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 711/1425] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:22:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 16:22:49.249969 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadda059-56c1-43f7-bad3-1c4b30625521 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:49.250530 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadda059-56c1-43f7-bad3-1c4b30625521 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:49.250530 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadda059-56c1-43f7-bad3-1c4b30625521 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:49.251864 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 715/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 16:22:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 16:22:49.258086 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0688ae18-cd67-47d5-8097-a4c9d3bff816 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:49.258532 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0688ae18-cd67-47d5-8097-a4c9d3bff816 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:49.258736 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0688ae18-cd67-47d5-8097-a4c9d3bff816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:49.277372 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-0688ae18-cd67-47d5-8097-a4c9d3bff816 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:22:49.278613 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-0688ae18-cd67-47d5-8097-a4c9d3bff816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:22:49.286336 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 712/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 16:22:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:22:49.433573 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadda059-56c1-43f7-bad3-1c4b30625521 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:22:49.448376 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadda059-56c1-43f7-bad3-1c4b30625521 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:22:49.453740 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f6164b-09c7-4082-8f44-6b1d286dff67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb13ad6d8b1e46029262556bff398796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:22:49.454408 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6164b-09c7-4082-8f44-6b1d286dff67 service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:49.454698 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6164b-09c7-4082-8f44-6b1d286dff67 service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:49.454980 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6164b-09c7-4082-8f44-6b1d286dff67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:49.463181 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f6164b-09c7-4082-8f44-6b1d286dff67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:22:49.464763 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f6164b-09c7-4082-8f44-6b1d286dff67 service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:22:49.474009 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 716/1428] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:22:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:22:50.378544 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeec576-8504-4609-89e1-d595533db655 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:50.379098 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeec576-8504-4609-89e1-d595533db655 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:50.379232 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeec576-8504-4609-89e1-d595533db655 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:50.381129 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 713/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 16:22:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:22:50.386202 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f195c-3421-4685-84de-c026ae3eb33e None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:50.386718 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f195c-3421-4685-84de-c026ae3eb33e None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:50.386830 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f195c-3421-4685-84de-c026ae3eb33e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:50.405606 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-e97f195c-3421-4685-84de-c026ae3eb33e None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:22:50.406832 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-e97f195c-3421-4685-84de-c026ae3eb33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:22:50.415016 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 717/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 16:22:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:22:50.563132 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeec576-8504-4609-89e1-d595533db655 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:22:50.577831 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeec576-8504-4609-89e1-d595533db655 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:22:50.583373 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1707ecad-1e21-4ccf-9500-8633d8c1ccb6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb13ad6d8b1e46029262556bff398796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:22:50.584009 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707ecad-1e21-4ccf-9500-8633d8c1ccb6 service nova] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:50.584297 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707ecad-1e21-4ccf-9500-8633d8c1ccb6 service nova] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:50.584579 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707ecad-1e21-4ccf-9500-8633d8c1ccb6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:50.592900 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1707ecad-1e21-4ccf-9500-8633d8c1ccb6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:22:50.594520 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1707ecad-1e21-4ccf-9500-8633d8c1ccb6 service nova] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:22:50.604463 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 714/1431] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:22:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:22:51.509355 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b144584-b606-4369-b294-5e9fdb36d4dc None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:51.509935 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b144584-b606-4369-b294-5e9fdb36d4dc None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:51.509935 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b144584-b606-4369-b294-5e9fdb36d4dc None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:51.511372 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 718/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 16:22:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:22:51.516201 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62782fb4-86af-4fc6-a3f6-a4065469c6fb None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:51.516612 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62782fb4-86af-4fc6-a3f6-a4065469c6fb None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:51.516761 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62782fb4-86af-4fc6-a3f6-a4065469c6fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:51.534950 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-62782fb4-86af-4fc6-a3f6-a4065469c6fb None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:22:51.536736 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-62782fb4-86af-4fc6-a3f6-a4065469c6fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:22:51.544624 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 715/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 16:22:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:22:51.692044 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b144584-b606-4369-b294-5e9fdb36d4dc None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:22:51.705978 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b144584-b606-4369-b294-5e9fdb36d4dc None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:22:51.711810 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0601a5bf-0e4c-4df4-9213-f798b41445f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb13ad6d8b1e46029262556bff398796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:22:51.712438 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601a5bf-0e4c-4df4-9213-f798b41445f8 service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:51.712721 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601a5bf-0e4c-4df4-9213-f798b41445f8 service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:51.712998 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601a5bf-0e4c-4df4-9213-f798b41445f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:51.720991 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0601a5bf-0e4c-4df4-9213-f798b41445f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:22:51.722613 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0601a5bf-0e4c-4df4-9213-f798b41445f8 service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:22:51.732338 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 719/1434] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:22:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:22:52.699755 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9dcdd-f856-4f38-aff2-901e619ffbc0 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:52.700294 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9dcdd-f856-4f38-aff2-901e619ffbc0 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:52.700294 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9dcdd-f856-4f38-aff2-901e619ffbc0 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:52.701691 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 716/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 16:22:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:22:52.706677 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c4f156-87ce-4743-a841-0ec5688e8550 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:52.707088 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c4f156-87ce-4743-a841-0ec5688e8550 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:52.707276 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c4f156-87ce-4743-a841-0ec5688e8550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:52.725211 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-52c4f156-87ce-4743-a841-0ec5688e8550 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:22:52.726447 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-52c4f156-87ce-4743-a841-0ec5688e8550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:22:52.734107 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 720/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 16:22:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:22:52.883357 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc9dcdd-f856-4f38-aff2-901e619ffbc0 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:22:52.897642 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc9dcdd-f856-4f38-aff2-901e619ffbc0 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:22:52.903286 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc18547-78da-4be7-865a-d4d1e61f26d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb13ad6d8b1e46029262556bff398796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:22:52.903919 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc18547-78da-4be7-865a-d4d1e61f26d3 service nova] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:52.904204 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc18547-78da-4be7-865a-d4d1e61f26d3 service nova] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:52.904481 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc18547-78da-4be7-865a-d4d1e61f26d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:52.912473 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc18547-78da-4be7-865a-d4d1e61f26d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:22:52.914672 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc18547-78da-4be7-865a-d4d1e61f26d3 service nova] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:22:52.923861 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 717/1437] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:22:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:22:53.901276 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6539456-18c3-4786-b734-2135f2ebe0a9 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:53.901762 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6539456-18c3-4786-b734-2135f2ebe0a9 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:53.901885 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6539456-18c3-4786-b734-2135f2ebe0a9 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:53.903233 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 721/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 16:22:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:22:53.908079 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a529679-d8d7-48e6-bb47-c9919376d277 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:53.908486 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a529679-d8d7-48e6-bb47-c9919376d277 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:53.908644 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a529679-d8d7-48e6-bb47-c9919376d277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:53.927533 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-5a529679-d8d7-48e6-bb47-c9919376d277 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:22:53.928723 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-5a529679-d8d7-48e6-bb47-c9919376d277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:22:53.936478 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 718/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 16:22:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:22:54.085108 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6539456-18c3-4786-b734-2135f2ebe0a9 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:22:54.099099 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6539456-18c3-4786-b734-2135f2ebe0a9 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:22:54.104351 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fee266-92af-45f4-a82a-e93587a4df93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb13ad6d8b1e46029262556bff398796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:22:54.104979 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fee266-92af-45f4-a82a-e93587a4df93 service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:54.105262 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fee266-92af-45f4-a82a-e93587a4df93 service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:54.105537 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fee266-92af-45f4-a82a-e93587a4df93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:54.113871 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fee266-92af-45f4-a82a-e93587a4df93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:22:54.115456 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fee266-92af-45f4-a82a-e93587a4df93 service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:22:54.124576 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 722/1440] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:22:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:22:56.200627 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8736bb3d-0e1f-457a-8852-be2f8ebf220a None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:56.201133 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8736bb3d-0e1f-457a-8852-be2f8ebf220a None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:56.201133 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8736bb3d-0e1f-457a-8852-be2f8ebf220a None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:56.202517 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 719/1441] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 16:22:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:22:56.207855 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075ab068-a573-4e07-ac82-28d42b60b214 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:56.208265 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075ab068-a573-4e07-ac82-28d42b60b214 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:56.208419 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075ab068-a573-4e07-ac82-28d42b60b214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:56.225811 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-075ab068-a573-4e07-ac82-28d42b60b214 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:22:56.227063 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-075ab068-a573-4e07-ac82-28d42b60b214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:22:56.234778 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 723/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 16:22:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:22:56.273138 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8736bb3d-0e1f-457a-8852-be2f8ebf220a None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:22:56.284112 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8736bb3d-0e1f-457a-8852-be2f8ebf220a None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:22:56.287710 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff0a282-be6a-44e9-ac64-946f4aa4adb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:22:56.288346 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff0a282-be6a-44e9-ac64-946f4aa4adb6 service neutron] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:56.288632 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff0a282-be6a-44e9-ac64-946f4aa4adb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:56.288912 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff0a282-be6a-44e9-ac64-946f4aa4adb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:56.297872 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff0a282-be6a-44e9-ac64-946f4aa4adb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:22:56.299328 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff0a282-be6a-44e9-ac64-946f4aa4adb6 service neutron] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:22:56.309350 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 720/1443] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:22:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:22:58.675445 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39c86b-1809-461c-8a48-dd4549f67ce9 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:58.676018 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39c86b-1809-461c-8a48-dd4549f67ce9 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:58.676018 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39c86b-1809-461c-8a48-dd4549f67ce9 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:58.677368 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 724/1444] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 16:22:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:22:58.682685 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcbc444-a45c-4fae-b4d6-0d81d16f86f8 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:58.683093 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcbc444-a45c-4fae-b4d6-0d81d16f86f8 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:58.683258 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcbc444-a45c-4fae-b4d6-0d81d16f86f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:58.700767 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-8dcbc444-a45c-4fae-b4d6-0d81d16f86f8 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:22:58.701962 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-8dcbc444-a45c-4fae-b4d6-0d81d16f86f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:22:58.710262 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 721/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 16:22:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:22:58.747520 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c39c86b-1809-461c-8a48-dd4549f67ce9 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:22:58.758212 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c39c86b-1809-461c-8a48-dd4549f67ce9 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:22:58.761801 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e4fbb4-71cf-4f24-a2b5-8cf064f5627a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:22:58.762462 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e4fbb4-71cf-4f24-a2b5-8cf064f5627a service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:58.762750 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e4fbb4-71cf-4f24-a2b5-8cf064f5627a service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:58.763029 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e4fbb4-71cf-4f24-a2b5-8cf064f5627a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:58.772628 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e4fbb4-71cf-4f24-a2b5-8cf064f5627a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:22:58.774345 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e4fbb4-71cf-4f24-a2b5-8cf064f5627a service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:22:58.783616 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 725/1446] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:22:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:23:01.332967 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610401d4-9c97-4d14-bad3-060e63b330c9 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:01.333573 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610401d4-9c97-4d14-bad3-060e63b330c9 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:01.333573 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610401d4-9c97-4d14-bad3-060e63b330c9 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:01.334912 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 722/1447] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 16:23:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:23:01.340259 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721bc88-a8ee-4041-8342-0f483fd521a4 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:01.340685 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721bc88-a8ee-4041-8342-0f483fd521a4 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:01.340794 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721bc88-a8ee-4041-8342-0f483fd521a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:01.358573 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-9721bc88-a8ee-4041-8342-0f483fd521a4 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:23:01.359754 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-9721bc88-a8ee-4041-8342-0f483fd521a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:23:01.367980 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 726/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 16:23:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:23:01.406047 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610401d4-9c97-4d14-bad3-060e63b330c9 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:23:01.417163 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610401d4-9c97-4d14-bad3-060e63b330c9 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:23:01.420721 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5da68ca-6626-466b-9afb-fb8b7116209b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:23:01.421351 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da68ca-6626-466b-9afb-fb8b7116209b service neutron] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:01.421639 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da68ca-6626-466b-9afb-fb8b7116209b service neutron] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:01.421927 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da68ca-6626-466b-9afb-fb8b7116209b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:01.431406 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5da68ca-6626-466b-9afb-fb8b7116209b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:23:01.432840 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5da68ca-6626-466b-9afb-fb8b7116209b service neutron] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:23:01.442105 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 723/1449] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:23:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:23:03.748356 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f086e-a43b-427b-9d14-1ec45b55ca00 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:03.748882 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f086e-a43b-427b-9d14-1ec45b55ca00 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:03.748882 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f086e-a43b-427b-9d14-1ec45b55ca00 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:03.750223 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 727/1450] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 16:23:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:23:03.756145 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b368b-eb27-4c93-ab3d-3a61c155f45a None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:03.756601 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b368b-eb27-4c93-ab3d-3a61c155f45a None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:03.756712 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b368b-eb27-4c93-ab3d-3a61c155f45a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:03.774803 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-2f9b368b-eb27-4c93-ab3d-3a61c155f45a None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:23:03.775977 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-2f9b368b-eb27-4c93-ab3d-3a61c155f45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:23:03.783632 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 724/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 16:23:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:23:03.821476 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897f086e-a43b-427b-9d14-1ec45b55ca00 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:23:03.832164 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897f086e-a43b-427b-9d14-1ec45b55ca00 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:23:03.835958 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37af3c4-e32e-479c-968b-9a60cd52a86d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:23:03.836601 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37af3c4-e32e-479c-968b-9a60cd52a86d service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:03.836892 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37af3c4-e32e-479c-968b-9a60cd52a86d service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:03.837169 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37af3c4-e32e-479c-968b-9a60cd52a86d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:03.847028 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37af3c4-e32e-479c-968b-9a60cd52a86d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:23:03.848501 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37af3c4-e32e-479c-968b-9a60cd52a86d service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:23:03.857718 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 728/1452] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:23:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:23:06.226631 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deca08a-814c-4df5-9acc-5812f793396a None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:06.227159 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deca08a-814c-4df5-9acc-5812f793396a None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:06.227159 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deca08a-814c-4df5-9acc-5812f793396a None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:06.228484 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 725/1453] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 16:23:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:23:06.233797 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3ffed-56ad-4e61-8cd0-9b307fea1cdb None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:06.234189 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3ffed-56ad-4e61-8cd0-9b307fea1cdb None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:06.234400 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3ffed-56ad-4e61-8cd0-9b307fea1cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:06.252375 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-6df3ffed-56ad-4e61-8cd0-9b307fea1cdb None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:23:06.254152 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-6df3ffed-56ad-4e61-8cd0-9b307fea1cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:23:06.262686 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 729/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 16:23:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:23:06.299739 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deca08a-814c-4df5-9acc-5812f793396a None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:23:06.310782 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deca08a-814c-4df5-9acc-5812f793396a None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:23:06.314236 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da95b8-d27e-4058-8b75-0a317dd17a08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:23:06.314892 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da95b8-d27e-4058-8b75-0a317dd17a08 service neutron] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:06.315173 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da95b8-d27e-4058-8b75-0a317dd17a08 service neutron] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:06.315444 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da95b8-d27e-4058-8b75-0a317dd17a08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:06.324845 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4da95b8-d27e-4058-8b75-0a317dd17a08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:23:06.326288 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4da95b8-d27e-4058-8b75-0a317dd17a08 service neutron] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:23:06.335762 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 726/1455] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:23:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:23:08.558807 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e3964-3994-4f30-8afb-37052e177243 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:08.559370 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e3964-3994-4f30-8afb-37052e177243 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:08.559370 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e3964-3994-4f30-8afb-37052e177243 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:08.560758 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 730/1456] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 16:23:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:23:08.565925 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc40149-0555-4fd1-a44d-307c31b31b6f None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:08.566389 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc40149-0555-4fd1-a44d-307c31b31b6f None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:08.566523 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc40149-0555-4fd1-a44d-307c31b31b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:08.584053 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-4cc40149-0555-4fd1-a44d-307c31b31b6f None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:23:08.585255 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-4cc40149-0555-4fd1-a44d-307c31b31b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:23:08.593131 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 727/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 16:23:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:23:08.631516 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e3964-3994-4f30-8afb-37052e177243 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:23:08.642373 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e3964-3994-4f30-8afb-37052e177243 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:23:08.646443 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b35c9db-78e5-44aa-b09f-0c5141c70631 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:23:08.647078 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b35c9db-78e5-44aa-b09f-0c5141c70631 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:08.647363 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b35c9db-78e5-44aa-b09f-0c5141c70631 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:08.647643 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b35c9db-78e5-44aa-b09f-0c5141c70631 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:08.657018 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b35c9db-78e5-44aa-b09f-0c5141c70631 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:23:08.658473 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b35c9db-78e5-44aa-b09f-0c5141c70631 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:23:08.667846 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 731/1458] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:23:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 16:23:10.945514 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f92fa56-1297-4214-af15-78f4fc14f125 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:10.946060 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f92fa56-1297-4214-af15-78f4fc14f125 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:10.946181 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f92fa56-1297-4214-af15-78f4fc14f125 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:10.947569 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 728/1459] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 16:23:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:23:10.952741 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b51f965-2991-4f61-b6dc-71aa4ef31e9d None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:10.953200 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b51f965-2991-4f61-b6dc-71aa4ef31e9d None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:10.953299 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b51f965-2991-4f61-b6dc-71aa4ef31e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:10.959906 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=70 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:23:10.971814 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-9b51f965-2991-4f61-b6dc-71aa4ef31e9d None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:23:10.973625 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-9b51f965-2991-4f61-b6dc-71aa4ef31e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:23:10.981519 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 732/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 16:23:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:23:11.017736 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f92fa56-1297-4214-af15-78f4fc14f125 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:23:11.024442 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=73 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:23:11.030337 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f92fa56-1297-4214-af15-78f4fc14f125 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:23:11.034320 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d8323-93db-4870-9488-77baf0171f5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:23:11.035578 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d8323-93db-4870-9488-77baf0171f5c service neutron] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:11.035863 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d8323-93db-4870-9488-77baf0171f5c service neutron] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:11.036142 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d8323-93db-4870-9488-77baf0171f5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:11.045483 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683d8323-93db-4870-9488-77baf0171f5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:23:11.046954 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683d8323-93db-4870-9488-77baf0171f5c service neutron] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:23:11.056121 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 729/1461] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:23:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:23:13.306321 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c05e471-abf4-4792-aa75-b182a2bbeba4 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:13.306831 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c05e471-abf4-4792-aa75-b182a2bbeba4 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:13.306831 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c05e471-abf4-4792-aa75-b182a2bbeba4 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:13.308205 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 733/1462] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 16:23:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:23:13.313421 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2104733-5363-4a74-a669-de421be51043 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:13.313866 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2104733-5363-4a74-a669-de421be51043 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:13.313965 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2104733-5363-4a74-a669-de421be51043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:13.332388 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-e2104733-5363-4a74-a669-de421be51043 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:23:13.333589 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-e2104733-5363-4a74-a669-de421be51043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:23:13.341295 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 730/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 16:23:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:23:13.377943 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c05e471-abf4-4792-aa75-b182a2bbeba4 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:23:13.388480 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c05e471-abf4-4792-aa75-b182a2bbeba4 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:23:13.391971 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88fc01b-dc08-4fc9-b703-6fa5d46779e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:23:13.392600 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88fc01b-dc08-4fc9-b703-6fa5d46779e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:13.392888 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88fc01b-dc08-4fc9-b703-6fa5d46779e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:13.393170 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88fc01b-dc08-4fc9-b703-6fa5d46779e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:13.406773 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88fc01b-dc08-4fc9-b703-6fa5d46779e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:23:13.408208 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88fc01b-dc08-4fc9-b703-6fa5d46779e6 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:23:13.419109 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 734/1464] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:23:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:23:15.635982 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c62bea7-d159-49a2-a0b1-e60e65270baf None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:15.636537 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c62bea7-d159-49a2-a0b1-e60e65270baf None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:15.636537 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c62bea7-d159-49a2-a0b1-e60e65270baf None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:15.638150 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 731/1465] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 16:23:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 16:23:15.643373 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497f2bc-37e0-4b2a-a849-56e2e3bb6085 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:15.644291 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497f2bc-37e0-4b2a-a849-56e2e3bb6085 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:15.644515 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497f2bc-37e0-4b2a-a849-56e2e3bb6085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:15.662139 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-1497f2bc-37e0-4b2a-a849-56e2e3bb6085 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:23:15.663355 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-1497f2bc-37e0-4b2a-a849-56e2e3bb6085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:23:15.671035 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 735/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 16:23:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:23:15.707101 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c62bea7-d159-49a2-a0b1-e60e65270baf None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:23:15.717568 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c62bea7-d159-49a2-a0b1-e60e65270baf None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:23:15.721077 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97494f2-dfc4-4aa5-8347-e9a55aabc4a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:23:15.721710 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97494f2-dfc4-4aa5-8347-e9a55aabc4a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:15.721995 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97494f2-dfc4-4aa5-8347-e9a55aabc4a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:15.722296 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97494f2-dfc4-4aa5-8347-e9a55aabc4a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:15.731067 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97494f2-dfc4-4aa5-8347-e9a55aabc4a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:23:15.732493 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97494f2-dfc4-4aa5-8347-e9a55aabc4a1 service neutron] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:23:15.742174 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 732/1467] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:23:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:23:17.944385 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de44d8b-ad08-48c4-986e-63a63b81cea6 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:17.944931 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de44d8b-ad08-48c4-986e-63a63b81cea6 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:17.944931 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de44d8b-ad08-48c4-986e-63a63b81cea6 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:17.946371 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 736/1468] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 16:23:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:23:17.951803 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19af9628-36e3-4976-9887-da93510bee4d None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:17.952204 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19af9628-36e3-4976-9887-da93510bee4d None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:17.952365 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19af9628-36e3-4976-9887-da93510bee4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:17.969973 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-19af9628-36e3-4976-9887-da93510bee4d None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:23:17.971212 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-19af9628-36e3-4976-9887-da93510bee4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:23:17.979676 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 733/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 16:23:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:23:18.015605 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de44d8b-ad08-48c4-986e-63a63b81cea6 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:23:18.026480 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de44d8b-ad08-48c4-986e-63a63b81cea6 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:23:18.029928 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e7f64b-bf1f-4806-9a12-f6076fc87a33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:23:18.030590 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7f64b-bf1f-4806-9a12-f6076fc87a33 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:18.030900 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7f64b-bf1f-4806-9a12-f6076fc87a33 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:18.031175 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7f64b-bf1f-4806-9a12-f6076fc87a33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:18.040351 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e7f64b-bf1f-4806-9a12-f6076fc87a33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:23:18.041761 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e7f64b-bf1f-4806-9a12-f6076fc87a33 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:23:18.051019 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 737/1470] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:23:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:23:27.964886 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=17 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:23:28.046913 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=17 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:23:51.374307 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61314cea-8248-4ee9-a385-05292c89e1d3 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:51.374926 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61314cea-8248-4ee9-a385-05292c89e1d3 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:51.374926 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61314cea-8248-4ee9-a385-05292c89e1d3 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:51.376326 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 734/1471] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:23:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:23:51.382133 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec57c0-5ff9-493a-90fe-2267228e51ba None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:51.382620 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec57c0-5ff9-493a-90fe-2267228e51ba None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:51.382730 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec57c0-5ff9-493a-90fe-2267228e51ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:51.400383 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-98ec57c0-5ff9-493a-90fe-2267228e51ba None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:23:51.401582 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-98ec57c0-5ff9-493a-90fe-2267228e51ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:23:51.409416 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 738/1472] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:23:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:23:51.456438 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0867bf-a7c4-4a05-bc85-41942fd97af8 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:51.456733 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0867bf-a7c4-4a05-bc85-41942fd97af8 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:51.457012 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0867bf-a7c4-4a05-bc85-41942fd97af8 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:51.458373 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 735/1473] 10.222.0.62 () {54 vars in 962 bytes} [Fri May 27 16:23:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:23:51.463208 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326e94c-f953-4745-b453-e6bbfabe4e66 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:51.463496 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326e94c-f953-4745-b453-e6bbfabe4e66 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:51.463775 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326e94c-f953-4745-b453-e6bbfabe4e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:51.481787 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-e326e94c-f953-4745-b453-e6bbfabe4e66 None None] MFA Rules not processed for user `2b072079733049e8ac204ebe5cc635ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:23:51.482993 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-e326e94c-f953-4745-b453-e6bbfabe4e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:23:51.489860 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 739/1474] 10.222.0.62 () {58 vars in 1059 bytes} [Fri May 27 16:23:51 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:23:51.496839 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0867bf-a7c4-4a05-bc85-41942fd97af8 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:23:51.508347 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0867bf-a7c4-4a05-bc85-41942fd97af8 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:23:51.511814 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55ca96d-234d-4056-8531-68f9346a87b9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b072079733049e8ac204ebe5cc635ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:23:51.512433 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ca96d-234d-4056-8531-68f9346a87b9 service glance] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:51.512713 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ca96d-234d-4056-8531-68f9346a87b9 service glance] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:51.512988 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ca96d-234d-4056-8531-68f9346a87b9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:51.522115 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55ca96d-234d-4056-8531-68f9346a87b9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:23:51.523574 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55ca96d-234d-4056-8531-68f9346a87b9 service glance] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:23:51.533332 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 736/1475] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:23:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:23:53.814552 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f5439-a5f9-4d12-84a7-265ccb5a2ab2 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:53.815076 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f5439-a5f9-4d12-84a7-265ccb5a2ab2 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:53.815076 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f5439-a5f9-4d12-84a7-265ccb5a2ab2 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:53.816460 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 740/1476] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:23:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:23:53.821702 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38703139-a434-4538-9ab0-6af5feeb8032 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:53.822092 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38703139-a434-4538-9ab0-6af5feeb8032 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:53.822305 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38703139-a434-4538-9ab0-6af5feeb8032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:53.840170 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-38703139-a434-4538-9ab0-6af5feeb8032 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:23:53.841383 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-38703139-a434-4538-9ab0-6af5feeb8032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:23:53.849257 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 737/1477] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:23:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:23:53.874362 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53f5439-a5f9-4d12-84a7-265ccb5a2ab2 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:23:53.890859 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53f5439-a5f9-4d12-84a7-265ccb5a2ab2 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:23:53.895884 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11648a9e-3710-4a68-b13f-b86530a2ce96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:23:53.896533 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11648a9e-3710-4a68-b13f-b86530a2ce96 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:53.897073 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11648a9e-3710-4a68-b13f-b86530a2ce96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:53.897357 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11648a9e-3710-4a68-b13f-b86530a2ce96 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:53.898087 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11648a9e-3710-4a68-b13f-b86530a2ce96 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:23:53.899932 dv-cinder-840493-2-smb devstack@keystone.service[80289]: WARNING py.warnings [None req-11648a9e-3710-4a68-b13f-b86530a2ce96 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 16:23:53.899932 dv-cinder-840493-2-smb devstack@keystone.service[80289]: warnings.warn(msg) May 27 16:23:53.899932 dv-cinder-840493-2-smb devstack@keystone.service[80289]: May 27 16:23:53.901073 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11648a9e-3710-4a68-b13f-b86530a2ce96 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:23:53.920248 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 741/1478] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 16:23:53 2022] GET /identity/v3/projects => generated 2553 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:23:56.139671 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef44ca-9841-4da2-a60b-979decf78658 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:56.140206 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef44ca-9841-4da2-a60b-979decf78658 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:56.140206 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef44ca-9841-4da2-a60b-979decf78658 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:56.141573 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 738/1479] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:23:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:23:56.147215 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13760d6-3b5d-4a6f-93b2-488cb56676dc None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:56.147637 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13760d6-3b5d-4a6f-93b2-488cb56676dc None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:56.147784 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13760d6-3b5d-4a6f-93b2-488cb56676dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:56.165779 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-a13760d6-3b5d-4a6f-93b2-488cb56676dc None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:23:56.166997 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-a13760d6-3b5d-4a6f-93b2-488cb56676dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:23:56.175203 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 742/1480] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:23:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:23:56.217362 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ef44ca-9841-4da2-a60b-979decf78658 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:23:56.231987 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ef44ca-9841-4da2-a60b-979decf78658 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:23:56.237975 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43031f0-b9ad-49c3-947f-a4a733fc40df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb13ad6d8b1e46029262556bff398796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:23:56.238637 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43031f0-b9ad-49c3-947f-a4a733fc40df service nova] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:56.238925 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43031f0-b9ad-49c3-947f-a4a733fc40df service nova] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:56.239194 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43031f0-b9ad-49c3-947f-a4a733fc40df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:56.247266 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43031f0-b9ad-49c3-947f-a4a733fc40df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:23:56.252335 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43031f0-b9ad-49c3-947f-a4a733fc40df service nova] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:23:56.258593 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 739/1481] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:23:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 16:23:58.626507 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3848f42-c713-4eb5-90e8-c6505a40e7e9 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:58.627044 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3848f42-c713-4eb5-90e8-c6505a40e7e9 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:58.627044 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3848f42-c713-4eb5-90e8-c6505a40e7e9 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:58.628487 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 743/1482] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:23:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:23:58.633839 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6fbb57-b55b-4ba4-92be-70d860e5b02f None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:58.634238 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6fbb57-b55b-4ba4-92be-70d860e5b02f None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:58.634438 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6fbb57-b55b-4ba4-92be-70d860e5b02f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:58.652346 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-1c6fbb57-b55b-4ba4-92be-70d860e5b02f None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:23:58.653626 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-1c6fbb57-b55b-4ba4-92be-70d860e5b02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:23:58.661568 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 740/1483] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:23:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:23:58.697761 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3848f42-c713-4eb5-90e8-c6505a40e7e9 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:23:58.708603 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3848f42-c713-4eb5-90e8-c6505a40e7e9 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:23:58.712267 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1364b04-5be2-4fec-9096-adfe2bb609da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:23:58.712898 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1364b04-5be2-4fec-9096-adfe2bb609da service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:58.713181 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1364b04-5be2-4fec-9096-adfe2bb609da service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:58.713485 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1364b04-5be2-4fec-9096-adfe2bb609da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:58.723099 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1364b04-5be2-4fec-9096-adfe2bb609da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:23:58.724523 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1364b04-5be2-4fec-9096-adfe2bb609da service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:23:58.733859 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 744/1484] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:23:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:24:01.033220 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaf8b86-c5ec-4eba-a047-1afacc772afb None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:24:01.033770 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaf8b86-c5ec-4eba-a047-1afacc772afb None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:24:01.033770 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaf8b86-c5ec-4eba-a047-1afacc772afb None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:24:01.035182 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 741/1485] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:24:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:24:01.040719 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a937c9-c17a-4a0b-8719-2dee8b1a73a3 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:24:01.041142 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a937c9-c17a-4a0b-8719-2dee8b1a73a3 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:24:01.041264 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a937c9-c17a-4a0b-8719-2dee8b1a73a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:24:01.059287 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-f8a937c9-c17a-4a0b-8719-2dee8b1a73a3 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:24:01.060457 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-f8a937c9-c17a-4a0b-8719-2dee8b1a73a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:24:01.068681 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 745/1486] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:24:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:24:01.105309 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaf8b86-c5ec-4eba-a047-1afacc772afb None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:24:01.116520 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaf8b86-c5ec-4eba-a047-1afacc772afb None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:24:01.120136 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7a75c3-d881-4fdd-806a-5f68ef1c60fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:24:01.120711 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a75c3-d881-4fdd-806a-5f68ef1c60fc service neutron] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:24:01.120998 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a75c3-d881-4fdd-806a-5f68ef1c60fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:24:01.121283 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a75c3-d881-4fdd-806a-5f68ef1c60fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:24:01.130696 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7a75c3-d881-4fdd-806a-5f68ef1c60fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:24:01.132120 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7a75c3-d881-4fdd-806a-5f68ef1c60fc service neutron] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:24:01.141555 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 742/1487] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:24:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:24:03.430335 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc5dd5-3963-4f08-9b0e-7c76d8c47a86 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:24:03.430951 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc5dd5-3963-4f08-9b0e-7c76d8c47a86 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:24:03.430951 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc5dd5-3963-4f08-9b0e-7c76d8c47a86 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:24:03.432384 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 746/1488] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:24:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:24:03.437670 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a47e1c-7edc-44c0-a0fa-cf95b8b319e7 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:24:03.438671 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a47e1c-7edc-44c0-a0fa-cf95b8b319e7 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:24:03.438810 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a47e1c-7edc-44c0-a0fa-cf95b8b319e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:24:03.456697 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-73a47e1c-7edc-44c0-a0fa-cf95b8b319e7 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:24:03.457890 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-73a47e1c-7edc-44c0-a0fa-cf95b8b319e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:24:03.465583 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 743/1489] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:24:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:24:03.505544 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc5dd5-3963-4f08-9b0e-7c76d8c47a86 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:24:03.516509 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc5dd5-3963-4f08-9b0e-7c76d8c47a86 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:24:03.520196 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74386af-3f5c-44a2-a1c0-4be85eaea621 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:24:03.520830 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74386af-3f5c-44a2-a1c0-4be85eaea621 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:24:03.521118 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74386af-3f5c-44a2-a1c0-4be85eaea621 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:24:03.521666 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74386af-3f5c-44a2-a1c0-4be85eaea621 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:24:03.530659 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74386af-3f5c-44a2-a1c0-4be85eaea621 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:24:03.532086 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74386af-3f5c-44a2-a1c0-4be85eaea621 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:24:03.541443 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 747/1490] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:24:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:24:06.066136 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d590ab8f-111c-45e1-86aa-39e918c85422 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:24:06.066712 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d590ab8f-111c-45e1-86aa-39e918c85422 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:24:06.066712 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d590ab8f-111c-45e1-86aa-39e918c85422 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:24:06.068128 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 744/1491] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 16:24:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:24:06.073795 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64753937-cc8e-425b-99d0-87173c749a20 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:24:06.074222 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64753937-cc8e-425b-99d0-87173c749a20 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:24:06.074424 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64753937-cc8e-425b-99d0-87173c749a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:24:06.092819 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-64753937-cc8e-425b-99d0-87173c749a20 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:24:06.094523 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-64753937-cc8e-425b-99d0-87173c749a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:24:06.102516 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 748/1492] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 16:24:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:24:06.140384 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d590ab8f-111c-45e1-86aa-39e918c85422 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:24:06.151438 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d590ab8f-111c-45e1-86aa-39e918c85422 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:24:06.154982 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4035faa-52eb-4c29-8267-ad9bd8703211 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:24:06.155617 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4035faa-52eb-4c29-8267-ad9bd8703211 service neutron] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:24:06.155906 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4035faa-52eb-4c29-8267-ad9bd8703211 service neutron] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:24:06.156182 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4035faa-52eb-4c29-8267-ad9bd8703211 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:24:06.165617 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4035faa-52eb-4c29-8267-ad9bd8703211 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:24:06.167068 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4035faa-52eb-4c29-8267-ad9bd8703211 service neutron] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:24:06.176943 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 745/1493] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:24:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:24:16.086824 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=33 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:24:16.172912 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=33 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:25:56.035128 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2870f2b6-e4e7-45a2-92ae-d6122fddee7b None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:25:56.035708 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2870f2b6-e4e7-45a2-92ae-d6122fddee7b None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:25:56.035708 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2870f2b6-e4e7-45a2-92ae-d6122fddee7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:25:56.053059 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-2870f2b6-e4e7-45a2-92ae-d6122fddee7b None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:25:56.054235 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-2870f2b6-e4e7-45a2-92ae-d6122fddee7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:25:56.061988 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 749/1494] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:25:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:25:56.071321 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90eb721-56db-447c-8868-db37cce95eb2 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:25:56.071824 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90eb721-56db-447c-8868-db37cce95eb2 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:25:56.071924 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90eb721-56db-447c-8868-db37cce95eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:25:56.090067 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-e90eb721-56db-447c-8868-db37cce95eb2 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:25:56.091890 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-e90eb721-56db-447c-8868-db37cce95eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:25:56.103918 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 746/1495] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:25:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:25:56.110035 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2870f2b6-e4e7-45a2-92ae-d6122fddee7b None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:25:56.120403 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2870f2b6-e4e7-45a2-92ae-d6122fddee7b None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:25:56.125021 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca67bd-cf8f-47cb-b22d-eef83fc7c302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:25:56.125686 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca67bd-cf8f-47cb-b22d-eef83fc7c302 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:25:56.125968 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca67bd-cf8f-47cb-b22d-eef83fc7c302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:25:56.126242 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca67bd-cf8f-47cb-b22d-eef83fc7c302 admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:25:56.126993 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ca67bd-cf8f-47cb-b22d-eef83fc7c302 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:25:56.127297 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ca67bd-cf8f-47cb-b22d-eef83fc7c302 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:25:56.128331 dv-cinder-840493-2-smb devstack@keystone.service[80289]: WARNING py.warnings [None req-18ca67bd-cf8f-47cb-b22d-eef83fc7c302 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 16:25:56.128331 dv-cinder-840493-2-smb devstack@keystone.service[80289]: warnings.warn(msg) May 27 16:25:56.128331 dv-cinder-840493-2-smb devstack@keystone.service[80289]: May 27 16:25:56.129233 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ca67bd-cf8f-47cb-b22d-eef83fc7c302 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:25:56.142307 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 750/1496] 10.222.0.62 () {58 vars in 1152 bytes} [Fri May 27 16:25:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:25:56.150663 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90eb721-56db-447c-8868-db37cce95eb2 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:25:56.160681 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90eb721-56db-447c-8868-db37cce95eb2 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:25:56.165174 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abe4103-a707-4a02-b913-34dd2e3c582d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:25:56.165822 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe4103-a707-4a02-b913-34dd2e3c582d admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:25:56.166102 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe4103-a707-4a02-b913-34dd2e3c582d admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:25:56.166416 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe4103-a707-4a02-b913-34dd2e3c582d admin admin] PATH_INFO: `/v3/projects` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:25:56.167128 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abe4103-a707-4a02-b913-34dd2e3c582d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:25:56.169072 dv-cinder-840493-2-smb devstack@keystone.service[80288]: WARNING py.warnings [None req-5abe4103-a707-4a02-b913-34dd2e3c582d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 16:25:56.169072 dv-cinder-840493-2-smb devstack@keystone.service[80288]: warnings.warn(msg) May 27 16:25:56.169072 dv-cinder-840493-2-smb devstack@keystone.service[80288]: May 27 16:25:56.170343 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abe4103-a707-4a02-b913-34dd2e3c582d admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:25:56.304518 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 747/1497] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:25:56 2022] POST /identity/v3/projects => generated 377 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:25:56.306087 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca67bd-cf8f-47cb-b22d-eef83fc7c302 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:25:56.316046 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca67bd-cf8f-47cb-b22d-eef83fc7c302 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:25:56.372849 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd3f220-0cbc-46f2-b32f-e19b25042324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:25:56.373522 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd3f220-0cbc-46f2-b32f-e19b25042324 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:25:56.373810 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd3f220-0cbc-46f2-b32f-e19b25042324 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:25:56.374090 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd3f220-0cbc-46f2-b32f-e19b25042324 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:25:56.374834 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd3f220-0cbc-46f2-b32f-e19b25042324 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:25:56.375847 dv-cinder-840493-2-smb devstack@keystone.service[80289]: WARNING py.warnings [None req-0bd3f220-0cbc-46f2-b32f-e19b25042324 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 16:25:56.375847 dv-cinder-840493-2-smb devstack@keystone.service[80289]: warnings.warn(msg) May 27 16:25:56.375847 dv-cinder-840493-2-smb devstack@keystone.service[80289]: May 27 16:25:56.377045 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd3f220-0cbc-46f2-b32f-e19b25042324 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:25:56.457263 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 751/1498] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:25:56 2022] POST /identity/v3/users => generated 289 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:25:56.461350 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abe4103-a707-4a02-b913-34dd2e3c582d admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:25:56.471714 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abe4103-a707-4a02-b913-34dd2e3c582d admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:25:56.476406 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca3a794-33b9-48ee-95dc-8a93b80c7bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:25:56.477064 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3a794-33b9-48ee-95dc-8a93b80c7bc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:25:56.477354 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3a794-33b9-48ee-95dc-8a93b80c7bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:25:56.477726 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3a794-33b9-48ee-95dc-8a93b80c7bc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:25:56.478495 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca3a794-33b9-48ee-95dc-8a93b80c7bc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:25:56.479510 dv-cinder-840493-2-smb devstack@keystone.service[80288]: WARNING py.warnings [None req-7ca3a794-33b9-48ee-95dc-8a93b80c7bc5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 16:25:56.479510 dv-cinder-840493-2-smb devstack@keystone.service[80288]: warnings.warn(msg) May 27 16:25:56.479510 dv-cinder-840493-2-smb devstack@keystone.service[80288]: May 27 16:25:56.480409 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca3a794-33b9-48ee-95dc-8a93b80c7bc5 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:25:56.493036 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 748/1499] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:25:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:25:56.497501 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd3f220-0cbc-46f2-b32f-e19b25042324 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:25:56.507454 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd3f220-0cbc-46f2-b32f-e19b25042324 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:25:56.511965 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c28f632-8a05-4653-9902-b98804a83fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:25:56.513200 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28f632-8a05-4653-9902-b98804a83fea admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:25:56.513505 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28f632-8a05-4653-9902-b98804a83fea admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:25:56.513784 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28f632-8a05-4653-9902-b98804a83fea admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:25:56.514552 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c28f632-8a05-4653-9902-b98804a83fea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:25:56.515570 dv-cinder-840493-2-smb devstack@keystone.service[80289]: WARNING py.warnings [None req-5c28f632-8a05-4653-9902-b98804a83fea admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 16:25:56.515570 dv-cinder-840493-2-smb devstack@keystone.service[80289]: warnings.warn(msg) May 27 16:25:56.515570 dv-cinder-840493-2-smb devstack@keystone.service[80289]: May 27 16:25:56.516751 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c28f632-8a05-4653-9902-b98804a83fea admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:25:56.530268 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 752/1500] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:25:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:25:56.534177 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca3a794-33b9-48ee-95dc-8a93b80c7bc5 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:25:56.544250 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca3a794-33b9-48ee-95dc-8a93b80c7bc5 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:25:56.548836 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73137a3f-3da2-49b1-9a2d-22cc442ff844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:25:56.549709 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73137a3f-3da2-49b1-9a2d-22cc442ff844 admin admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:25:56.549999 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73137a3f-3da2-49b1-9a2d-22cc442ff844 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:25:56.550313 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73137a3f-3da2-49b1-9a2d-22cc442ff844 admin admin] PATH_INFO: `/v3/projects/7d237948f1e645edb42311d02a32b713/users/f70f62d17de847148a72c7a99ea55693/roles/c8ce6d197f654598ac45f6016ecccabd` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:25:56.569629 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73137a3f-3da2-49b1-9a2d-22cc442ff844 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d237948f1e645edb42311d02a32b713, user_id=f70f62d17de847148a72c7a99ea55693, role_id=c8ce6d197f654598ac45f6016ecccabd)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:25:56.569629 dv-cinder-840493-2-smb devstack@keystone.service[80288]: WARNING py.warnings [None req-73137a3f-3da2-49b1-9a2d-22cc442ff844 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 16:25:56.569629 dv-cinder-840493-2-smb devstack@keystone.service[80288]: warnings.warn(msg) May 27 16:25:56.569629 dv-cinder-840493-2-smb devstack@keystone.service[80288]: May 27 16:25:56.569629 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73137a3f-3da2-49b1-9a2d-22cc442ff844 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:25:56.660363 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 749/1501] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:25:56 2022] PUT /identity/v3/projects/7d237948f1e645edb42311d02a32b713/users/f70f62d17de847148a72c7a99ea55693/roles/c8ce6d197f654598ac45f6016ecccabd => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:25:56.671800 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dad4ad-5226-436e-833e-0fc36b5342f1 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:25:56.672109 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dad4ad-5226-436e-833e-0fc36b5342f1 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:25:56.672397 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dad4ad-5226-436e-833e-0fc36b5342f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:25:56.698928 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-17dad4ad-5226-436e-833e-0fc36b5342f1 None None] MFA Rules not processed for user `f70f62d17de847148a72c7a99ea55693`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:25:56.700765 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-17dad4ad-5226-436e-833e-0fc36b5342f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:25:56.762221 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 753/1502] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:25:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:25:56.775547 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35683bc7-28cf-46f7-88d5-f4f95af89c03 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:25:56.775845 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35683bc7-28cf-46f7-88d5-f4f95af89c03 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:25:56.776126 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35683bc7-28cf-46f7-88d5-f4f95af89c03 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:25:56.777515 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 750/1503] 10.222.0.62 () {54 vars in 963 bytes} [Fri May 27 16:25:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:25:56.782424 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e6d58-d585-4054-bc8a-dcfd95a74848 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:25:56.782719 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e6d58-d585-4054-bc8a-dcfd95a74848 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:25:56.782999 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e6d58-d585-4054-bc8a-dcfd95a74848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:25:56.800989 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-4a5e6d58-d585-4054-bc8a-dcfd95a74848 None None] MFA Rules not processed for user `d8693a1e72f14fdfb383f11e96330726`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:25:56.802161 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-4a5e6d58-d585-4054-bc8a-dcfd95a74848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:25:56.844661 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:25:56.852064 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 754/1504] 10.222.0.62 () {58 vars in 1060 bytes} [Fri May 27 16:25:56 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:25:56.964772 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35683bc7-28cf-46f7-88d5-f4f95af89c03 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:25:56.975713 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35683bc7-28cf-46f7-88d5-f4f95af89c03 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:25:56.979204 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1684b00-fd41-4959-ab12-e5ae4913158b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8693a1e72f14fdfb383f11e96330726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:25:56.979836 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1684b00-fd41-4959-ab12-e5ae4913158b service cinder] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:25:56.980120 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1684b00-fd41-4959-ab12-e5ae4913158b service cinder] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:25:56.980398 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1684b00-fd41-4959-ab12-e5ae4913158b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:25:56.988946 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1684b00-fd41-4959-ab12-e5ae4913158b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:25:56.990396 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1684b00-fd41-4959-ab12-e5ae4913158b service cinder] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:25:56.999593 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 751/1505] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:25:56 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:25:57.040928 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa08c99-46b3-41f6-94e4-74d15bafa3b2 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:25:57.041321 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa08c99-46b3-41f6-94e4-74d15bafa3b2 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:25:57.041494 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa08c99-46b3-41f6-94e4-74d15bafa3b2 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:25:57.042846 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 755/1506] 10.222.0.62 () {52 vars in 829 bytes} [Fri May 27 16:25:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:25:57.046905 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1684b00-fd41-4959-ab12-e5ae4913158b service cinder] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:25:57.108337 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1684b00-fd41-4959-ab12-e5ae4913158b service cinder] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:25:57.112776 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ed0bf6-01d3-4d43-be21-675f9d44c28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:25:57.113643 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed0bf6-01d3-4d43-be21-675f9d44c28d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:25:57.113928 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed0bf6-01d3-4d43-be21-675f9d44c28d admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:25:57.114207 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed0bf6-01d3-4d43-be21-675f9d44c28d admin admin] PATH_INFO: `/v3/users/f70f62d17de847148a72c7a99ea55693` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:25:57.115413 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ed0bf6-01d3-4d43-be21-675f9d44c28d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f70f62d17de847148a72c7a99ea55693)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:25:57.116419 dv-cinder-840493-2-smb devstack@keystone.service[80288]: WARNING py.warnings [None req-84ed0bf6-01d3-4d43-be21-675f9d44c28d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 16:25:57.116419 dv-cinder-840493-2-smb devstack@keystone.service[80288]: warnings.warn(msg) May 27 16:25:57.116419 dv-cinder-840493-2-smb devstack@keystone.service[80288]: May 27 16:25:57.117620 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ed0bf6-01d3-4d43-be21-675f9d44c28d admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:25:57.354753 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-84ed0bf6-01d3-4d43-be21-675f9d44c28d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f70f62d17de847148a72c7a99ea55693'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:25:57.373780 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-84ed0bf6-01d3-4d43-be21-675f9d44c28d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f70f62d17de847148a72c7a99ea55693'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:25:57.374516 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-84ed0bf6-01d3-4d43-be21-675f9d44c28d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f70f62d17de847148a72c7a99ea55693'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:25:57.375133 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-84ed0bf6-01d3-4d43-be21-675f9d44c28d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f70f62d17de847148a72c7a99ea55693'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:25:57.451113 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-84ed0bf6-01d3-4d43-be21-675f9d44c28d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f70f62d17de847148a72c7a99ea55693'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:25:57.460216 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:25:57.470292 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 752/1507] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:25:57 2022] DELETE /identity/v3/users/f70f62d17de847148a72c7a99ea55693 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:25:57.474930 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d220cb6-242f-459f-82d5-f048d7c35247 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:25:57.475258 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d220cb6-242f-459f-82d5-f048d7c35247 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:25:57.475550 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d220cb6-242f-459f-82d5-f048d7c35247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:25:57.492696 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-4d220cb6-242f-459f-82d5-f048d7c35247 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:25:57.493890 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-4d220cb6-242f-459f-82d5-f048d7c35247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:25:57.551910 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 756/1508] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:25:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:25:57.561387 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ed0bf6-01d3-4d43-be21-675f9d44c28d admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:25:57.562902 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-84ed0bf6-01d3-4d43-be21-675f9d44c28d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:25:57.619972 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ed0bf6-01d3-4d43-be21-675f9d44c28d admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:25:57.623540 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd4332d-a1b1-45df-90e5-f1fdced60440 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:25:57.624238 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4332d-a1b1-45df-90e5-f1fdced60440 service neutron] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:25:57.624470 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4332d-a1b1-45df-90e5-f1fdced60440 service neutron] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:25:57.624749 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4332d-a1b1-45df-90e5-f1fdced60440 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:25:57.633570 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd4332d-a1b1-45df-90e5-f1fdced60440 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:25:57.635147 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd4332d-a1b1-45df-90e5-f1fdced60440 service neutron] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:25:57.645242 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 753/1509] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:25:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:25:58.290908 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d220cb6-242f-459f-82d5-f048d7c35247 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:25:58.292377 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-4d220cb6-242f-459f-82d5-f048d7c35247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:25:58.304875 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d220cb6-242f-459f-82d5-f048d7c35247 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:25:58.310477 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd1ac11-f88f-475e-a5f9-b63fa855c6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:25:58.311450 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd1ac11-f88f-475e-a5f9-b63fa855c6cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:25:58.311613 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd1ac11-f88f-475e-a5f9-b63fa855c6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:25:58.311875 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd1ac11-f88f-475e-a5f9-b63fa855c6cf admin admin] PATH_INFO: `/v3/projects/7d237948f1e645edb42311d02a32b713` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:25:58.313069 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd1ac11-f88f-475e-a5f9-b63fa855c6cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d237948f1e645edb42311d02a32b713)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:25:58.314095 dv-cinder-840493-2-smb devstack@keystone.service[80289]: WARNING py.warnings [None req-dcd1ac11-f88f-475e-a5f9-b63fa855c6cf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 16:25:58.314095 dv-cinder-840493-2-smb devstack@keystone.service[80289]: warnings.warn(msg) May 27 16:25:58.314095 dv-cinder-840493-2-smb devstack@keystone.service[80289]: May 27 16:25:58.317299 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd1ac11-f88f-475e-a5f9-b63fa855c6cf admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:25:58.431759 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-dcd1ac11-f88f-475e-a5f9-b63fa855c6cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d237948f1e645edb42311d02a32b713', 'request_id': 'req-dcd1ac11-f88f-475e-a5f9-b63fa855c6cf'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:25:58.446946 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-dcd1ac11-f88f-475e-a5f9-b63fa855c6cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d237948f1e645edb42311d02a32b713', 'request_id': 'req-dcd1ac11-f88f-475e-a5f9-b63fa855c6cf'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:25:58.524493 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-dcd1ac11-f88f-475e-a5f9-b63fa855c6cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d237948f1e645edb42311d02a32b713', 'request_id': 'req-dcd1ac11-f88f-475e-a5f9-b63fa855c6cf'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:25:58.537234 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-dcd1ac11-f88f-475e-a5f9-b63fa855c6cf admin admin] The token cache is being invalidate because project 7d237948f1e645edb42311d02a32b713 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:25:58.537234 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-dcd1ac11-f88f-475e-a5f9-b63fa855c6cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:25:58.537234 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-dcd1ac11-f88f-475e-a5f9-b63fa855c6cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:25:58.538603 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 757/1510] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:25:58 2022] DELETE /identity/v3/projects/7d237948f1e645edb42311d02a32b713 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:26:07.641296 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=29 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:26:08.532777 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:27:50.413798 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab455c-7b77-41ae-87ab-2b8b7f66d65f None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:27:50.414412 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab455c-7b77-41ae-87ab-2b8b7f66d65f None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:27:50.414522 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab455c-7b77-41ae-87ab-2b8b7f66d65f None None] PATH_INFO: `/v3` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:27:50.415740 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 754/1511] 10.222.0.79 () {54 vars in 925 bytes} [Fri May 27 16:27:50 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:27:50.432198 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15958f8-3518-479f-b7d8-4114e1149dce None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:27:50.432646 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15958f8-3518-479f-b7d8-4114e1149dce None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:27:50.432751 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15958f8-3518-479f-b7d8-4114e1149dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:27:50.440986 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d87fcbf-aa8f-49cb-9a10-111d2ba67e31 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:27:50.441276 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d87fcbf-aa8f-49cb-9a10-111d2ba67e31 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:27:50.441558 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d87fcbf-aa8f-49cb-9a10-111d2ba67e31 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:27:50.443026 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 755/1512] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 16:27:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 16:27:50.448084 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f4b78a-b3dc-4eae-9c6e-372ee30b3742 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:27:50.448398 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f4b78a-b3dc-4eae-9c6e-372ee30b3742 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:27:50.448687 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f4b78a-b3dc-4eae-9c6e-372ee30b3742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:27:50.451944 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-e15958f8-3518-479f-b7d8-4114e1149dce None None] MFA Rules not processed for user `35d98c4a2af546d8b655d649d655f447`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:27:50.453169 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-e15958f8-3518-479f-b7d8-4114e1149dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:27:50.467085 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-81f4b78a-b3dc-4eae-9c6e-372ee30b3742 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:27:50.468274 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-81f4b78a-b3dc-4eae-9c6e-372ee30b3742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:27:50.522207 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 758/1513] 10.222.0.79 () {58 vars in 1015 bytes} [Fri May 27 16:27:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:27:50.533210 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 756/1514] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 16:27:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:27:50.700614 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15958f8-3518-479f-b7d8-4114e1149dce None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:27:50.701997 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-e15958f8-3518-479f-b7d8-4114e1149dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:27:50.775218 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15958f8-3518-479f-b7d8-4114e1149dce None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:27:50.780491 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c065d07-4711-4937-87f8-5120503ff133 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb13ad6d8b1e46029262556bff398796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:27:50.786308 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c065d07-4711-4937-87f8-5120503ff133 service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:27:50.786308 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c065d07-4711-4937-87f8-5120503ff133 service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:27:50.786308 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c065d07-4711-4937-87f8-5120503ff133 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:27:50.790005 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c065d07-4711-4937-87f8-5120503ff133 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:27:50.791647 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c065d07-4711-4937-87f8-5120503ff133 service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:27:50.801289 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 759/1515] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:27:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:27:51.667137 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e0632-094d-46c1-bd9b-fb58705d53e9 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:27:51.667695 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e0632-094d-46c1-bd9b-fb58705d53e9 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:27:51.667695 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e0632-094d-46c1-bd9b-fb58705d53e9 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:27:51.669145 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 757/1516] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 16:27:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:27:51.673952 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce3316-fdc0-442d-977d-d140f2e6c501 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:27:51.674392 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce3316-fdc0-442d-977d-d140f2e6c501 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:27:51.674552 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce3316-fdc0-442d-977d-d140f2e6c501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:27:51.693177 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-66ce3316-fdc0-442d-977d-d140f2e6c501 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:27:51.694410 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-66ce3316-fdc0-442d-977d-d140f2e6c501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:27:51.702821 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 760/1517] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 16:27:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:27:51.851134 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11e0632-094d-46c1-bd9b-fb58705d53e9 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:27:51.867812 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11e0632-094d-46c1-bd9b-fb58705d53e9 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:27:51.885624 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846d009a-33b7-4c1c-b179-591a548fb8b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb13ad6d8b1e46029262556bff398796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:27:51.886575 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d009a-33b7-4c1c-b179-591a548fb8b4 service nova] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:27:51.886873 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d009a-33b7-4c1c-b179-591a548fb8b4 service nova] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:27:51.887133 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d009a-33b7-4c1c-b179-591a548fb8b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:27:51.896244 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846d009a-33b7-4c1c-b179-591a548fb8b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:27:51.897874 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846d009a-33b7-4c1c-b179-591a548fb8b4 service nova] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:27:51.907749 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 758/1518] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:27:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:27:59.467541 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9d300-115a-4f8e-af08-101a5dc19814 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:27:59.468055 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9d300-115a-4f8e-af08-101a5dc19814 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:27:59.468487 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9d300-115a-4f8e-af08-101a5dc19814 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:27:59.469981 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 761/1519] 10.222.0.62 () {54 vars in 960 bytes} [Fri May 27 16:27:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:27:59.474893 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e64b1e-d665-4b99-8aef-7cef07eb73cc None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:27:59.475305 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e64b1e-d665-4b99-8aef-7cef07eb73cc None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:27:59.475493 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e64b1e-d665-4b99-8aef-7cef07eb73cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:27:59.493726 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-d4e64b1e-d665-4b99-8aef-7cef07eb73cc None None] MFA Rules not processed for user `35d98c4a2af546d8b655d649d655f447`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:27:59.495575 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-d4e64b1e-d665-4b99-8aef-7cef07eb73cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:27:59.504034 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 759/1520] 10.222.0.62 () {58 vars in 1057 bytes} [Fri May 27 16:27:59 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:27:59.511655 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c9d300-115a-4f8e-af08-101a5dc19814 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:27:59.524629 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c9d300-115a-4f8e-af08-101a5dc19814 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:27:59.529499 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137a0f6f-c30f-4796-9b56-d6b5d48bc031 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35d98c4a2af546d8b655d649d655f447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:27:59.530125 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137a0f6f-c30f-4796-9b56-d6b5d48bc031 service placement] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:27:59.530440 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137a0f6f-c30f-4796-9b56-d6b5d48bc031 service placement] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:27:59.530722 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137a0f6f-c30f-4796-9b56-d6b5d48bc031 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:27:59.538796 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137a0f6f-c30f-4796-9b56-d6b5d48bc031 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:27:59.540378 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137a0f6f-c30f-4796-9b56-d6b5d48bc031 service placement] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:27:59.550292 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 762/1521] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:27:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:28:03.187128 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a8d5e-95eb-4766-8978-04b196f5781b None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:28:03.187638 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a8d5e-95eb-4766-8978-04b196f5781b None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:28:03.187638 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a8d5e-95eb-4766-8978-04b196f5781b None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:28:03.188979 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 760/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 16:28:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:28:03.193807 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69c4f5-8f71-4548-b01e-0fb7d0e85df6 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:28:03.194273 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69c4f5-8f71-4548-b01e-0fb7d0e85df6 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:28:03.194422 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69c4f5-8f71-4548-b01e-0fb7d0e85df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:28:03.212289 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-4b69c4f5-8f71-4548-b01e-0fb7d0e85df6 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:28:03.214011 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-4b69c4f5-8f71-4548-b01e-0fb7d0e85df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:28:03.221607 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 763/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 16:28:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:28:03.372717 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174a8d5e-95eb-4766-8978-04b196f5781b None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:28:03.387989 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174a8d5e-95eb-4766-8978-04b196f5781b None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:28:03.395703 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ca922f-4056-413e-b1ba-ec1dbc18762c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb13ad6d8b1e46029262556bff398796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:28:03.395703 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca922f-4056-413e-b1ba-ec1dbc18762c service nova] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:28:03.395703 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca922f-4056-413e-b1ba-ec1dbc18762c service nova] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:28:03.395703 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca922f-4056-413e-b1ba-ec1dbc18762c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:28:03.402543 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ca922f-4056-413e-b1ba-ec1dbc18762c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:28:03.404125 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ca922f-4056-413e-b1ba-ec1dbc18762c service nova] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:28:03.413298 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 761/1524] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:28:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:28:04.285254 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f50de4d-794a-44d2-aa45-218e3eda2c42 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:28:04.285797 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f50de4d-794a-44d2-aa45-218e3eda2c42 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:28:04.285797 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f50de4d-794a-44d2-aa45-218e3eda2c42 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:28:04.287280 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 764/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 16:28:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:28:04.292547 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346fe9c3-4088-4fad-8e69-7e49fdda3789 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:28:04.292950 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346fe9c3-4088-4fad-8e69-7e49fdda3789 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:28:04.293097 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346fe9c3-4088-4fad-8e69-7e49fdda3789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:28:04.310589 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-346fe9c3-4088-4fad-8e69-7e49fdda3789 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:28:04.311782 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-346fe9c3-4088-4fad-8e69-7e49fdda3789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:28:04.319435 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 762/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 16:28:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:28:04.468237 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f50de4d-794a-44d2-aa45-218e3eda2c42 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:28:04.483244 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f50de4d-794a-44d2-aa45-218e3eda2c42 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:28:04.488688 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a9d054-433f-4e9f-832d-1dd361c5de43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb13ad6d8b1e46029262556bff398796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:28:04.489326 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a9d054-433f-4e9f-832d-1dd361c5de43 service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:28:04.489617 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a9d054-433f-4e9f-832d-1dd361c5de43 service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:28:04.489899 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a9d054-433f-4e9f-832d-1dd361c5de43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:28:04.498112 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a9d054-433f-4e9f-832d-1dd361c5de43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:28:04.499731 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a9d054-433f-4e9f-832d-1dd361c5de43 service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:28:04.509001 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 765/1527] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:28:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:28:08.764569 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00de8e5-1d29-4b59-890a-484073db5d33 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:28:08.782467 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00de8e5-1d29-4b59-890a-484073db5d33 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:28:08.782467 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00de8e5-1d29-4b59-890a-484073db5d33 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:28:08.782467 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 763/1528] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 16:28:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:28:08.782909 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb37aef-d92b-4bde-b692-fa9a13a8871c None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:28:08.782909 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb37aef-d92b-4bde-b692-fa9a13a8871c None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:28:08.782909 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb37aef-d92b-4bde-b692-fa9a13a8871c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:28:08.792636 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-1cb37aef-d92b-4bde-b692-fa9a13a8871c None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:28:08.793892 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-1cb37aef-d92b-4bde-b692-fa9a13a8871c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:28:08.802473 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 766/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 16:28:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:28:08.839116 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00de8e5-1d29-4b59-890a-484073db5d33 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:28:08.840860 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-f00de8e5-1d29-4b59-890a-484073db5d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:28:08.898003 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00de8e5-1d29-4b59-890a-484073db5d33 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:28:08.902229 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c33a35-5151-4925-bbef-73553fd23149 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:28:08.902915 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c33a35-5151-4925-bbef-73553fd23149 service neutron] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:28:08.903184 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c33a35-5151-4925-bbef-73553fd23149 service neutron] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:28:08.903464 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c33a35-5151-4925-bbef-73553fd23149 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:28:08.912403 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c33a35-5151-4925-bbef-73553fd23149 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:28:08.913816 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c33a35-5151-4925-bbef-73553fd23149 service neutron] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:28:08.923331 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 764/1530] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:28:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 16:28:11.129053 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e301d478-af75-4912-b0e0-c2509c8dac31 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:28:11.129606 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e301d478-af75-4912-b0e0-c2509c8dac31 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:28:11.129606 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e301d478-af75-4912-b0e0-c2509c8dac31 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:28:11.131051 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 767/1531] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 16:28:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:28:11.136657 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b63cf-9c30-428d-8cd8-3746077ff322 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:28:11.137053 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b63cf-9c30-428d-8cd8-3746077ff322 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:28:11.137236 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b63cf-9c30-428d-8cd8-3746077ff322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:28:11.155076 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-c29b63cf-9c30-428d-8cd8-3746077ff322 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:28:11.156289 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-c29b63cf-9c30-428d-8cd8-3746077ff322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:28:11.164058 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 765/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 16:28:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:28:11.199462 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e301d478-af75-4912-b0e0-c2509c8dac31 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:28:11.210259 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e301d478-af75-4912-b0e0-c2509c8dac31 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:28:11.213970 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02711f78-17d6-4d90-a2a1-0ca79f71ce14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:28:11.214634 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02711f78-17d6-4d90-a2a1-0ca79f71ce14 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:28:11.214921 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02711f78-17d6-4d90-a2a1-0ca79f71ce14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:28:11.215206 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02711f78-17d6-4d90-a2a1-0ca79f71ce14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:28:11.224353 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02711f78-17d6-4d90-a2a1-0ca79f71ce14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:28:11.225784 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02711f78-17d6-4d90-a2a1-0ca79f71ce14 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:28:11.235625 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 768/1533] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:28:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:28:15.004791 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc69a4b-394c-4adf-a906-21f99c6e8852 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:28:15.005349 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc69a4b-394c-4adf-a906-21f99c6e8852 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:28:15.005349 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc69a4b-394c-4adf-a906-21f99c6e8852 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:28:15.006878 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 766/1534] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 16:28:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:28:15.012959 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beebd8fc-84fd-4af5-89d9-f9e0ceaf2d0d None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:28:15.013422 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beebd8fc-84fd-4af5-89d9-f9e0ceaf2d0d None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:28:15.013592 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beebd8fc-84fd-4af5-89d9-f9e0ceaf2d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:28:15.031861 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-beebd8fc-84fd-4af5-89d9-f9e0ceaf2d0d None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:28:15.033088 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-beebd8fc-84fd-4af5-89d9-f9e0ceaf2d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:28:15.041714 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 769/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 16:28:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:28:15.316886 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc69a4b-394c-4adf-a906-21f99c6e8852 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:28:15.318607 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-cbc69a4b-394c-4adf-a906-21f99c6e8852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:28:15.375701 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc69a4b-394c-4adf-a906-21f99c6e8852 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:28:15.379223 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87df0915-f185-41d0-ae7f-cd3d4b2eaeac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8693a1e72f14fdfb383f11e96330726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:28:15.379866 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df0915-f185-41d0-ae7f-cd3d4b2eaeac service cinder] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:28:15.380150 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df0915-f185-41d0-ae7f-cd3d4b2eaeac service cinder] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:28:15.380433 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df0915-f185-41d0-ae7f-cd3d4b2eaeac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:28:15.389996 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87df0915-f185-41d0-ae7f-cd3d4b2eaeac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:28:15.391560 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87df0915-f185-41d0-ae7f-cd3d4b2eaeac service cinder] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:28:15.396453 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:28:15.401082 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 767/1536] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:28:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:28:17.611722 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b14ce9-7eb6-4cab-91d3-36950b0f5063 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:28:17.611722 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b14ce9-7eb6-4cab-91d3-36950b0f5063 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:28:17.611722 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b14ce9-7eb6-4cab-91d3-36950b0f5063 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:28:17.613328 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 770/1537] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 16:28:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:28:17.619111 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc0f932-ccc8-4866-81ca-5990fe388153 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:28:17.619571 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc0f932-ccc8-4866-81ca-5990fe388153 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:28:17.619679 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc0f932-ccc8-4866-81ca-5990fe388153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:28:17.639390 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-ffc0f932-ccc8-4866-81ca-5990fe388153 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:28:17.640601 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-ffc0f932-ccc8-4866-81ca-5990fe388153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:28:17.648368 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 768/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 16:28:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:28:17.918570 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b14ce9-7eb6-4cab-91d3-36950b0f5063 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:28:17.920260 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-93b14ce9-7eb6-4cab-91d3-36950b0f5063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:28:17.933517 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b14ce9-7eb6-4cab-91d3-36950b0f5063 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:28:17.937162 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3617f03e-c832-4dbf-b457-441545f99dda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8693a1e72f14fdfb383f11e96330726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:28:17.937796 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3617f03e-c832-4dbf-b457-441545f99dda service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:28:17.938084 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3617f03e-c832-4dbf-b457-441545f99dda service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:28:17.938404 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3617f03e-c832-4dbf-b457-441545f99dda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:28:17.947152 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3617f03e-c832-4dbf-b457-441545f99dda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:28:17.948574 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3617f03e-c832-4dbf-b457-441545f99dda service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:28:17.957786 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 771/1539] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:28:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:28:27.632268 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=3 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:28:27.953758 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:29:52.069320 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c194035a-d79b-4bc1-884f-eaf3929f69e6 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:52.070467 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c194035a-d79b-4bc1-884f-eaf3929f69e6 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:52.071081 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c194035a-d79b-4bc1-884f-eaf3929f69e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:52.103580 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-c194035a-d79b-4bc1-884f-eaf3929f69e6 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:29:52.104919 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-c194035a-d79b-4bc1-884f-eaf3929f69e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:29:52.115862 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 769/1540] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:29:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:29:52.126778 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9dfb9-5e22-4b24-9060-2e7f46263de7 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:52.127377 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9dfb9-5e22-4b24-9060-2e7f46263de7 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:52.127377 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9dfb9-5e22-4b24-9060-2e7f46263de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:52.159107 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-1be9dfb9-5e22-4b24-9060-2e7f46263de7 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:29:52.160415 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-1be9dfb9-5e22-4b24-9060-2e7f46263de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:29:52.171846 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81f3da-dd32-435a-8776-254aaaf1f943 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:52.172211 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81f3da-dd32-435a-8776-254aaaf1f943 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:52.172421 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81f3da-dd32-435a-8776-254aaaf1f943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:52.178588 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 772/1541] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:29:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:29:52.191318 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be9dfb9-5e22-4b24-9060-2e7f46263de7 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:29:52.207999 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be9dfb9-5e22-4b24-9060-2e7f46263de7 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:29:52.209697 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-cd81f3da-dd32-435a-8776-254aaaf1f943 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:29:52.210966 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-cd81f3da-dd32-435a-8776-254aaaf1f943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:29:52.217387 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6490749-10ec-4122-82f3-0239b55ddc37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:29:52.218082 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6490749-10ec-4122-82f3-0239b55ddc37 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:52.218394 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6490749-10ec-4122-82f3-0239b55ddc37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:52.218667 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6490749-10ec-4122-82f3-0239b55ddc37 admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:52.219565 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6490749-10ec-4122-82f3-0239b55ddc37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:29:52.219877 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6490749-10ec-4122-82f3-0239b55ddc37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:29:52.221577 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6490749-10ec-4122-82f3-0239b55ddc37 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:29:52.227398 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 770/1542] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:29:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:29:52.236212 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 773/1543] 10.222.0.62 () {58 vars in 1152 bytes} [Fri May 27 16:29:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:29:52.238998 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6210eec0-5b90-4737-beec-958f88db9b29 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:52.238998 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6210eec0-5b90-4737-beec-958f88db9b29 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:52.239220 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6210eec0-5b90-4737-beec-958f88db9b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:52.244715 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dea731-9505-48c6-a6fe-8a880bfb0901 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:52.245259 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dea731-9505-48c6-a6fe-8a880bfb0901 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:52.245703 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dea731-9505-48c6-a6fe-8a880bfb0901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:52.273158 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-c0dea731-9505-48c6-a6fe-8a880bfb0901 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:29:52.275202 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-c0dea731-9505-48c6-a6fe-8a880bfb0901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:29:52.279459 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-6210eec0-5b90-4737-beec-958f88db9b29 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:29:52.280650 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-6210eec0-5b90-4737-beec-958f88db9b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:29:52.291214 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 774/1544] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:29:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:29:52.292397 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dea731-9505-48c6-a6fe-8a880bfb0901 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:29:52.306183 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dea731-9505-48c6-a6fe-8a880bfb0901 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:29:52.311683 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 771/1545] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:29:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:29:52.313013 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6224af51-ec62-4c28-94cd-30f23c6d2f62 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:52.313320 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6224af51-ec62-4c28-94cd-30f23c6d2f62 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:52.313599 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6224af51-ec62-4c28-94cd-30f23c6d2f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:52.317299 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a9011b-d904-4f87-a6a8-8dd1e0f79f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:29:52.318191 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9011b-d904-4f87-a6a8-8dd1e0f79f8a admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:52.318780 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9011b-d904-4f87-a6a8-8dd1e0f79f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:52.319216 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9011b-d904-4f87-a6a8-8dd1e0f79f8a admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:52.320118 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a9011b-d904-4f87-a6a8-8dd1e0f79f8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:29:52.321327 dv-cinder-840493-2-smb devstack@keystone.service[80289]: WARNING py.warnings [None req-35a9011b-d904-4f87-a6a8-8dd1e0f79f8a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 16:29:52.321327 dv-cinder-840493-2-smb devstack@keystone.service[80289]: warnings.warn(msg) May 27 16:29:52.321327 dv-cinder-840493-2-smb devstack@keystone.service[80289]: May 27 16:29:52.322922 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a9011b-d904-4f87-a6a8-8dd1e0f79f8a admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:29:52.363960 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-6224af51-ec62-4c28-94cd-30f23c6d2f62 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:29:52.365231 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-6224af51-ec62-4c28-94cd-30f23c6d2f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:29:52.384228 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 772/1546] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:29:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:29:52.385132 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6224af51-ec62-4c28-94cd-30f23c6d2f62 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:29:52.398188 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6224af51-ec62-4c28-94cd-30f23c6d2f62 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:29:52.403047 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e36990c-722a-4e4d-bc31-1a807e0d194e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:29:52.403711 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36990c-722a-4e4d-bc31-1a807e0d194e admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:52.404000 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36990c-722a-4e4d-bc31-1a807e0d194e admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:52.404277 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36990c-722a-4e4d-bc31-1a807e0d194e admin admin] PATH_INFO: `/v3/domains` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:52.405008 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e36990c-722a-4e4d-bc31-1a807e0d194e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:29:52.405316 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e36990c-722a-4e4d-bc31-1a807e0d194e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:29:52.406358 dv-cinder-840493-2-smb devstack@keystone.service[80288]: WARNING py.warnings [None req-6e36990c-722a-4e4d-bc31-1a807e0d194e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 16:29:52.406358 dv-cinder-840493-2-smb devstack@keystone.service[80288]: warnings.warn(msg) May 27 16:29:52.406358 dv-cinder-840493-2-smb devstack@keystone.service[80288]: May 27 16:29:52.407263 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e36990c-722a-4e4d-bc31-1a807e0d194e admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:29:52.419961 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 773/1547] 10.222.0.62 () {58 vars in 1152 bytes} [Fri May 27 16:29:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:29:52.424328 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa714dc-4606-4a43-be22-468d530237e5 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:52.424328 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa714dc-4606-4a43-be22-468d530237e5 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:52.424328 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa714dc-4606-4a43-be22-468d530237e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:52.439836 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-4aa714dc-4606-4a43-be22-468d530237e5 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:29:52.441040 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-4aa714dc-4606-4a43-be22-468d530237e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:29:52.450178 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 774/1548] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:29:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:29:52.450927 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 775/1549] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:29:52 2022] POST /identity/v3/projects => generated 383 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:29:52.451527 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb6266-85c5-4dd9-96ec-cb9e64704d36 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:52.451826 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb6266-85c5-4dd9-96ec-cb9e64704d36 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:52.452105 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb6266-85c5-4dd9-96ec-cb9e64704d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:52.452336 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a823bb-04ce-456e-8841-62312ac4cc53 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:52.452635 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a823bb-04ce-456e-8841-62312ac4cc53 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:52.452918 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a823bb-04ce-456e-8841-62312ac4cc53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:52.471225 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-87a823bb-04ce-456e-8841-62312ac4cc53 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:29:52.472575 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-87a823bb-04ce-456e-8841-62312ac4cc53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:29:52.475368 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-e0bb6266-85c5-4dd9-96ec-cb9e64704d36 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:29:52.476566 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-e0bb6266-85c5-4dd9-96ec-cb9e64704d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:29:52.532305 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 776/1550] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:29:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:29:52.533155 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a823bb-04ce-456e-8841-62312ac4cc53 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:29:52.544611 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 775/1551] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:29:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:29:52.544611 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cebb592-1d3d-46ec-a5c6-4b3a132b8d65 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:52.544611 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cebb592-1d3d-46ec-a5c6-4b3a132b8d65 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:52.544611 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cebb592-1d3d-46ec-a5c6-4b3a132b8d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:52.546721 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a823bb-04ce-456e-8841-62312ac4cc53 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:29:52.551919 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d17e667-7844-495e-9700-7760bc43486c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:29:52.552608 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17e667-7844-495e-9700-7760bc43486c admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:52.552893 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17e667-7844-495e-9700-7760bc43486c admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:52.553173 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17e667-7844-495e-9700-7760bc43486c admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:52.553899 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d17e667-7844-495e-9700-7760bc43486c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:29:52.554208 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d17e667-7844-495e-9700-7760bc43486c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:29:52.555866 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d17e667-7844-495e-9700-7760bc43486c admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:29:52.561929 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-2cebb592-1d3d-46ec-a5c6-4b3a132b8d65 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:29:52.563219 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-2cebb592-1d3d-46ec-a5c6-4b3a132b8d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:29:52.568556 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 777/1552] 10.222.0.62 () {58 vars in 1152 bytes} [Fri May 27 16:29:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:29:52.569859 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea22ef-de40-4fbf-9a5b-061413323d3f None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:52.570229 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea22ef-de40-4fbf-9a5b-061413323d3f None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:52.570479 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea22ef-de40-4fbf-9a5b-061413323d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:52.571853 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 776/1553] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:29:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:29:52.572762 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cebb592-1d3d-46ec-a5c6-4b3a132b8d65 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:29:52.588643 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cebb592-1d3d-46ec-a5c6-4b3a132b8d65 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:29:52.593412 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12668b52-fd31-4eac-bb84-21c4ecad94d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:29:52.594071 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12668b52-fd31-4eac-bb84-21c4ecad94d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:52.594392 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12668b52-fd31-4eac-bb84-21c4ecad94d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:52.594678 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12668b52-fd31-4eac-bb84-21c4ecad94d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:52.595371 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12668b52-fd31-4eac-bb84-21c4ecad94d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:29:52.596325 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-5aea22ef-de40-4fbf-9a5b-061413323d3f None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:29:52.597294 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12668b52-fd31-4eac-bb84-21c4ecad94d4 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:29:52.597509 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-5aea22ef-de40-4fbf-9a5b-061413323d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:29:52.606090 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 778/1554] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:29:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:29:52.607185 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba23c5b-33e4-4e25-918c-fd4e2d3a1ebb None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:52.607470 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba23c5b-33e4-4e25-918c-fd4e2d3a1ebb None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:52.607743 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba23c5b-33e4-4e25-918c-fd4e2d3a1ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:52.631269 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-0ba23c5b-33e4-4e25-918c-fd4e2d3a1ebb None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:29:52.632821 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-0ba23c5b-33e4-4e25-918c-fd4e2d3a1ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:29:52.643607 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 779/1555] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:29:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:29:52.645515 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba23c5b-33e4-4e25-918c-fd4e2d3a1ebb None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:29:52.658597 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba23c5b-33e4-4e25-918c-fd4e2d3a1ebb None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:29:52.666107 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf16c38-619e-44eb-a1ed-baddebb140b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:29:52.667177 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf16c38-619e-44eb-a1ed-baddebb140b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:52.667647 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf16c38-619e-44eb-a1ed-baddebb140b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:52.668110 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf16c38-619e-44eb-a1ed-baddebb140b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:52.669275 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf16c38-619e-44eb-a1ed-baddebb140b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:29:52.672444 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf16c38-619e-44eb-a1ed-baddebb140b8 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:29:52.730894 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 777/1556] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:29:52 2022] POST /identity/v3/projects => generated 391 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:29:52.732414 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c0276a-f625-4e78-92e9-18b4708d88c7 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:52.732649 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c0276a-f625-4e78-92e9-18b4708d88c7 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:52.732858 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c0276a-f625-4e78-92e9-18b4708d88c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:52.750604 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-d2c0276a-f625-4e78-92e9-18b4708d88c7 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:29:52.751803 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-d2c0276a-f625-4e78-92e9-18b4708d88c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:29:52.786859 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 780/1557] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:29:52 2022] POST /identity/v3/users => generated 292 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:29:52.790140 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2aa025-57ad-4ba6-9af6-1a6708ea6690 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:52.790140 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2aa025-57ad-4ba6-9af6-1a6708ea6690 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:52.790140 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2aa025-57ad-4ba6-9af6-1a6708ea6690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:52.807014 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-ac2aa025-57ad-4ba6-9af6-1a6708ea6690 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:29:52.808288 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-ac2aa025-57ad-4ba6-9af6-1a6708ea6690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:29:52.811980 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 778/1558] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:29:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:29:52.812789 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c0276a-f625-4e78-92e9-18b4708d88c7 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:29:52.819724 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 781/1559] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:29:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:29:52.821397 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce88d920-361e-4f81-9d2f-980f349c6f44 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:52.821643 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce88d920-361e-4f81-9d2f-980f349c6f44 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:52.822091 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce88d920-361e-4f81-9d2f-980f349c6f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:52.825562 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c0276a-f625-4e78-92e9-18b4708d88c7 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:29:52.830229 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d19e20-3fbd-4da3-9f57-9ebc6dffdeb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:29:52.830907 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d19e20-3fbd-4da3-9f57-9ebc6dffdeb9 admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:52.831190 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d19e20-3fbd-4da3-9f57-9ebc6dffdeb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:52.831466 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d19e20-3fbd-4da3-9f57-9ebc6dffdeb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:52.832169 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d19e20-3fbd-4da3-9f57-9ebc6dffdeb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:29:52.834087 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d19e20-3fbd-4da3-9f57-9ebc6dffdeb9 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:29:52.841895 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-ce88d920-361e-4f81-9d2f-980f349c6f44 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:29:52.843143 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-ce88d920-361e-4f81-9d2f-980f349c6f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:29:52.851704 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 782/1560] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:29:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:29:52.852951 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9ba6ec-ee01-4469-82dd-20444a1a75af None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:52.853240 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9ba6ec-ee01-4469-82dd-20444a1a75af None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:52.853523 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9ba6ec-ee01-4469-82dd-20444a1a75af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:52.871342 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-7c9ba6ec-ee01-4469-82dd-20444a1a75af None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:29:52.872521 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-7c9ba6ec-ee01-4469-82dd-20444a1a75af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:29:52.880413 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 783/1561] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:29:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:29:52.881431 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9ba6ec-ee01-4469-82dd-20444a1a75af None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:29:52.890456 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9ba6ec-ee01-4469-82dd-20444a1a75af None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:29:52.895031 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b2dbe-4e80-4479-943b-62968a400845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:29:52.895656 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b2dbe-4e80-4479-943b-62968a400845 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:52.895946 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b2dbe-4e80-4479-943b-62968a400845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:52.896317 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b2dbe-4e80-4479-943b-62968a400845 admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:52.897037 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59b2dbe-4e80-4479-943b-62968a400845 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:29:52.897363 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59b2dbe-4e80-4479-943b-62968a400845 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:29:52.898978 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59b2dbe-4e80-4479-943b-62968a400845 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:29:52.910788 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 784/1562] 10.222.0.62 () {58 vars in 1152 bytes} [Fri May 27 16:29:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:29:52.911409 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b2dbe-4e80-4479-943b-62968a400845 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:29:52.922138 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b2dbe-4e80-4479-943b-62968a400845 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:29:52.927367 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169dac3a-2478-4201-a909-2619ca7c6f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:29:52.928002 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169dac3a-2478-4201-a909-2619ca7c6f79 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:52.928287 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169dac3a-2478-4201-a909-2619ca7c6f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:52.928563 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169dac3a-2478-4201-a909-2619ca7c6f79 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:52.929234 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169dac3a-2478-4201-a909-2619ca7c6f79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:29:52.931128 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169dac3a-2478-4201-a909-2619ca7c6f79 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:29:52.987576 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 779/1563] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:29:52 2022] POST /identity/v3/projects => generated 403 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:29:52.988471 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d19e20-3fbd-4da3-9f57-9ebc6dffdeb9 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:29:52.994041 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:29:53.051596 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d19e20-3fbd-4da3-9f57-9ebc6dffdeb9 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:29:53.058340 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 785/1564] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:29:52 2022] POST /identity/v3/users => generated 296 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:29:53.058340 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169dac3a-2478-4201-a909-2619ca7c6f79 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:29:53.058557 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ea6673-c625-403f-9830-4f10a1df1d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:29:53.058557 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea6673-c625-403f-9830-4f10a1df1d2f admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:53.058557 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea6673-c625-403f-9830-4f10a1df1d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:53.058557 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea6673-c625-403f-9830-4f10a1df1d2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:53.059458 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ea6673-c625-403f-9830-4f10a1df1d2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:29:53.060009 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ea6673-c625-403f-9830-4f10a1df1d2f admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:29:53.066120 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169dac3a-2478-4201-a909-2619ca7c6f79 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:29:53.070120 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 780/1565] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:29:53.070831 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ea6673-c625-403f-9830-4f10a1df1d2f admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:29:53.073602 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1d51f2-995b-410f-a84c-b77d5f686240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:29:53.074199 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1d51f2-995b-410f-a84c-b77d5f686240 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:53.074516 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1d51f2-995b-410f-a84c-b77d5f686240 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:53.074797 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1d51f2-995b-410f-a84c-b77d5f686240 admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:53.075528 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1d51f2-995b-410f-a84c-b77d5f686240 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:29:53.075835 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1d51f2-995b-410f-a84c-b77d5f686240 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:29:53.077596 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1d51f2-995b-410f-a84c-b77d5f686240 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:29:53.081691 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ea6673-c625-403f-9830-4f10a1df1d2f admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:29:53.086968 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76157d11-2e57-4e0e-a4f5-1cba79714440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:29:53.087610 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76157d11-2e57-4e0e-a4f5-1cba79714440 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:53.087904 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76157d11-2e57-4e0e-a4f5-1cba79714440 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:53.088417 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76157d11-2e57-4e0e-a4f5-1cba79714440 admin admin] PATH_INFO: `/v3/domains` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:53.089306 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76157d11-2e57-4e0e-a4f5-1cba79714440 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:29:53.089828 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76157d11-2e57-4e0e-a4f5-1cba79714440 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:29:53.091160 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 786/1566] 10.222.0.62 () {58 vars in 1152 bytes} [Fri May 27 16:29:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:29:53.092062 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76157d11-2e57-4e0e-a4f5-1cba79714440 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:29:53.092333 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1d51f2-995b-410f-a84c-b77d5f686240 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:29:53.100243 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:29:53.105280 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1d51f2-995b-410f-a84c-b77d5f686240 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:29:53.106302 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 781/1567] 10.222.0.62 () {58 vars in 1152 bytes} [Fri May 27 16:29:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:29:53.106972 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76157d11-2e57-4e0e-a4f5-1cba79714440 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:29:53.114008 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a8184-9800-45b7-b058-eb6fdc7ff3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:29:53.114709 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a8184-9800-45b7-b058-eb6fdc7ff3a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:53.115029 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a8184-9800-45b7-b058-eb6fdc7ff3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:53.115307 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a8184-9800-45b7-b058-eb6fdc7ff3a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:53.116073 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832a8184-9800-45b7-b058-eb6fdc7ff3a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:29:53.116384 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832a8184-9800-45b7-b058-eb6fdc7ff3a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:29:53.116595 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76157d11-2e57-4e0e-a4f5-1cba79714440 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:29:53.118013 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832a8184-9800-45b7-b058-eb6fdc7ff3a9 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:29:53.121255 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ff23ee-5433-4159-8825-78928d2cdba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:29:53.121895 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff23ee-5433-4159-8825-78928d2cdba6 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:53.122179 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff23ee-5433-4159-8825-78928d2cdba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:53.122483 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff23ee-5433-4159-8825-78928d2cdba6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:53.123196 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ff23ee-5433-4159-8825-78928d2cdba6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:29:53.123503 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ff23ee-5433-4159-8825-78928d2cdba6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:29:53.125072 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ff23ee-5433-4159-8825-78928d2cdba6 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:29:53.129887 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 787/1568] 10.222.0.62 () {58 vars in 1152 bytes} [Fri May 27 16:29:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:29:53.130766 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a8184-9800-45b7-b058-eb6fdc7ff3a9 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:29:53.136882 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 782/1569] 10.222.0.62 () {58 vars in 1152 bytes} [Fri May 27 16:29:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:29:53.137871 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ff23ee-5433-4159-8825-78928d2cdba6 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:29:53.147567 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a8184-9800-45b7-b058-eb6fdc7ff3a9 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:29:53.148457 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ff23ee-5433-4159-8825-78928d2cdba6 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:29:53.152187 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc5ff8d-1655-4837-aa24-1f5134a05aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:29:53.152932 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5ff8d-1655-4837-aa24-1f5134a05aa8 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:53.153167 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48beb5f9-11a8-4d9f-9271-1d22bdf3298d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:29:53.153318 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5ff8d-1655-4837-aa24-1f5134a05aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:53.153501 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5ff8d-1655-4837-aa24-1f5134a05aa8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:53.153817 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48beb5f9-11a8-4d9f-9271-1d22bdf3298d admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:53.154106 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48beb5f9-11a8-4d9f-9271-1d22bdf3298d admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:53.154206 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc5ff8d-1655-4837-aa24-1f5134a05aa8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:29:53.154413 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48beb5f9-11a8-4d9f-9271-1d22bdf3298d admin admin] PATH_INFO: `/v3/users` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:53.155099 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48beb5f9-11a8-4d9f-9271-1d22bdf3298d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:29:53.156095 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc5ff8d-1655-4837-aa24-1f5134a05aa8 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:29:53.156219 dv-cinder-840493-2-smb devstack@keystone.service[80288]: WARNING py.warnings [None req-48beb5f9-11a8-4d9f-9271-1d22bdf3298d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 16:29:53.156219 dv-cinder-840493-2-smb devstack@keystone.service[80288]: warnings.warn(msg) May 27 16:29:53.156219 dv-cinder-840493-2-smb devstack@keystone.service[80288]: May 27 16:29:53.157312 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48beb5f9-11a8-4d9f-9271-1d22bdf3298d admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:29:53.298884 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 783/1570] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:29:53 2022] POST /identity/v3/users => generated 302 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:29:53.299268 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 788/1571] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:29:53 2022] POST /identity/v3/projects => generated 365 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:29:53.299268 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc5ff8d-1655-4837-aa24-1f5134a05aa8 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:29:53.299766 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48beb5f9-11a8-4d9f-9271-1d22bdf3298d admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:29:53.309602 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48beb5f9-11a8-4d9f-9271-1d22bdf3298d admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:29:53.361289 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc5ff8d-1655-4837-aa24-1f5134a05aa8 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:29:53.365906 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5570db-f0d7-468b-a331-6fe060bf0664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:29:53.366204 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76508ef3-7036-4bae-8719-bb1b598e8213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:29:53.366595 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5570db-f0d7-468b-a331-6fe060bf0664 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:53.366879 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5570db-f0d7-468b-a331-6fe060bf0664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:53.366978 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76508ef3-7036-4bae-8719-bb1b598e8213 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:53.367154 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5570db-f0d7-468b-a331-6fe060bf0664 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:53.367272 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76508ef3-7036-4bae-8719-bb1b598e8213 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:53.367451 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76508ef3-7036-4bae-8719-bb1b598e8213 admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:53.367876 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5570db-f0d7-468b-a331-6fe060bf0664 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:29:53.368236 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76508ef3-7036-4bae-8719-bb1b598e8213 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:29:53.369468 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5570db-f0d7-468b-a331-6fe060bf0664 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:29:53.369823 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76508ef3-7036-4bae-8719-bb1b598e8213 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:29:53.380583 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 784/1572] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:29:53 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:29:53.382150 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 789/1573] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:29:53 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:29:53.383001 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5570db-f0d7-468b-a331-6fe060bf0664 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:29:53.384297 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76508ef3-7036-4bae-8719-bb1b598e8213 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:29:53.393538 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5570db-f0d7-468b-a331-6fe060bf0664 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:29:53.397532 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76508ef3-7036-4bae-8719-bb1b598e8213 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:29:53.398959 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6127817-30b3-48d5-b03b-2410c3c47050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:29:53.399611 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6127817-30b3-48d5-b03b-2410c3c47050 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:53.399734 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b6ad66-c934-4341-abff-2f8bce982c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:29:53.399926 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6127817-30b3-48d5-b03b-2410c3c47050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:53.400210 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6127817-30b3-48d5-b03b-2410c3c47050 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:53.400464 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b6ad66-c934-4341-abff-2f8bce982c23 admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:53.400754 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b6ad66-c934-4341-abff-2f8bce982c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:53.400895 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6127817-30b3-48d5-b03b-2410c3c47050 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:29:53.401037 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b6ad66-c934-4341-abff-2f8bce982c23 admin admin] PATH_INFO: `/v3/projects` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:53.401729 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b6ad66-c934-4341-abff-2f8bce982c23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:29:53.402878 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6127817-30b3-48d5-b03b-2410c3c47050 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:29:53.403693 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b6ad66-c934-4341-abff-2f8bce982c23 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:29:53.536047 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 790/1574] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:29:53 2022] POST /identity/v3/projects => generated 373 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:29:53.536848 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6127817-30b3-48d5-b03b-2410c3c47050 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:29:53.575331 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 785/1575] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:29:53 2022] POST /identity/v3/projects => generated 379 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:29:53.575331 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b6ad66-c934-4341-abff-2f8bce982c23 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:29:53.598753 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6127817-30b3-48d5-b03b-2410c3c47050 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:29:53.607522 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:29:53.643502 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b6ad66-c934-4341-abff-2f8bce982c23 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:29:53.643502 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6126079-4575-47c0-9c06-e7831e918e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:29:53.643502 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6126079-4575-47c0-9c06-e7831e918e1e admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:53.643502 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6126079-4575-47c0-9c06-e7831e918e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:53.643935 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6126079-4575-47c0-9c06-e7831e918e1e admin admin] PATH_INFO: `/v3/projects` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:53.643935 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6126079-4575-47c0-9c06-e7831e918e1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:29:53.645440 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:29:53.645657 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6126079-4575-47c0-9c06-e7831e918e1e admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:29:53.655095 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce063d-9cb0-4b9c-923c-ec4a68b9ac92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:29:53.655767 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce063d-9cb0-4b9c-923c-ec4a68b9ac92 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:53.656052 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce063d-9cb0-4b9c-923c-ec4a68b9ac92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:53.656333 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce063d-9cb0-4b9c-923c-ec4a68b9ac92 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:53.657057 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ce063d-9cb0-4b9c-923c-ec4a68b9ac92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:29:53.659121 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ce063d-9cb0-4b9c-923c-ec4a68b9ac92 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:29:53.747090 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 786/1576] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:29:53 2022] POST /identity/v3/projects => generated 355 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:29:53.747927 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6126079-4575-47c0-9c06-e7831e918e1e admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:29:53.762351 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 791/1577] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:29:53 2022] POST /identity/v3/projects => generated 375 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:29:53.762351 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce063d-9cb0-4b9c-923c-ec4a68b9ac92 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:29:53.813397 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6126079-4575-47c0-9c06-e7831e918e1e admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:29:53.823163 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce063d-9cb0-4b9c-923c-ec4a68b9ac92 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:29:53.827812 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e1b06-968c-4fe2-88ba-13c4c210e11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:29:53.828481 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e1b06-968c-4fe2-88ba-13c4c210e11d admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:53.828757 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e1b06-968c-4fe2-88ba-13c4c210e11d admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:53.829030 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e1b06-968c-4fe2-88ba-13c4c210e11d admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:53.829730 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432e1b06-968c-4fe2-88ba-13c4c210e11d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:29:53.831705 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432e1b06-968c-4fe2-88ba-13c4c210e11d admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:29:53.869158 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ffc33b-9449-49fe-a987-787f63593081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:29:53.869833 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ffc33b-9449-49fe-a987-787f63593081 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:53.870113 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ffc33b-9449-49fe-a987-787f63593081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:53.870423 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ffc33b-9449-49fe-a987-787f63593081 admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:53.871142 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ffc33b-9449-49fe-a987-787f63593081 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:29:53.872724 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ffc33b-9449-49fe-a987-787f63593081 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:29:53.883087 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 787/1578] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:29:53 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:29:53.884385 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ffc33b-9449-49fe-a987-787f63593081 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:29:53.893959 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ffc33b-9449-49fe-a987-787f63593081 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:29:53.899042 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01010015-1e46-40e9-b6b7-a6a2e0ea8fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:29:53.899659 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01010015-1e46-40e9-b6b7-a6a2e0ea8fe4 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:53.899947 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01010015-1e46-40e9-b6b7-a6a2e0ea8fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:53.900226 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01010015-1e46-40e9-b6b7-a6a2e0ea8fe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:53.900928 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01010015-1e46-40e9-b6b7-a6a2e0ea8fe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:29:53.902521 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01010015-1e46-40e9-b6b7-a6a2e0ea8fe4 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:29:53.912643 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 788/1579] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:29:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:29:53.913516 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01010015-1e46-40e9-b6b7-a6a2e0ea8fe4 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:29:53.922742 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01010015-1e46-40e9-b6b7-a6a2e0ea8fe4 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:29:53.927261 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace12bcd-13e5-4f27-8175-32a4365b5874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:29:53.928136 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace12bcd-13e5-4f27-8175-32a4365b5874 admin admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:53.928450 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace12bcd-13e5-4f27-8175-32a4365b5874 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:53.929019 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace12bcd-13e5-4f27-8175-32a4365b5874 admin admin] PATH_INFO: `/v3/projects/56eea53edcdb46f2962bd64b148fed5c/users/084e2920eeb1401fbd973d8dcbf81b5c/roles/c8ce6d197f654598ac45f6016ecccabd` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:53.929578 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 792/1580] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:29:53 2022] POST /identity/v3/users => generated 283 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:29:53.930551 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e1b06-968c-4fe2-88ba-13c4c210e11d admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:29:53.940634 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e1b06-968c-4fe2-88ba-13c4c210e11d admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:29:53.944813 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace12bcd-13e5-4f27-8175-32a4365b5874 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56eea53edcdb46f2962bd64b148fed5c, user_id=084e2920eeb1401fbd973d8dcbf81b5c, role_id=c8ce6d197f654598ac45f6016ecccabd)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:29:53.945542 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c5fb7-639c-49fd-b022-52207be6a72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:29:53.946203 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c5fb7-639c-49fd-b022-52207be6a72d admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:53.946519 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c5fb7-639c-49fd-b022-52207be6a72d admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:53.946800 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c5fb7-639c-49fd-b022-52207be6a72d admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:53.947487 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8c5fb7-639c-49fd-b022-52207be6a72d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:29:53.947994 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace12bcd-13e5-4f27-8175-32a4365b5874 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:29:53.949404 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8c5fb7-639c-49fd-b022-52207be6a72d admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:29:54.038661 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 789/1581] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:29:53 2022] PUT /identity/v3/projects/56eea53edcdb46f2962bd64b148fed5c/users/084e2920eeb1401fbd973d8dcbf81b5c/roles/c8ce6d197f654598ac45f6016ecccabd => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:29:54.039489 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace12bcd-13e5-4f27-8175-32a4365b5874 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:29:54.068583 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:29:54.075156 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 793/1582] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:29:53 2022] POST /identity/v3/users => generated 287 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:29:54.075156 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c5fb7-639c-49fd-b022-52207be6a72d admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:29:54.087883 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c5fb7-639c-49fd-b022-52207be6a72d admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:29:54.108342 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace12bcd-13e5-4f27-8175-32a4365b5874 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:29:54.113271 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e577b-4979-48a9-a9ed-9744ae2eb03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:29:54.113981 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e577b-4979-48a9-a9ed-9744ae2eb03c admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:54.114291 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e577b-4979-48a9-a9ed-9744ae2eb03c admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:54.114577 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e577b-4979-48a9-a9ed-9744ae2eb03c admin admin] PATH_INFO: `/v3/users` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:54.115354 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9e577b-4979-48a9-a9ed-9744ae2eb03c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:29:54.117386 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9e577b-4979-48a9-a9ed-9744ae2eb03c admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:29:54.145975 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601831ec-8516-40a2-9687-b40d48dc22e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:29:54.146730 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601831ec-8516-40a2-9687-b40d48dc22e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:54.147021 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601831ec-8516-40a2-9687-b40d48dc22e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:54.147303 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601831ec-8516-40a2-9687-b40d48dc22e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:54.147984 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601831ec-8516-40a2-9687-b40d48dc22e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:29:54.149958 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601831ec-8516-40a2-9687-b40d48dc22e3 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:29:54.229286 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 790/1583] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:29:54 2022] POST /identity/v3/users => generated 290 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:29:54.229286 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e577b-4979-48a9-a9ed-9744ae2eb03c admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:29:54.237328 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e577b-4979-48a9-a9ed-9744ae2eb03c admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:29:54.241809 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bab1e1c-9ee6-4962-89d1-cca55e1e0513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:29:54.242471 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab1e1c-9ee6-4962-89d1-cca55e1e0513 admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:54.242760 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab1e1c-9ee6-4962-89d1-cca55e1e0513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:54.243039 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab1e1c-9ee6-4962-89d1-cca55e1e0513 admin admin] PATH_INFO: `/v3/users` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:54.243710 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bab1e1c-9ee6-4962-89d1-cca55e1e0513 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:29:54.245590 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bab1e1c-9ee6-4962-89d1-cca55e1e0513 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:29:54.256718 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 794/1584] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:29:54 2022] POST /identity/v3/users => generated 278 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:29:54.256718 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601831ec-8516-40a2-9687-b40d48dc22e3 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:29:54.265964 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601831ec-8516-40a2-9687-b40d48dc22e3 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:29:54.271104 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2c5310-09c9-418d-8d85-c1e3885dc3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:29:54.271745 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c5310-09c9-418d-8d85-c1e3885dc3cd admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:54.272032 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c5310-09c9-418d-8d85-c1e3885dc3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:54.272312 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c5310-09c9-418d-8d85-c1e3885dc3cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:54.273031 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2c5310-09c9-418d-8d85-c1e3885dc3cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:29:54.274691 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2c5310-09c9-418d-8d85-c1e3885dc3cd admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:29:54.284573 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 795/1585] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:29:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:29:54.285327 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2c5310-09c9-418d-8d85-c1e3885dc3cd admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:29:54.294625 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2c5310-09c9-418d-8d85-c1e3885dc3cd admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:29:54.299155 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12456bcd-563f-4fd1-83c1-3b1bac5afadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:29:54.299988 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12456bcd-563f-4fd1-83c1-3b1bac5afadf admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:54.300272 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12456bcd-563f-4fd1-83c1-3b1bac5afadf admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:54.300549 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12456bcd-563f-4fd1-83c1-3b1bac5afadf admin admin] PATH_INFO: `/v3/projects/ae9096e313b84244a4d719822eb82a1d/users/d2aced0927994e97bac1ce1a63f4a911/roles/c8ce6d197f654598ac45f6016ecccabd` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:54.315008 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12456bcd-563f-4fd1-83c1-3b1bac5afadf admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae9096e313b84244a4d719822eb82a1d, user_id=d2aced0927994e97bac1ce1a63f4a911, role_id=c8ce6d197f654598ac45f6016ecccabd)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:29:54.316027 dv-cinder-840493-2-smb devstack@keystone.service[80289]: WARNING py.warnings [None req-12456bcd-563f-4fd1-83c1-3b1bac5afadf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 16:29:54.316027 dv-cinder-840493-2-smb devstack@keystone.service[80289]: warnings.warn(msg) May 27 16:29:54.316027 dv-cinder-840493-2-smb devstack@keystone.service[80289]: May 27 16:29:54.318543 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12456bcd-563f-4fd1-83c1-3b1bac5afadf admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:29:54.363250 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 791/1586] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:29:54 2022] POST /identity/v3/users => generated 288 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:29:54.365600 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bab1e1c-9ee6-4962-89d1-cca55e1e0513 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:29:54.378096 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bab1e1c-9ee6-4962-89d1-cca55e1e0513 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:29:54.384278 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6c4633-7a66-43ed-a13e-73ed7750a059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:29:54.384949 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c4633-7a66-43ed-a13e-73ed7750a059 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:54.385230 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c4633-7a66-43ed-a13e-73ed7750a059 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:54.385502 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c4633-7a66-43ed-a13e-73ed7750a059 admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:54.386265 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6c4633-7a66-43ed-a13e-73ed7750a059 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:29:54.387851 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6c4633-7a66-43ed-a13e-73ed7750a059 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:29:54.398952 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 792/1587] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:29:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:29:54.400145 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2babb90-bd6f-45b3-a8a7-4c56eb1eea8c None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:54.400436 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2babb90-bd6f-45b3-a8a7-4c56eb1eea8c None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:54.400716 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2babb90-bd6f-45b3-a8a7-4c56eb1eea8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:54.420481 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 796/1588] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:29:54 2022] PUT /identity/v3/projects/ae9096e313b84244a4d719822eb82a1d/users/d2aced0927994e97bac1ce1a63f4a911/roles/c8ce6d197f654598ac45f6016ecccabd => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:29:54.421319 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12456bcd-563f-4fd1-83c1-3b1bac5afadf admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:29:54.427746 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:29:54.431880 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-c2babb90-bd6f-45b3-a8a7-4c56eb1eea8c None None] MFA Rules not processed for user `084e2920eeb1401fbd973d8dcbf81b5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:29:54.432377 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-c2babb90-bd6f-45b3-a8a7-4c56eb1eea8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:29:54.484611 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12456bcd-563f-4fd1-83c1-3b1bac5afadf admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:29:54.490572 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087b10ce-311f-4fb2-b344-84919bfd8f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:29:54.491264 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087b10ce-311f-4fb2-b344-84919bfd8f53 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:54.491553 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087b10ce-311f-4fb2-b344-84919bfd8f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:54.491831 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087b10ce-311f-4fb2-b344-84919bfd8f53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:54.492554 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087b10ce-311f-4fb2-b344-84919bfd8f53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:29:54.494506 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087b10ce-311f-4fb2-b344-84919bfd8f53 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:29:54.498678 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 793/1589] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:29:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:29:54.503948 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2babb90-bd6f-45b3-a8a7-4c56eb1eea8c None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:29:54.508851 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 797/1590] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:29:54 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:29:54.508851 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087b10ce-311f-4fb2-b344-84919bfd8f53 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:29:54.511695 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2babb90-bd6f-45b3-a8a7-4c56eb1eea8c None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:29:54.516996 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67361fa8-ecdd-48e7-b7c5-a2abb694013d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:29:54.517669 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67361fa8-ecdd-48e7-b7c5-a2abb694013d admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:54.517923 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087b10ce-311f-4fb2-b344-84919bfd8f53 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:29:54.518077 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67361fa8-ecdd-48e7-b7c5-a2abb694013d admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:54.518311 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67361fa8-ecdd-48e7-b7c5-a2abb694013d admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:54.518970 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67361fa8-ecdd-48e7-b7c5-a2abb694013d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:29:54.520711 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67361fa8-ecdd-48e7-b7c5-a2abb694013d admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:29:54.523114 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba2a79-fd76-4dde-b621-b385e7ffda31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:29:54.524269 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba2a79-fd76-4dde-b621-b385e7ffda31 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:54.524794 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba2a79-fd76-4dde-b621-b385e7ffda31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:54.525735 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba2a79-fd76-4dde-b621-b385e7ffda31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:54.526506 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ba2a79-fd76-4dde-b621-b385e7ffda31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:29:54.528260 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ba2a79-fd76-4dde-b621-b385e7ffda31 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:29:54.534983 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 794/1591] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:29:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:29:54.534983 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67361fa8-ecdd-48e7-b7c5-a2abb694013d admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:29:54.539618 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 798/1592] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:29:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:29:54.552511 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba2a79-fd76-4dde-b621-b385e7ffda31 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:29:54.552643 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67361fa8-ecdd-48e7-b7c5-a2abb694013d admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:29:54.552759 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba2a79-fd76-4dde-b621-b385e7ffda31 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:29:54.552862 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e6b33b-b48f-4bfd-ab4a-541beb183caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:29:54.552862 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6b33b-b48f-4bfd-ab4a-541beb183caf admin admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:54.552862 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6b33b-b48f-4bfd-ab4a-541beb183caf admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:54.554465 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6b33b-b48f-4bfd-ab4a-541beb183caf admin admin] PATH_INFO: `/v3/projects/940cf4d429c549f28b77263bf08b7ab7/users/cc70e444bc9346dbb89c0e0ea0f08212/roles/c8ce6d197f654598ac45f6016ecccabd` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:54.555223 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e170547e-d1ee-45bf-90b2-f801e42a45dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:29:54.555915 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e170547e-d1ee-45bf-90b2-f801e42a45dc admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:54.556206 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e170547e-d1ee-45bf-90b2-f801e42a45dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:54.556488 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e170547e-d1ee-45bf-90b2-f801e42a45dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:54.557206 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e170547e-d1ee-45bf-90b2-f801e42a45dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:29:54.558822 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e170547e-d1ee-45bf-90b2-f801e42a45dc admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:29:54.572562 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 799/1593] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:29:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:29:54.572751 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e6b33b-b48f-4bfd-ab4a-541beb183caf admin admin] RBAC: Authorizing `identity:create_grant(project_id=940cf4d429c549f28b77263bf08b7ab7, user_id=cc70e444bc9346dbb89c0e0ea0f08212, role_id=c8ce6d197f654598ac45f6016ecccabd)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:29:54.572862 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e170547e-d1ee-45bf-90b2-f801e42a45dc admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:29:54.572960 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e6b33b-b48f-4bfd-ab4a-541beb183caf admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:29:54.582707 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e170547e-d1ee-45bf-90b2-f801e42a45dc admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:29:54.587211 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a99567-09d8-47ed-9600-be672b58ae25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:29:54.587863 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a99567-09d8-47ed-9600-be672b58ae25 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:54.588150 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a99567-09d8-47ed-9600-be672b58ae25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:54.588433 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a99567-09d8-47ed-9600-be672b58ae25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:54.589144 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a99567-09d8-47ed-9600-be672b58ae25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:29:54.590793 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a99567-09d8-47ed-9600-be672b58ae25 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:29:54.601088 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 800/1594] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:29:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:29:54.602273 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2700d76d-65b8-4ab2-85da-28ded90c25b2 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:54.602567 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2700d76d-65b8-4ab2-85da-28ded90c25b2 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:54.602849 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2700d76d-65b8-4ab2-85da-28ded90c25b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:54.619349 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-2700d76d-65b8-4ab2-85da-28ded90c25b2 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:29:54.620555 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-2700d76d-65b8-4ab2-85da-28ded90c25b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:29:54.628328 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 801/1595] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:29:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:29:54.632229 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2700d76d-65b8-4ab2-85da-28ded90c25b2 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:29:54.639646 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2700d76d-65b8-4ab2-85da-28ded90c25b2 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:29:54.644248 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a71d5-869e-4799-a5a4-bec1c06ce0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:29:54.644916 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a71d5-869e-4799-a5a4-bec1c06ce0eb admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:54.645205 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a71d5-869e-4799-a5a4-bec1c06ce0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:54.645485 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a71d5-869e-4799-a5a4-bec1c06ce0eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:54.646202 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22a71d5-869e-4799-a5a4-bec1c06ce0eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:29:54.647863 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22a71d5-869e-4799-a5a4-bec1c06ce0eb admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:29:54.658016 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 802/1596] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:29:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:29:54.659279 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dee621f-15ed-4098-b0c5-43ec551fd9b7 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:54.665140 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dee621f-15ed-4098-b0c5-43ec551fd9b7 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:54.665140 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dee621f-15ed-4098-b0c5-43ec551fd9b7 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:54.665140 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 803/1597] 10.222.0.62 () {54 vars in 961 bytes} [Fri May 27 16:29:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:29:54.665140 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dee621f-15ed-4098-b0c5-43ec551fd9b7 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:29:54.673774 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dee621f-15ed-4098-b0c5-43ec551fd9b7 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:29:54.678922 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a10118-b8a9-4efd-9897-e7ea3ec434bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:29:54.679524 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a10118-b8a9-4efd-9897-e7ea3ec434bb admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:54.679811 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a10118-b8a9-4efd-9897-e7ea3ec434bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:54.680091 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a10118-b8a9-4efd-9897-e7ea3ec434bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:54.680799 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a10118-b8a9-4efd-9897-e7ea3ec434bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:29:54.682395 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a10118-b8a9-4efd-9897-e7ea3ec434bb admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:29:54.693870 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 804/1598] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:29:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:29:54.694873 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a10118-b8a9-4efd-9897-e7ea3ec434bb admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:29:54.702521 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 795/1599] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:29:54 2022] PUT /identity/v3/projects/940cf4d429c549f28b77263bf08b7ab7/users/cc70e444bc9346dbb89c0e0ea0f08212/roles/c8ce6d197f654598ac45f6016ecccabd => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:29:54.703474 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e6b33b-b48f-4bfd-ab4a-541beb183caf admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:29:54.709228 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a10118-b8a9-4efd-9897-e7ea3ec434bb admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:29:54.748698 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:29:54.763136 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289d9e6c-599e-4ca0-877b-f5a648166267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:29:54.763814 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d9e6c-599e-4ca0-877b-f5a648166267 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:54.764099 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d9e6c-599e-4ca0-877b-f5a648166267 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:54.764395 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d9e6c-599e-4ca0-877b-f5a648166267 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:54.765137 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289d9e6c-599e-4ca0-877b-f5a648166267 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:29:54.767054 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289d9e6c-599e-4ca0-877b-f5a648166267 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:29:54.768410 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e6b33b-b48f-4bfd-ab4a-541beb183caf admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:29:54.773342 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8d6629-61da-4294-8fd3-11d1079c839d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:29:54.774005 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d6629-61da-4294-8fd3-11d1079c839d admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:54.774322 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d6629-61da-4294-8fd3-11d1079c839d admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:54.774603 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d6629-61da-4294-8fd3-11d1079c839d admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:54.775376 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8d6629-61da-4294-8fd3-11d1079c839d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:29:54.776970 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8d6629-61da-4294-8fd3-11d1079c839d admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:29:54.777397 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 805/1600] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:29:54 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:29:54.778283 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289d9e6c-599e-4ca0-877b-f5a648166267 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:29:54.791269 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 796/1601] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:29:54 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:29:54.791451 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289d9e6c-599e-4ca0-877b-f5a648166267 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:29:54.796460 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8d6629-61da-4294-8fd3-11d1079c839d admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:29:54.796595 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5c18ce-fe9c-47ec-9ce5-d4f638052edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:29:54.796595 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c18ce-fe9c-47ec-9ce5-d4f638052edf admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:54.796595 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c18ce-fe9c-47ec-9ce5-d4f638052edf admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:54.796595 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c18ce-fe9c-47ec-9ce5-d4f638052edf admin admin] PATH_INFO: `/v3/projects/e71a743c256a4a9b91acb075079af933/users/fedac9fe4a414116bdcf9a722bb9fe8c/roles/c8ce6d197f654598ac45f6016ecccabd` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:54.813654 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5c18ce-fe9c-47ec-9ce5-d4f638052edf admin admin] RBAC: Authorizing `identity:create_grant(project_id=e71a743c256a4a9b91acb075079af933, user_id=fedac9fe4a414116bdcf9a722bb9fe8c, role_id=c8ce6d197f654598ac45f6016ecccabd)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:29:54.816365 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5c18ce-fe9c-47ec-9ce5-d4f638052edf admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:29:54.849005 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8d6629-61da-4294-8fd3-11d1079c839d admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:29:54.852703 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c19313-bfd0-471b-bcd3-3025b9490417 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:29:54.853511 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c19313-bfd0-471b-bcd3-3025b9490417 service neutron] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:54.853848 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c19313-bfd0-471b-bcd3-3025b9490417 service neutron] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:54.854134 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c19313-bfd0-471b-bcd3-3025b9490417 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:54.864468 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c19313-bfd0-471b-bcd3-3025b9490417 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:29:54.866308 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c19313-bfd0-471b-bcd3-3025b9490417 service neutron] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:29:54.876129 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 797/1602] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:29:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:29:54.881915 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c19313-bfd0-471b-bcd3-3025b9490417 service neutron] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:29:54.886584 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c19313-bfd0-471b-bcd3-3025b9490417 service neutron] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:29:54.891700 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b8a1c2-6e3f-4567-a0b0-1d28eb80d432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:29:54.892582 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b8a1c2-6e3f-4567-a0b0-1d28eb80d432 admin admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:54.892872 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b8a1c2-6e3f-4567-a0b0-1d28eb80d432 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:54.893150 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b8a1c2-6e3f-4567-a0b0-1d28eb80d432 admin admin] PATH_INFO: `/v3/projects/1be282fda618452982c480b875f0139a/users/199f6997391641abbc7c51a24a33ae59/roles/c8ce6d197f654598ac45f6016ecccabd` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:54.981828 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 806/1603] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:29:54 2022] PUT /identity/v3/projects/e71a743c256a4a9b91acb075079af933/users/fedac9fe4a414116bdcf9a722bb9fe8c/roles/c8ce6d197f654598ac45f6016ecccabd => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:29:54.983057 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d4b30a-e348-457b-841f-f08a8d97740d None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:54.983364 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d4b30a-e348-457b-841f-f08a8d97740d None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:54.983632 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d4b30a-e348-457b-841f-f08a8d97740d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:55.003460 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-96d4b30a-e348-457b-841f-f08a8d97740d None None] MFA Rules not processed for user `cb13ad6d8b1e46029262556bff398796`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:29:55.004736 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-96d4b30a-e348-457b-841f-f08a8d97740d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:29:55.010025 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:29:55.036975 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b8a1c2-6e3f-4567-a0b0-1d28eb80d432 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1be282fda618452982c480b875f0139a, user_id=199f6997391641abbc7c51a24a33ae59, role_id=c8ce6d197f654598ac45f6016ecccabd)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:29:55.039780 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b8a1c2-6e3f-4567-a0b0-1d28eb80d432 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:29:55.079429 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 807/1604] 10.222.0.62 () {58 vars in 1058 bytes} [Fri May 27 16:29:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:29:55.079924 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d4b30a-e348-457b-841f-f08a8d97740d None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:29:55.141470 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 798/1605] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:29:54 2022] PUT /identity/v3/projects/1be282fda618452982c480b875f0139a/users/199f6997391641abbc7c51a24a33ae59/roles/c8ce6d197f654598ac45f6016ecccabd => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:29:55.142014 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d4b30a-e348-457b-841f-f08a8d97740d None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:29:55.143526 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8afdb-a143-438c-add2-6272d6e6374f None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:55.143939 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8afdb-a143-438c-add2-6272d6e6374f None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:55.144224 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8afdb-a143-438c-add2-6272d6e6374f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:55.173176 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-09e8afdb-a143-438c-add2-6272d6e6374f None None] MFA Rules not processed for user `cc70e444bc9346dbb89c0e0ea0f08212`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:29:55.173176 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-09e8afdb-a143-438c-add2-6272d6e6374f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:29:55.197611 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e609380c-2706-43e7-a341-0303b349b45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:29:55.200468 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609380c-2706-43e7-a341-0303b349b45d admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:55.200468 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609380c-2706-43e7-a341-0303b349b45d admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:55.200468 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609380c-2706-43e7-a341-0303b349b45d admin admin] PATH_INFO: `/v3/projects/7481daa23a9c4f7b91e59bb4795bd262/users/6066cf53517044f69afcd4c2e8b13b55/roles/c8ce6d197f654598ac45f6016ecccabd` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:55.215564 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e609380c-2706-43e7-a341-0303b349b45d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7481daa23a9c4f7b91e59bb4795bd262, user_id=6066cf53517044f69afcd4c2e8b13b55, role_id=c8ce6d197f654598ac45f6016ecccabd)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:29:55.219217 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e609380c-2706-43e7-a341-0303b349b45d admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:29:55.240815 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 799/1606] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:29:55 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:29:55.241643 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e8afdb-a143-438c-add2-6272d6e6374f None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:29:55.251789 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e8afdb-a143-438c-add2-6272d6e6374f None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:29:55.259339 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495bb2fd-2f77-40d6-ac35-2f86a67cdeec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:29:55.260248 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495bb2fd-2f77-40d6-ac35-2f86a67cdeec admin admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:55.260495 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495bb2fd-2f77-40d6-ac35-2f86a67cdeec admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:55.260813 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495bb2fd-2f77-40d6-ac35-2f86a67cdeec admin admin] PATH_INFO: `/v3/projects/10335f4dca1f4b5f84859eb7907677f2/users/e0c686bafd66451b9c0eb75d3b59e2c9/roles/c8ce6d197f654598ac45f6016ecccabd` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:55.277348 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495bb2fd-2f77-40d6-ac35-2f86a67cdeec admin admin] RBAC: Authorizing `identity:create_grant(project_id=10335f4dca1f4b5f84859eb7907677f2, user_id=e0c686bafd66451b9c0eb75d3b59e2c9, role_id=c8ce6d197f654598ac45f6016ecccabd)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:29:55.280126 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495bb2fd-2f77-40d6-ac35-2f86a67cdeec admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:29:55.323803 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 808/1607] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:29:55 2022] PUT /identity/v3/projects/7481daa23a9c4f7b91e59bb4795bd262/users/6066cf53517044f69afcd4c2e8b13b55/roles/c8ce6d197f654598ac45f6016ecccabd => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:29:55.324787 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e609380c-2706-43e7-a341-0303b349b45d admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:29:55.352538 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 800/1608] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:29:55 2022] PUT /identity/v3/projects/10335f4dca1f4b5f84859eb7907677f2/users/e0c686bafd66451b9c0eb75d3b59e2c9/roles/c8ce6d197f654598ac45f6016ecccabd => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:29:55.354463 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af311982-8f94-4d98-b277-da273b9b4f54 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:55.354463 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af311982-8f94-4d98-b277-da273b9b4f54 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:55.354463 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af311982-8f94-4d98-b277-da273b9b4f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:55.358895 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:29:55.380628 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-af311982-8f94-4d98-b277-da273b9b4f54 None None] MFA Rules not processed for user `fedac9fe4a414116bdcf9a722bb9fe8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:29:55.382432 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-af311982-8f94-4d98-b277-da273b9b4f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:29:55.387573 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e609380c-2706-43e7-a341-0303b349b45d admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:29:55.390461 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:29:55.447269 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e64b5-510d-4dca-8612-b6215d9c7d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:29:55.448349 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e64b5-510d-4dca-8612-b6215d9c7d91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:55.448633 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e64b5-510d-4dca-8612-b6215d9c7d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:55.448983 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e64b5-510d-4dca-8612-b6215d9c7d91 admin admin] PATH_INFO: `/v3/projects/08e477d9bd754665844c35963f723850/users/820d152f8d5b45a2aca035e7cc2684ef/roles/c8ce6d197f654598ac45f6016ecccabd` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:55.457860 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 801/1609] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:29:55 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:29:55.459709 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af311982-8f94-4d98-b277-da273b9b4f54 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:29:55.469007 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13e64b5-510d-4dca-8612-b6215d9c7d91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08e477d9bd754665844c35963f723850, user_id=820d152f8d5b45a2aca035e7cc2684ef, role_id=c8ce6d197f654598ac45f6016ecccabd)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:29:55.472090 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13e64b5-510d-4dca-8612-b6215d9c7d91 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:29:55.537439 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af311982-8f94-4d98-b277-da273b9b4f54 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:29:55.543159 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea38e0-e05e-44d7-8618-1848d6d2747d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb13ad6d8b1e46029262556bff398796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:29:55.543810 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea38e0-e05e-44d7-8618-1848d6d2747d service nova] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:55.544094 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea38e0-e05e-44d7-8618-1848d6d2747d service nova] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:55.544366 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea38e0-e05e-44d7-8618-1848d6d2747d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:55.603957 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edea38e0-e05e-44d7-8618-1848d6d2747d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:29:55.605563 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edea38e0-e05e-44d7-8618-1848d6d2747d service nova] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:29:55.614692 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 802/1610] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:29:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:29:55.615978 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c1a9f-be57-40c2-a3df-3657adb3eb2b None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:55.616260 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c1a9f-be57-40c2-a3df-3657adb3eb2b None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:55.616538 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c1a9f-be57-40c2-a3df-3657adb3eb2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:55.627398 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 809/1611] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:29:55 2022] PUT /identity/v3/projects/08e477d9bd754665844c35963f723850/users/820d152f8d5b45a2aca035e7cc2684ef/roles/c8ce6d197f654598ac45f6016ecccabd => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:29:55.628413 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e64b5-510d-4dca-8612-b6215d9c7d91 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:29:55.647621 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-0f2c1a9f-be57-40c2-a3df-3657adb3eb2b None None] MFA Rules not processed for user `199f6997391641abbc7c51a24a33ae59`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:29:55.648870 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-0f2c1a9f-be57-40c2-a3df-3657adb3eb2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:29:55.701252 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e64b5-510d-4dca-8612-b6215d9c7d91 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:29:55.706667 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f925f6-a995-4144-8b8c-55c84d266bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:29:55.707805 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f925f6-a995-4144-8b8c-55c84d266bd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:55.708230 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f925f6-a995-4144-8b8c-55c84d266bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:55.708526 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f925f6-a995-4144-8b8c-55c84d266bd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:55.709434 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f925f6-a995-4144-8b8c-55c84d266bd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:29:55.719218 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f925f6-a995-4144-8b8c-55c84d266bd8 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:29:55.719363 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 803/1612] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:29:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:29:55.719363 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c9f273-bc46-46dd-9cac-df949d8a8a83 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:55.719363 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c9f273-bc46-46dd-9cac-df949d8a8a83 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:55.719363 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c9f273-bc46-46dd-9cac-df949d8a8a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:55.739882 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-11c9f273-bc46-46dd-9cac-df949d8a8a83 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:29:55.740900 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-11c9f273-bc46-46dd-9cac-df949d8a8a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:29:55.749205 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 804/1613] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:29:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:29:55.752290 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db914f-8008-4452-8d01-e22eec774a06 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:55.752290 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db914f-8008-4452-8d01-e22eec774a06 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:55.752290 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db914f-8008-4452-8d01-e22eec774a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:55.782992 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-91db914f-8008-4452-8d01-e22eec774a06 None None] MFA Rules not processed for user `e0c686bafd66451b9c0eb75d3b59e2c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:29:55.784359 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-91db914f-8008-4452-8d01-e22eec774a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:29:55.849485 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 810/1614] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:29:55 2022] POST /identity/v3/projects => generated 403 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:29:55.851300 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f925f6-a995-4144-8b8c-55c84d266bd8 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:29:55.859592 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 805/1615] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:29:55 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:29:55.859592 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595597ab-9a56-43a0-89cd-bb8f592b9206 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:55.859592 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595597ab-9a56-43a0-89cd-bb8f592b9206 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:55.859592 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595597ab-9a56-43a0-89cd-bb8f592b9206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:55.885313 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-595597ab-9a56-43a0-89cd-bb8f592b9206 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:29:55.887429 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-595597ab-9a56-43a0-89cd-bb8f592b9206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:29:55.917437 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:29:55.920754 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:29:55.932673 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f925f6-a995-4144-8b8c-55c84d266bd8 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:29:55.937401 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711ff779-6359-471f-8435-8746ccacdf7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:29:55.938061 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ff779-6359-471f-8435-8746ccacdf7c admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:55.938377 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ff779-6359-471f-8435-8746ccacdf7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:55.938661 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ff779-6359-471f-8435-8746ccacdf7c admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:55.939452 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711ff779-6359-471f-8435-8746ccacdf7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:29:55.941394 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711ff779-6359-471f-8435-8746ccacdf7c admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:29:55.954504 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 806/1616] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:29:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:29:55.955798 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb8887-bace-44f4-a403-f1ac87543df7 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:55.956086 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb8887-bace-44f4-a403-f1ac87543df7 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:55.956358 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb8887-bace-44f4-a403-f1ac87543df7 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:55.958219 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 807/1617] 10.222.0.62 () {54 vars in 961 bytes} [Fri May 27 16:29:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:29:55.958732 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb8887-bace-44f4-a403-f1ac87543df7 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:29:55.960376 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-84fb8887-bace-44f4-a403-f1ac87543df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:29:56.016196 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb8887-bace-44f4-a403-f1ac87543df7 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:29:56.019827 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5eea6a-4e9b-4c55-9fb8-2523e957ca85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:29:56.020456 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5eea6a-4e9b-4c55-9fb8-2523e957ca85 service neutron] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:56.020744 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5eea6a-4e9b-4c55-9fb8-2523e957ca85 service neutron] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:56.021015 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5eea6a-4e9b-4c55-9fb8-2523e957ca85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:56.029888 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5eea6a-4e9b-4c55-9fb8-2523e957ca85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:29:56.031343 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5eea6a-4e9b-4c55-9fb8-2523e957ca85 service neutron] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:29:56.047136 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 808/1618] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:29:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:29:56.047136 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5eea6a-4e9b-4c55-9fb8-2523e957ca85 service neutron] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:29:56.050365 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5eea6a-4e9b-4c55-9fb8-2523e957ca85 service neutron] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:29:56.058275 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d463af10-ad39-4281-93e2-9763347f1275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:29:56.058951 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d463af10-ad39-4281-93e2-9763347f1275 admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:56.059290 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d463af10-ad39-4281-93e2-9763347f1275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:56.059664 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d463af10-ad39-4281-93e2-9763347f1275 admin admin] PATH_INFO: `/v3/users` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:56.060357 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d463af10-ad39-4281-93e2-9763347f1275 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:29:56.062281 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d463af10-ad39-4281-93e2-9763347f1275 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:29:56.074290 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 811/1619] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:29:55 2022] POST /identity/v3/projects => generated 363 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:29:56.076568 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711ff779-6359-471f-8435-8746ccacdf7c admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:29:56.140286 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711ff779-6359-471f-8435-8746ccacdf7c admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:29:56.145094 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6e6d64-e64f-4ab7-ba46-2b61a8092ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:29:56.145763 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e6d64-e64f-4ab7-ba46-2b61a8092ba0 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:56.146047 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e6d64-e64f-4ab7-ba46-2b61a8092ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:56.146363 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e6d64-e64f-4ab7-ba46-2b61a8092ba0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:56.147048 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6e6d64-e64f-4ab7-ba46-2b61a8092ba0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:29:56.148945 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6e6d64-e64f-4ab7-ba46-2b61a8092ba0 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:29:56.272773 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 809/1620] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:29:56 2022] POST /identity/v3/users => generated 308 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:29:56.274310 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1496cd78-4219-4a2f-8c25-4fe1b936e2ad None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:56.274684 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1496cd78-4219-4a2f-8c25-4fe1b936e2ad None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:56.275033 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1496cd78-4219-4a2f-8c25-4fe1b936e2ad None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:56.276462 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 810/1621] 10.222.0.62 () {54 vars in 912 bytes} [Fri May 27 16:29:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:29:56.277595 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f002c6d9-5747-43b5-94f3-6a29c9105316 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:56.277971 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f002c6d9-5747-43b5-94f3-6a29c9105316 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:56.278313 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f002c6d9-5747-43b5-94f3-6a29c9105316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:56.297356 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-f002c6d9-5747-43b5-94f3-6a29c9105316 None None] MFA Rules not processed for user `cb13ad6d8b1e46029262556bff398796`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:29:56.298704 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-f002c6d9-5747-43b5-94f3-6a29c9105316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:29:56.314752 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 812/1622] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:29:56 2022] POST /identity/v3/projects => generated 357 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:29:56.315701 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6e6d64-e64f-4ab7-ba46-2b61a8092ba0 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:29:56.377247 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6e6d64-e64f-4ab7-ba46-2b61a8092ba0 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:29:56.380184 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 811/1623] 10.222.0.62 () {58 vars in 1058 bytes} [Fri May 27 16:29:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:29:56.381332 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f002c6d9-5747-43b5-94f3-6a29c9105316 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:29:56.383747 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62236635-6ef6-4ad5-8503-1ce288067fee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:29:56.384688 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62236635-6ef6-4ad5-8503-1ce288067fee service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:56.385144 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62236635-6ef6-4ad5-8503-1ce288067fee service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:56.385596 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62236635-6ef6-4ad5-8503-1ce288067fee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:56.391179 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f002c6d9-5747-43b5-94f3-6a29c9105316 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:29:56.459270 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18ed586-355b-438d-b806-08b64680ea12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:29:56.459993 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ed586-355b-438d-b806-08b64680ea12 admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:56.460868 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ed586-355b-438d-b806-08b64680ea12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:56.460868 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ed586-355b-438d-b806-08b64680ea12 admin admin] PATH_INFO: `/v3/users` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:56.461352 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18ed586-355b-438d-b806-08b64680ea12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:29:56.463164 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62236635-6ef6-4ad5-8503-1ce288067fee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:29:56.463369 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18ed586-355b-438d-b806-08b64680ea12 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:29:56.464733 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62236635-6ef6-4ad5-8503-1ce288067fee service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:29:56.476680 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 813/1624] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:29:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:29:56.484856 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62236635-6ef6-4ad5-8503-1ce288067fee service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:29:56.495035 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62236635-6ef6-4ad5-8503-1ce288067fee service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:29:56.499971 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1174fcf9-67e2-425c-bee1-d5df06a15f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:29:56.500650 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174fcf9-67e2-425c-bee1-d5df06a15f90 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:56.500936 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174fcf9-67e2-425c-bee1-d5df06a15f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:56.501219 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174fcf9-67e2-425c-bee1-d5df06a15f90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:56.501945 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1174fcf9-67e2-425c-bee1-d5df06a15f90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:29:56.503718 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1174fcf9-67e2-425c-bee1-d5df06a15f90 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:29:56.517122 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 814/1625] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:29:56 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:29:56.521207 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684913c8-96fd-4316-8165-3c055d4d2817 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:56.521207 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684913c8-96fd-4316-8165-3c055d4d2817 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:56.521207 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684913c8-96fd-4316-8165-3c055d4d2817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:56.548405 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-684913c8-96fd-4316-8165-3c055d4d2817 None None] MFA Rules not processed for user `cb13ad6d8b1e46029262556bff398796`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:29:56.550132 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-684913c8-96fd-4316-8165-3c055d4d2817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:29:56.594656 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:29:56.605228 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 812/1626] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:29:56 2022] POST /identity/v3/users => generated 288 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:29:56.607123 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18ed586-355b-438d-b806-08b64680ea12 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:29:56.624423 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18ed586-355b-438d-b806-08b64680ea12 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:29:56.630346 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb7c7e1-d21b-4162-a396-18eeb8600bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:29:56.631546 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7c7e1-d21b-4162-a396-18eeb8600bb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:56.632131 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7c7e1-d21b-4162-a396-18eeb8600bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:56.633593 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7c7e1-d21b-4162-a396-18eeb8600bb6 admin admin] PATH_INFO: `/v3/users` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:56.634725 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb7c7e1-d21b-4162-a396-18eeb8600bb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:29:56.636760 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 815/1627] 10.222.0.62 () {58 vars in 1009 bytes} [Fri May 27 16:29:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:29:56.637709 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684913c8-96fd-4316-8165-3c055d4d2817 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:29:56.638553 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb7c7e1-d21b-4162-a396-18eeb8600bb6 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:29:56.652106 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684913c8-96fd-4316-8165-3c055d4d2817 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:29:56.659046 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e7c8e-a14c-4882-8889-5e3e317897fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb13ad6d8b1e46029262556bff398796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:29:56.661280 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e7c8e-a14c-4882-8889-5e3e317897fc service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:56.661917 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e7c8e-a14c-4882-8889-5e3e317897fc service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:56.661917 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e7c8e-a14c-4882-8889-5e3e317897fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:56.741921 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 813/1628] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:29:56 2022] POST /identity/v3/users => generated 285 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:29:56.742890 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb7c7e1-d21b-4162-a396-18eeb8600bb6 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:29:56.760651 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb7c7e1-d21b-4162-a396-18eeb8600bb6 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:29:56.777636 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:29:56.777837 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12024599-0af0-435b-ae82-8b549ec489b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:29:56.777837 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12024599-0af0-435b-ae82-8b549ec489b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:56.777837 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12024599-0af0-435b-ae82-8b549ec489b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:56.777837 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12024599-0af0-435b-ae82-8b549ec489b5 admin admin] PATH_INFO: `/v3/projects/a40e1d7c6b1b4631bdad3701f9a70ecf/users/f635425276b144b886fab03474e67272/roles/e04fe3eb1f714d74901ac83e33ea8a16` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:56.780453 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54e7c8e-a14c-4882-8889-5e3e317897fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:29:56.782386 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54e7c8e-a14c-4882-8889-5e3e317897fc service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:29:56.794411 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 816/1629] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:29:56 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:29:56.794896 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e7c8e-a14c-4882-8889-5e3e317897fc service nova] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:29:56.801423 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12024599-0af0-435b-ae82-8b549ec489b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a40e1d7c6b1b4631bdad3701f9a70ecf, user_id=f635425276b144b886fab03474e67272, role_id=e04fe3eb1f714d74901ac83e33ea8a16)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:29:56.805565 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12024599-0af0-435b-ae82-8b549ec489b5 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:29:56.810376 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e7c8e-a14c-4882-8889-5e3e317897fc service nova] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:29:56.816004 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059cb772-f94e-45f8-984e-361625928e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:29:56.817562 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059cb772-f94e-45f8-984e-361625928e40 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:56.818308 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059cb772-f94e-45f8-984e-361625928e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:56.818308 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059cb772-f94e-45f8-984e-361625928e40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:56.818970 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059cb772-f94e-45f8-984e-361625928e40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:29:56.820681 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059cb772-f94e-45f8-984e-361625928e40 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:29:56.836904 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 817/1630] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:29:56 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:29:56.838429 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059cb772-f94e-45f8-984e-361625928e40 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:29:56.924782 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 814/1631] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:29:56 2022] PUT /identity/v3/projects/a40e1d7c6b1b4631bdad3701f9a70ecf/users/f635425276b144b886fab03474e67272/roles/e04fe3eb1f714d74901ac83e33ea8a16 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:29:56.926881 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12024599-0af0-435b-ae82-8b549ec489b5 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:29:56.932066 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059cb772-f94e-45f8-984e-361625928e40 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:29:56.987644 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:29:57.036859 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13651120-ef0f-4e15-b017-fbf57f19ff2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8693a1e72f14fdfb383f11e96330726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:29:57.038743 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13651120-ef0f-4e15-b017-fbf57f19ff2d service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:57.039030 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13651120-ef0f-4e15-b017-fbf57f19ff2d service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:57.039310 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13651120-ef0f-4e15-b017-fbf57f19ff2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:57.063791 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12024599-0af0-435b-ae82-8b549ec489b5 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:29:57.081053 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2791a821-08a9-4e34-8763-d90af71c2044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:29:57.081743 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791a821-08a9-4e34-8763-d90af71c2044 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:57.082057 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791a821-08a9-4e34-8763-d90af71c2044 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:57.082362 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791a821-08a9-4e34-8763-d90af71c2044 admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:57.083107 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2791a821-08a9-4e34-8763-d90af71c2044 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:29:57.084726 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2791a821-08a9-4e34-8763-d90af71c2044 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:29:57.114723 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 815/1632] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:29:56 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:29:57.115901 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2791a821-08a9-4e34-8763-d90af71c2044 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:29:57.140209 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2791a821-08a9-4e34-8763-d90af71c2044 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:29:57.146872 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83dcbc4-a34c-4489-b1b5-c0209a82da0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:29:57.147796 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83dcbc4-a34c-4489-b1b5-c0209a82da0e admin admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:57.148545 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83dcbc4-a34c-4489-b1b5-c0209a82da0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:57.149034 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83dcbc4-a34c-4489-b1b5-c0209a82da0e admin admin] PATH_INFO: `/v3/projects/783a43312a194100a2bd36ff703d2867/users/f3dc7eec10374695a35ee0072b876af1/roles/e04fe3eb1f714d74901ac83e33ea8a16` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:57.177236 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13651120-ef0f-4e15-b017-fbf57f19ff2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:29:57.178786 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13651120-ef0f-4e15-b017-fbf57f19ff2d service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:29:57.185563 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83dcbc4-a34c-4489-b1b5-c0209a82da0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=783a43312a194100a2bd36ff703d2867, user_id=f3dc7eec10374695a35ee0072b876af1, role_id=e04fe3eb1f714d74901ac83e33ea8a16)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:29:57.188271 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83dcbc4-a34c-4489-b1b5-c0209a82da0e admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:29:57.192179 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 818/1633] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:29:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:29:57.193166 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13651120-ef0f-4e15-b017-fbf57f19ff2d service cinder] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:29:57.205623 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13651120-ef0f-4e15-b017-fbf57f19ff2d service cinder] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:29:57.216156 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d1c069-883d-4dbe-abe9-f14c05a60aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:29:57.216905 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d1c069-883d-4dbe-abe9-f14c05a60aeb admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:57.217196 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d1c069-883d-4dbe-abe9-f14c05a60aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:57.217520 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d1c069-883d-4dbe-abe9-f14c05a60aeb admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:57.218336 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d1c069-883d-4dbe-abe9-f14c05a60aeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:29:57.220131 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d1c069-883d-4dbe-abe9-f14c05a60aeb admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:29:57.253138 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 819/1634] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:29:57 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:29:57.258742 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d1c069-883d-4dbe-abe9-f14c05a60aeb admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:29:57.286004 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d1c069-883d-4dbe-abe9-f14c05a60aeb admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:29:57.295725 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 816/1635] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:29:57 2022] PUT /identity/v3/projects/783a43312a194100a2bd36ff703d2867/users/f3dc7eec10374695a35ee0072b876af1/roles/e04fe3eb1f714d74901ac83e33ea8a16 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:29:57.298603 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4236484b-1596-42f8-8c22-3a8a42659c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:29:57.298754 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df9c551-0756-4bb5-9305-ca21343292f3 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:57.298754 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df9c551-0756-4bb5-9305-ca21343292f3 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:57.298754 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df9c551-0756-4bb5-9305-ca21343292f3 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:57.300598 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 817/1636] 10.222.0.62 () {54 vars in 912 bytes} [Fri May 27 16:29:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:29:57.302019 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df9c551-0756-4bb5-9305-ca21343292f3 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:29:57.305723 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4236484b-1596-42f8-8c22-3a8a42659c85 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:57.306227 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4236484b-1596-42f8-8c22-3a8a42659c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:57.316851 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4236484b-1596-42f8-8c22-3a8a42659c85 admin admin] PATH_INFO: `/v3/projects/4b5cb0becc644fe89534957510d795ae/users/faaebf52c7b74c098bf9d110906a0b7b/roles/e04fe3eb1f714d74901ac83e33ea8a16` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:57.349967 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4236484b-1596-42f8-8c22-3a8a42659c85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b5cb0becc644fe89534957510d795ae, user_id=faaebf52c7b74c098bf9d110906a0b7b, role_id=e04fe3eb1f714d74901ac83e33ea8a16)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:29:57.354035 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4236484b-1596-42f8-8c22-3a8a42659c85 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:29:57.426455 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df9c551-0756-4bb5-9305-ca21343292f3 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:29:57.430835 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:29:57.439036 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eebc558-de08-458c-af6c-e6209fb2cb29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:29:57.440880 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eebc558-de08-458c-af6c-e6209fb2cb29 admin admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:57.441671 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eebc558-de08-458c-af6c-e6209fb2cb29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:57.442156 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eebc558-de08-458c-af6c-e6209fb2cb29 admin admin] PATH_INFO: `/v3/projects/a40e1d7c6b1b4631bdad3701f9a70ecf/users/f635425276b144b886fab03474e67272/roles/e04fe3eb1f714d74901ac83e33ea8a16` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:57.444705 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eebc558-de08-458c-af6c-e6209fb2cb29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a40e1d7c6b1b4631bdad3701f9a70ecf, user_id=f635425276b144b886fab03474e67272, role_id=e04fe3eb1f714d74901ac83e33ea8a16)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:29:57.447942 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eebc558-de08-458c-af6c-e6209fb2cb29 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:29:57.475845 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 818/1637] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:29:57 2022] PUT /identity/v3/projects/a40e1d7c6b1b4631bdad3701f9a70ecf/users/f635425276b144b886fab03474e67272/roles/e04fe3eb1f714d74901ac83e33ea8a16 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:29:57.475845 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eebc558-de08-458c-af6c-e6209fb2cb29 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:29:57.507089 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 820/1638] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:29:57 2022] PUT /identity/v3/projects/4b5cb0becc644fe89534957510d795ae/users/faaebf52c7b74c098bf9d110906a0b7b/roles/e04fe3eb1f714d74901ac83e33ea8a16 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:29:57.509212 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef3cdb-908d-43b7-b40e-f6f3e56586e2 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:57.510844 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef3cdb-908d-43b7-b40e-f6f3e56586e2 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:57.511917 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef3cdb-908d-43b7-b40e-f6f3e56586e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:57.548201 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-7cef3cdb-908d-43b7-b40e-f6f3e56586e2 None None] MFA Rules not processed for user `cb13ad6d8b1e46029262556bff398796`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:29:57.549887 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-7cef3cdb-908d-43b7-b40e-f6f3e56586e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:29:57.599816 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eebc558-de08-458c-af6c-e6209fb2cb29 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:29:57.645628 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 821/1639] 10.222.0.62 () {58 vars in 1009 bytes} [Fri May 27 16:29:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:29:57.647113 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec4fd7-c285-4a69-8f0e-9ce5ad42c765 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:57.647510 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec4fd7-c285-4a69-8f0e-9ce5ad42c765 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:57.647894 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec4fd7-c285-4a69-8f0e-9ce5ad42c765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:57.699932 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:29:57.701064 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-cbec4fd7-c285-4a69-8f0e-9ce5ad42c765 None None] MFA Rules not processed for user `f635425276b144b886fab03474e67272`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:29:57.702574 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-cbec4fd7-c285-4a69-8f0e-9ce5ad42c765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:29:57.734555 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247275ce-126f-4826-b003-8da13946e0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:29:57.735244 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247275ce-126f-4826-b003-8da13946e0e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:57.735527 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247275ce-126f-4826-b003-8da13946e0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:57.735807 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247275ce-126f-4826-b003-8da13946e0e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:57.736554 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247275ce-126f-4826-b003-8da13946e0e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:29:57.738717 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247275ce-126f-4826-b003-8da13946e0e9 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:29:57.751860 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 819/1640] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:29:57 2022] GET /identity/v3/roles => generated 1420 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:29:57.752281 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247275ce-126f-4826-b003-8da13946e0e9 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:29:57.764146 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247275ce-126f-4826-b003-8da13946e0e9 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:29:57.770517 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e18413e-f421-402b-ac7e-24c8245122cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:29:57.771075 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e18413e-f421-402b-ac7e-24c8245122cd admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:57.771421 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e18413e-f421-402b-ac7e-24c8245122cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:57.771730 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e18413e-f421-402b-ac7e-24c8245122cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:57.773090 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e18413e-f421-402b-ac7e-24c8245122cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:29:57.774938 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e18413e-f421-402b-ac7e-24c8245122cd admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:29:57.787143 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 820/1641] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:29:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:29:57.790833 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e18413e-f421-402b-ac7e-24c8245122cd admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:29:57.866906 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 822/1642] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:29:57 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:29:57.868751 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbec4fd7-c285-4a69-8f0e-9ce5ad42c765 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:29:57.893893 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbec4fd7-c285-4a69-8f0e-9ce5ad42c765 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:29:57.904929 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c317bbb-190d-404b-9d29-6cae49ec52c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:29:57.907100 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c317bbb-190d-404b-9d29-6cae49ec52c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:57.907841 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c317bbb-190d-404b-9d29-6cae49ec52c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:57.908320 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c317bbb-190d-404b-9d29-6cae49ec52c1 admin admin] PATH_INFO: `/v3/projects/783a43312a194100a2bd36ff703d2867/users/f3dc7eec10374695a35ee0072b876af1/roles/e04fe3eb1f714d74901ac83e33ea8a16` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:57.912482 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c317bbb-190d-404b-9d29-6cae49ec52c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=783a43312a194100a2bd36ff703d2867, user_id=f3dc7eec10374695a35ee0072b876af1, role_id=e04fe3eb1f714d74901ac83e33ea8a16)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:29:57.916126 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e18413e-f421-402b-ac7e-24c8245122cd admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:29:57.916575 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c317bbb-190d-404b-9d29-6cae49ec52c1 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:29:57.920869 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f7e8a6-0c21-4df8-9edd-fd0d53447dcd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8693a1e72f14fdfb383f11e96330726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:29:57.921535 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7e8a6-0c21-4df8-9edd-fd0d53447dcd service cinder] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:57.921818 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7e8a6-0c21-4df8-9edd-fd0d53447dcd service cinder] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:57.922091 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7e8a6-0c21-4df8-9edd-fd0d53447dcd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:57.938844 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f7e8a6-0c21-4df8-9edd-fd0d53447dcd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:29:57.940423 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f7e8a6-0c21-4df8-9edd-fd0d53447dcd service cinder] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:29:57.943707 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 823/1643] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:29:57 2022] PUT /identity/v3/projects/783a43312a194100a2bd36ff703d2867/users/f3dc7eec10374695a35ee0072b876af1/roles/e04fe3eb1f714d74901ac83e33ea8a16 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:29:57.945011 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c317bbb-190d-404b-9d29-6cae49ec52c1 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:29:57.993655 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 821/1644] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:29:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:29:57.995111 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcfc840-ea77-421f-ae15-4bad6cb85ac9 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:57.995507 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcfc840-ea77-421f-ae15-4bad6cb85ac9 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:57.995667 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcfc840-ea77-421f-ae15-4bad6cb85ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:58.122305 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c317bbb-190d-404b-9d29-6cae49ec52c1 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:29:58.130418 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:29:58.134576 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-1bcfc840-ea77-421f-ae15-4bad6cb85ac9 None None] MFA Rules not processed for user `f3dc7eec10374695a35ee0072b876af1`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:29:58.136509 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-1bcfc840-ea77-421f-ae15-4bad6cb85ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:29:58.137602 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db445d-c576-4974-a83b-24cafb32451a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:29:58.138678 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db445d-c576-4974-a83b-24cafb32451a admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:58.138966 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db445d-c576-4974-a83b-24cafb32451a admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:58.139245 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db445d-c576-4974-a83b-24cafb32451a admin admin] PATH_INFO: `/v3/projects/4b5cb0becc644fe89534957510d795ae/users/faaebf52c7b74c098bf9d110906a0b7b/roles/e04fe3eb1f714d74901ac83e33ea8a16` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:58.141462 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61db445d-c576-4974-a83b-24cafb32451a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b5cb0becc644fe89534957510d795ae, user_id=faaebf52c7b74c098bf9d110906a0b7b, role_id=e04fe3eb1f714d74901ac83e33ea8a16)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:29:58.145257 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61db445d-c576-4974-a83b-24cafb32451a admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:29:58.159171 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 824/1645] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:29:57 2022] PUT /identity/v3/projects/4b5cb0becc644fe89534957510d795ae/users/faaebf52c7b74c098bf9d110906a0b7b/roles/e04fe3eb1f714d74901ac83e33ea8a16 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:29:58.176681 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c47ce-3249-47dd-aba8-c96228fa5110 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:58.176976 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c47ce-3249-47dd-aba8-c96228fa5110 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:58.181686 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c47ce-3249-47dd-aba8-c96228fa5110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:58.220482 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-fc9c47ce-3249-47dd-aba8-c96228fa5110 None None] MFA Rules not processed for user `faaebf52c7b74c098bf9d110906a0b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:29:58.226611 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-fc9c47ce-3249-47dd-aba8-c96228fa5110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:29:58.253542 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 822/1646] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:29:57 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:29:58.299565 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 825/1647] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:29:58 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:29:58.645916 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcfc840-ea77-421f-ae15-4bad6cb85ac9 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:29:58.709728 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcfc840-ea77-421f-ae15-4bad6cb85ac9 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:29:59.246382 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3899677-997d-4bc9-8408-671d862e107f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8693a1e72f14fdfb383f11e96330726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:29:59.246382 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3899677-997d-4bc9-8408-671d862e107f service cinder] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:59.246382 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3899677-997d-4bc9-8408-671d862e107f service cinder] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:59.246382 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3899677-997d-4bc9-8408-671d862e107f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:59.248893 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3899677-997d-4bc9-8408-671d862e107f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:29:59.248893 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3899677-997d-4bc9-8408-671d862e107f service cinder] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:29:59.248893 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 823/1648] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:29:58 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:29:59.251003 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9c47ce-3249-47dd-aba8-c96228fa5110 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:29:59.251003 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9c47ce-3249-47dd-aba8-c96228fa5110 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:29:59.251003 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9cd2fd-0974-42dc-b221-e79dc561b9d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8693a1e72f14fdfb383f11e96330726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:29:59.251003 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9cd2fd-0974-42dc-b221-e79dc561b9d4 service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:59.253167 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9cd2fd-0974-42dc-b221-e79dc561b9d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:59.253167 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9cd2fd-0974-42dc-b221-e79dc561b9d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:59.253167 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9cd2fd-0974-42dc-b221-e79dc561b9d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:29:59.253167 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9cd2fd-0974-42dc-b221-e79dc561b9d4 service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:29:59.253167 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 826/1649] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:29:59 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:29:59.274064 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8814ac3-846f-4a80-a94f-cea0a610b5b5 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:59.274471 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8814ac3-846f-4a80-a94f-cea0a610b5b5 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:59.274761 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8814ac3-846f-4a80-a94f-cea0a610b5b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:59.301782 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-b8814ac3-846f-4a80-a94f-cea0a610b5b5 None None] MFA Rules not processed for user `6066cf53517044f69afcd4c2e8b13b55`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:29:59.303048 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-b8814ac3-846f-4a80-a94f-cea0a610b5b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:29:59.402029 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 824/1650] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:29:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:29:59.417961 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7989123-55da-478e-962f-480389e4597b None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:59.418345 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7989123-55da-478e-962f-480389e4597b None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:59.418626 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7989123-55da-478e-962f-480389e4597b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:59.425572 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8814ac3-846f-4a80-a94f-cea0a610b5b5 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:29:59.438661 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-d7989123-55da-478e-962f-480389e4597b None None] MFA Rules not processed for user `6066cf53517044f69afcd4c2e8b13b55`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:29:59.440347 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-d7989123-55da-478e-962f-480389e4597b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:29:59.443098 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8814ac3-846f-4a80-a94f-cea0a610b5b5 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:29:59.448105 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 827/1651] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:29:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:29:59.449573 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625dc5c9-e136-4e33-8dae-340b61933ead service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8693a1e72f14fdfb383f11e96330726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:29:59.450428 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625dc5c9-e136-4e33-8dae-340b61933ead service cinder] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:59.450720 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625dc5c9-e136-4e33-8dae-340b61933ead service cinder] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:59.451050 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625dc5c9-e136-4e33-8dae-340b61933ead service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:59.463410 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625dc5c9-e136-4e33-8dae-340b61933ead service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:29:59.465067 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625dc5c9-e136-4e33-8dae-340b61933ead service cinder] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:29:59.478075 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 825/1652] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:29:59 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:29:59.689821 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:29:59.703225 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7989123-55da-478e-962f-480389e4597b None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:29:59.883557 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7989123-55da-478e-962f-480389e4597b None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:29:59.889493 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa2756a-a44c-4463-bd1e-154666dd2de3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb13ad6d8b1e46029262556bff398796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:29:59.890552 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa2756a-a44c-4463-bd1e-154666dd2de3 service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:29:59.890552 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa2756a-a44c-4463-bd1e-154666dd2de3 service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:29:59.890933 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa2756a-a44c-4463-bd1e-154666dd2de3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:29:59.902527 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa2756a-a44c-4463-bd1e-154666dd2de3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:29:59.904245 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa2756a-a44c-4463-bd1e-154666dd2de3 service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:29:59.922565 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 828/1653] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:29:59 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:30:00.072332 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625dc5c9-e136-4e33-8dae-340b61933ead service cinder] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:00.084924 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625dc5c9-e136-4e33-8dae-340b61933ead service cinder] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:00.097434 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7bd4a5-3029-498e-a852-ef96fec8ef39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8693a1e72f14fdfb383f11e96330726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:00.098168 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7bd4a5-3029-498e-a852-ef96fec8ef39 service cinder] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:00.098488 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7bd4a5-3029-498e-a852-ef96fec8ef39 service cinder] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:00.101275 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7bd4a5-3029-498e-a852-ef96fec8ef39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:00.141547 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:30:00.167346 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa2756a-a44c-4463-bd1e-154666dd2de3 service nova] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:00.178921 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa2756a-a44c-4463-bd1e-154666dd2de3 service nova] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:00.195378 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7caff2d-1b0a-4332-8ecb-14abc78b2598 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8693a1e72f14fdfb383f11e96330726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:00.197950 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7caff2d-1b0a-4332-8ecb-14abc78b2598 service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:00.199366 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7caff2d-1b0a-4332-8ecb-14abc78b2598 service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:00.200936 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7caff2d-1b0a-4332-8ecb-14abc78b2598 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:00.240617 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7bd4a5-3029-498e-a852-ef96fec8ef39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:00.242266 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7bd4a5-3029-498e-a852-ef96fec8ef39 service cinder] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:00.262031 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 826/1654] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:30:00 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:30:00.357263 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7caff2d-1b0a-4332-8ecb-14abc78b2598 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:00.359953 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7caff2d-1b0a-4332-8ecb-14abc78b2598 service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:00.378026 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 829/1655] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:30:00 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:30:00.427214 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:30:00.885967 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a470f3b5-a96c-4dfc-bcfe-4287c65f7aee None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:00.886560 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a470f3b5-a96c-4dfc-bcfe-4287c65f7aee None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:00.886635 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a470f3b5-a96c-4dfc-bcfe-4287c65f7aee None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:00.889176 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 827/1656] 10.222.0.62 () {54 vars in 912 bytes} [Fri May 27 16:30:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:30:00.898743 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa6a44-8cdd-4417-84d1-14f680a3d1eb None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:00.899268 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa6a44-8cdd-4417-84d1-14f680a3d1eb None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:00.899659 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa6a44-8cdd-4417-84d1-14f680a3d1eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:00.916502 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a470f3b5-a96c-4dfc-bcfe-4287c65f7aee None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:00.960950 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-2aaa6a44-8cdd-4417-84d1-14f680a3d1eb None None] MFA Rules not processed for user `b367ccea28d540a0b24ec4e42ebfef65`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:00.962524 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-2aaa6a44-8cdd-4417-84d1-14f680a3d1eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:01.089250 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a470f3b5-a96c-4dfc-bcfe-4287c65f7aee None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:01.103328 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f5be4-131b-42d9-a264-de795b755d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:01.103328 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f5be4-131b-42d9-a264-de795b755d7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:01.103328 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f5be4-131b-42d9-a264-de795b755d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:01.103328 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f5be4-131b-42d9-a264-de795b755d7e admin admin] PATH_INFO: `/v3/users/cc70e444bc9346dbb89c0e0ea0f08212` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:01.104245 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95f5be4-131b-42d9-a264-de795b755d7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc70e444bc9346dbb89c0e0ea0f08212)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:01.106798 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 830/1657] 10.222.0.62 () {58 vars in 1009 bytes} [Fri May 27 16:30:00 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:30:01.108398 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95f5be4-131b-42d9-a264-de795b755d7e admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:01.203271 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaa6a44-8cdd-4417-84d1-14f680a3d1eb None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:01.217462 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaa6a44-8cdd-4417-84d1-14f680a3d1eb None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:01.225713 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf91980-d433-4fda-9a74-28ec85f0c53c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:01.226829 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf91980-d433-4fda-9a74-28ec85f0c53c service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:01.227437 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf91980-d433-4fda-9a74-28ec85f0c53c service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:01.227971 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf91980-d433-4fda-9a74-28ec85f0c53c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:01.243076 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf91980-d433-4fda-9a74-28ec85f0c53c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:01.246143 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf91980-d433-4fda-9a74-28ec85f0c53c service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:01.260261 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 831/1658] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:30:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:30:01.390642 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-c95f5be4-131b-42d9-a264-de795b755d7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc70e444bc9346dbb89c0e0ea0f08212'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:01.436187 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-c95f5be4-131b-42d9-a264-de795b755d7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc70e444bc9346dbb89c0e0ea0f08212'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:01.437199 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-c95f5be4-131b-42d9-a264-de795b755d7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc70e444bc9346dbb89c0e0ea0f08212'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:01.439051 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-c95f5be4-131b-42d9-a264-de795b755d7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc70e444bc9346dbb89c0e0ea0f08212'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:01.519207 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-c95f5be4-131b-42d9-a264-de795b755d7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc70e444bc9346dbb89c0e0ea0f08212'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:01.550164 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 828/1659] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:30:00 2022] DELETE /identity/v3/users/cc70e444bc9346dbb89c0e0ea0f08212 => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:30:01.552994 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dccd125-3cee-461b-87eb-6e5c2dc56e1b None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:01.553455 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dccd125-3cee-461b-87eb-6e5c2dc56e1b None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:01.553856 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dccd125-3cee-461b-87eb-6e5c2dc56e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:01.578793 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-4dccd125-3cee-461b-87eb-6e5c2dc56e1b None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:01.582211 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-4dccd125-3cee-461b-87eb-6e5c2dc56e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:01.733901 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:30:01.778232 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 832/1660] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:30:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:30:01.822986 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f5be4-131b-42d9-a264-de795b755d7e admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:01.825063 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-c95f5be4-131b-42d9-a264-de795b755d7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:02.086229 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f5be4-131b-42d9-a264-de795b755d7e admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:02.100549 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d62fa7d-f0b9-4666-9134-f38f687289ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:02.101239 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d62fa7d-f0b9-4666-9134-f38f687289ae service neutron] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:02.101532 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d62fa7d-f0b9-4666-9134-f38f687289ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:02.101815 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d62fa7d-f0b9-4666-9134-f38f687289ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:02.119865 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:30:02.124352 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d62fa7d-f0b9-4666-9134-f38f687289ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:02.125923 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d62fa7d-f0b9-4666-9134-f38f687289ae service neutron] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:02.158590 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 829/1661] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:30:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:30:02.388819 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e6d3ec-61f7-433f-9f30-9e8dd4b663ee None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:02.389494 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e6d3ec-61f7-433f-9f30-9e8dd4b663ee None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:02.389985 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e6d3ec-61f7-433f-9f30-9e8dd4b663ee None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:02.392262 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 833/1662] 10.222.0.62 () {54 vars in 960 bytes} [Fri May 27 16:30:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:30:02.399525 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d1834-f064-48e2-8bc1-7086b52d5180 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:02.400322 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d1834-f064-48e2-8bc1-7086b52d5180 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:02.400441 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d1834-f064-48e2-8bc1-7086b52d5180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:02.439348 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-136d1834-f064-48e2-8bc1-7086b52d5180 None None] MFA Rules not processed for user `35d98c4a2af546d8b655d649d655f447`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:02.440602 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-136d1834-f064-48e2-8bc1-7086b52d5180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:02.537470 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e6d3ec-61f7-433f-9f30-9e8dd4b663ee None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:02.539873 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-34e6d3ec-61f7-433f-9f30-9e8dd4b663ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:02.574081 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e6d3ec-61f7-433f-9f30-9e8dd4b663ee None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:02.586739 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a463cf0-925d-4892-8a9e-b47992643483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:02.589512 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a463cf0-925d-4892-8a9e-b47992643483 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:02.590017 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a463cf0-925d-4892-8a9e-b47992643483 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:02.591390 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a463cf0-925d-4892-8a9e-b47992643483 admin admin] PATH_INFO: `/v3/users/199f6997391641abbc7c51a24a33ae59` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:02.596890 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a463cf0-925d-4892-8a9e-b47992643483 admin admin] RBAC: Authorizing `identity:delete_user(user_id=199f6997391641abbc7c51a24a33ae59)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:02.598328 dv-cinder-840493-2-smb devstack@keystone.service[80289]: WARNING py.warnings [None req-1a463cf0-925d-4892-8a9e-b47992643483 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 16:30:02.598328 dv-cinder-840493-2-smb devstack@keystone.service[80289]: warnings.warn(msg) May 27 16:30:02.598328 dv-cinder-840493-2-smb devstack@keystone.service[80289]: May 27 16:30:02.601688 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a463cf0-925d-4892-8a9e-b47992643483 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:02.686653 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 830/1663] 10.222.0.62 () {58 vars in 1057 bytes} [Fri May 27 16:30:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:30:02.718161 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d1834-f064-48e2-8bc1-7086b52d5180 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:02.735939 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d1834-f064-48e2-8bc1-7086b52d5180 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:02.753821 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c32be-4620-453c-89bd-cd0274a99ee2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35d98c4a2af546d8b655d649d655f447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:02.755092 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c32be-4620-453c-89bd-cd0274a99ee2 service placement] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:02.755377 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c32be-4620-453c-89bd-cd0274a99ee2 service placement] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:02.755654 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c32be-4620-453c-89bd-cd0274a99ee2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:02.767157 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-9f6c32be-4620-453c-89bd-cd0274a99ee2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:02.842933 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6c32be-4620-453c-89bd-cd0274a99ee2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:02.846475 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6c32be-4620-453c-89bd-cd0274a99ee2 service placement] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:02.895120 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 831/1664] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:30:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:30:02.982778 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-1a463cf0-925d-4892-8a9e-b47992643483 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '199f6997391641abbc7c51a24a33ae59'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:03.015606 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-1a463cf0-925d-4892-8a9e-b47992643483 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '199f6997391641abbc7c51a24a33ae59'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:03.020542 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-1a463cf0-925d-4892-8a9e-b47992643483 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '199f6997391641abbc7c51a24a33ae59'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:03.022650 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-1a463cf0-925d-4892-8a9e-b47992643483 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '199f6997391641abbc7c51a24a33ae59'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:03.157091 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-1a463cf0-925d-4892-8a9e-b47992643483 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '199f6997391641abbc7c51a24a33ae59'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:03.237202 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 834/1665] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:30:02 2022] DELETE /identity/v3/users/199f6997391641abbc7c51a24a33ae59 => generated 0 bytes in 700 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:30:03.242086 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f8423-763b-4e5a-a8da-154f9a57a3c5 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:03.242706 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f8423-763b-4e5a-a8da-154f9a57a3c5 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:03.242706 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f8423-763b-4e5a-a8da-154f9a57a3c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:03.316264 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-a40f8423-763b-4e5a-a8da-154f9a57a3c5 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:03.317993 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-a40f8423-763b-4e5a-a8da-154f9a57a3c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:03.509897 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 832/1666] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:30:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:30:03.533742 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a463cf0-925d-4892-8a9e-b47992643483 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:03.536298 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-1a463cf0-925d-4892-8a9e-b47992643483 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:03.652699 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:30:03.711798 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a463cf0-925d-4892-8a9e-b47992643483 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:03.720239 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1aa9e4-8171-4668-9a53-485be4ab8abe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:03.721123 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1aa9e4-8171-4668-9a53-485be4ab8abe service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:03.721550 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1aa9e4-8171-4668-9a53-485be4ab8abe service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:03.722182 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1aa9e4-8171-4668-9a53-485be4ab8abe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:03.739191 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1aa9e4-8171-4668-9a53-485be4ab8abe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:03.742416 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1aa9e4-8171-4668-9a53-485be4ab8abe service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:03.754127 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 835/1667] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:30:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:30:04.255103 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40f8423-763b-4e5a-a8da-154f9a57a3c5 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:04.257234 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-a40f8423-763b-4e5a-a8da-154f9a57a3c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:04.282050 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40f8423-763b-4e5a-a8da-154f9a57a3c5 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:04.295337 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847cf405-5b4b-4036-8752-3b94ccca8e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:04.296234 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847cf405-5b4b-4036-8752-3b94ccca8e12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:04.296679 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847cf405-5b4b-4036-8752-3b94ccca8e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:04.297096 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847cf405-5b4b-4036-8752-3b94ccca8e12 admin admin] PATH_INFO: `/v3/projects/940cf4d429c549f28b77263bf08b7ab7` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:04.299934 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847cf405-5b4b-4036-8752-3b94ccca8e12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=940cf4d429c549f28b77263bf08b7ab7)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:04.301222 dv-cinder-840493-2-smb devstack@keystone.service[80288]: WARNING py.warnings [None req-847cf405-5b4b-4036-8752-3b94ccca8e12 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 16:30:04.301222 dv-cinder-840493-2-smb devstack@keystone.service[80288]: warnings.warn(msg) May 27 16:30:04.301222 dv-cinder-840493-2-smb devstack@keystone.service[80288]: May 27 16:30:04.303548 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847cf405-5b4b-4036-8752-3b94ccca8e12 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:04.405419 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0613ea55-2b42-4194-9a58-63fac22bcb01 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:04.405714 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0613ea55-2b42-4194-9a58-63fac22bcb01 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:04.405989 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0613ea55-2b42-4194-9a58-63fac22bcb01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:04.448485 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-0613ea55-2b42-4194-9a58-63fac22bcb01 None None] MFA Rules not processed for user `d2aced0927994e97bac1ce1a63f4a911`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:04.449716 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-0613ea55-2b42-4194-9a58-63fac22bcb01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:04.487964 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-847cf405-5b4b-4036-8752-3b94ccca8e12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '940cf4d429c549f28b77263bf08b7ab7', 'request_id': 'req-847cf405-5b4b-4036-8752-3b94ccca8e12'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:04.511529 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-847cf405-5b4b-4036-8752-3b94ccca8e12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '940cf4d429c549f28b77263bf08b7ab7', 'request_id': 'req-847cf405-5b4b-4036-8752-3b94ccca8e12'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:04.523701 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-847cf405-5b4b-4036-8752-3b94ccca8e12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '940cf4d429c549f28b77263bf08b7ab7', 'request_id': 'req-847cf405-5b4b-4036-8752-3b94ccca8e12'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:04.561901 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 836/1668] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:30:04 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:30:04.575338 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b20a0-8b14-4e41-875a-9de32b46e26a None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:04.575338 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b20a0-8b14-4e41-875a-9de32b46e26a None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:04.575338 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b20a0-8b14-4e41-875a-9de32b46e26a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:04.604344 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-847cf405-5b4b-4036-8752-3b94ccca8e12 admin admin] The token cache is being invalidate because project 940cf4d429c549f28b77263bf08b7ab7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80288) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:30:04.604792 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-847cf405-5b4b-4036-8752-3b94ccca8e12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:04.609202 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-847cf405-5b4b-4036-8752-3b94ccca8e12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:04.615165 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 833/1669] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:30:04 2022] DELETE /identity/v3/projects/940cf4d429c549f28b77263bf08b7ab7 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:30:04.618114 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-ea3b20a0-8b14-4e41-875a-9de32b46e26a None None] MFA Rules not processed for user `d2aced0927994e97bac1ce1a63f4a911`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:04.618114 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-ea3b20a0-8b14-4e41-875a-9de32b46e26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:04.622799 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847cf405-5b4b-4036-8752-3b94ccca8e12 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:04.622799 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-847cf405-5b4b-4036-8752-3b94ccca8e12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:04.804181 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847cf405-5b4b-4036-8752-3b94ccca8e12 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:04.804682 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 837/1670] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:30:04 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:30:04.818418 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3b20a0-8b14-4e41-875a-9de32b46e26a None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:04.820714 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf22f147-4a6c-4e8f-b9a2-703a03878998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:04.821261 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-ea3b20a0-8b14-4e41-875a-9de32b46e26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:04.821994 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf22f147-4a6c-4e8f-b9a2-703a03878998 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:04.822428 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf22f147-4a6c-4e8f-b9a2-703a03878998 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:04.822831 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf22f147-4a6c-4e8f-b9a2-703a03878998 admin admin] PATH_INFO: `/v3/users/f635425276b144b886fab03474e67272` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:04.826031 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf22f147-4a6c-4e8f-b9a2-703a03878998 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f635425276b144b886fab03474e67272)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:04.828193 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf22f147-4a6c-4e8f-b9a2-703a03878998 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:05.004025 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3b20a0-8b14-4e41-875a-9de32b46e26a None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:05.021493 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61b518a-2c39-4530-8b91-36a9207a21cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb13ad6d8b1e46029262556bff398796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:05.022163 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b518a-2c39-4530-8b91-36a9207a21cb service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:05.022519 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b518a-2c39-4530-8b91-36a9207a21cb service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:05.022801 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b518a-2c39-4530-8b91-36a9207a21cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:05.029101 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-b61b518a-2c39-4530-8b91-36a9207a21cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:05.055334 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61b518a-2c39-4530-8b91-36a9207a21cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:05.057237 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61b518a-2c39-4530-8b91-36a9207a21cb service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:05.060148 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:30:05.080099 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-cf22f147-4a6c-4e8f-b9a2-703a03878998 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f635425276b144b886fab03474e67272'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:05.104031 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 838/1671] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:30:04 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 16:30:05.104598 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-cf22f147-4a6c-4e8f-b9a2-703a03878998 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f635425276b144b886fab03474e67272'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:05.105404 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-cf22f147-4a6c-4e8f-b9a2-703a03878998 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f635425276b144b886fab03474e67272'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:05.107901 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-cf22f147-4a6c-4e8f-b9a2-703a03878998 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f635425276b144b886fab03474e67272'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:05.115328 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61b518a-2c39-4530-8b91-36a9207a21cb service nova] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:05.122926 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-b61b518a-2c39-4530-8b91-36a9207a21cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:05.168608 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61b518a-2c39-4530-8b91-36a9207a21cb service nova] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:05.189576 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bef02be-c1e2-4456-b434-e282f50a3343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:05.190491 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef02be-c1e2-4456-b434-e282f50a3343 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:05.192395 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-cf22f147-4a6c-4e8f-b9a2-703a03878998 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f635425276b144b886fab03474e67272'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:05.193895 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef02be-c1e2-4456-b434-e282f50a3343 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:05.194073 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef02be-c1e2-4456-b434-e282f50a3343 admin admin] PATH_INFO: `/v3/projects/1be282fda618452982c480b875f0139a` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:05.205441 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bef02be-c1e2-4456-b434-e282f50a3343 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1be282fda618452982c480b875f0139a)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:05.208560 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bef02be-c1e2-4456-b434-e282f50a3343 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:05.227978 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 834/1672] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:30:04 2022] DELETE /identity/v3/users/f635425276b144b886fab03474e67272 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:30:05.449319 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-3bef02be-c1e2-4456-b434-e282f50a3343 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1be282fda618452982c480b875f0139a', 'request_id': 'req-3bef02be-c1e2-4456-b434-e282f50a3343'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:05.463112 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-3bef02be-c1e2-4456-b434-e282f50a3343 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1be282fda618452982c480b875f0139a', 'request_id': 'req-3bef02be-c1e2-4456-b434-e282f50a3343'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:05.583189 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-3bef02be-c1e2-4456-b434-e282f50a3343 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1be282fda618452982c480b875f0139a', 'request_id': 'req-3bef02be-c1e2-4456-b434-e282f50a3343'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:05.599670 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-3bef02be-c1e2-4456-b434-e282f50a3343 admin admin] The token cache is being invalidate because project 1be282fda618452982c480b875f0139a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:30:05.600121 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-3bef02be-c1e2-4456-b434-e282f50a3343 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:05.605730 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-3bef02be-c1e2-4456-b434-e282f50a3343 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:05.607932 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 839/1673] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:30:05 2022] DELETE /identity/v3/projects/1be282fda618452982c480b875f0139a => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:30:05.617892 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a13ac-be1b-4192-88f9-edcaa7c47f01 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:05.617892 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a13ac-be1b-4192-88f9-edcaa7c47f01 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:05.617892 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a13ac-be1b-4192-88f9-edcaa7c47f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:05.649509 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-131a13ac-be1b-4192-88f9-edcaa7c47f01 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:05.652914 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-131a13ac-be1b-4192-88f9-edcaa7c47f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:05.678760 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bef02be-c1e2-4456-b434-e282f50a3343 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:05.680703 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-3bef02be-c1e2-4456-b434-e282f50a3343 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:05.835458 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bef02be-c1e2-4456-b434-e282f50a3343 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:05.870402 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571e8b9f-c26b-4063-b69e-14098ef6ae86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:05.872603 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e8b9f-c26b-4063-b69e-14098ef6ae86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:05.873911 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e8b9f-c26b-4063-b69e-14098ef6ae86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:05.874344 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e8b9f-c26b-4063-b69e-14098ef6ae86 admin admin] PATH_INFO: `/v3/users/084e2920eeb1401fbd973d8dcbf81b5c` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:05.875843 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571e8b9f-c26b-4063-b69e-14098ef6ae86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=084e2920eeb1401fbd973d8dcbf81b5c)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:05.877904 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571e8b9f-c26b-4063-b69e-14098ef6ae86 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:05.914327 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 835/1674] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:30:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:30:05.925412 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15659faf-ff5e-427b-b5bc-7471702f7e66 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:05.926520 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15659faf-ff5e-427b-b5bc-7471702f7e66 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:05.927223 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15659faf-ff5e-427b-b5bc-7471702f7e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:05.952422 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-15659faf-ff5e-427b-b5bc-7471702f7e66 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:05.955704 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-15659faf-ff5e-427b-b5bc-7471702f7e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:05.970873 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 836/1675] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:30:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:30:05.988332 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15659faf-ff5e-427b-b5bc-7471702f7e66 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:06.015057 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15659faf-ff5e-427b-b5bc-7471702f7e66 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:06.022846 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5aec63-69fc-43fb-b3ed-8e2f8c38490c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:06.023999 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5aec63-69fc-43fb-b3ed-8e2f8c38490c admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:06.024289 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5aec63-69fc-43fb-b3ed-8e2f8c38490c admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:06.025201 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5aec63-69fc-43fb-b3ed-8e2f8c38490c admin admin] PATH_INFO: `/v3/domains` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:06.026033 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5aec63-69fc-43fb-b3ed-8e2f8c38490c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:30:06.026449 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5aec63-69fc-43fb-b3ed-8e2f8c38490c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:06.029105 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5aec63-69fc-43fb-b3ed-8e2f8c38490c admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:06.046554 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 837/1676] 10.222.0.62 () {58 vars in 1152 bytes} [Fri May 27 16:30:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:30:06.053807 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5aec63-69fc-43fb-b3ed-8e2f8c38490c admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:06.070703 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5aec63-69fc-43fb-b3ed-8e2f8c38490c admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:06.076920 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fefb45a-3966-4187-8532-459fe8bb8bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:06.077658 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fefb45a-3966-4187-8532-459fe8bb8bf6 admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:06.077952 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fefb45a-3966-4187-8532-459fe8bb8bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:06.078398 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fefb45a-3966-4187-8532-459fe8bb8bf6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:06.079799 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fefb45a-3966-4187-8532-459fe8bb8bf6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:06.083150 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fefb45a-3966-4187-8532-459fe8bb8bf6 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:06.107145 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-571e8b9f-c26b-4063-b69e-14098ef6ae86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '084e2920eeb1401fbd973d8dcbf81b5c'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:06.157709 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-571e8b9f-c26b-4063-b69e-14098ef6ae86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '084e2920eeb1401fbd973d8dcbf81b5c'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:06.161320 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-571e8b9f-c26b-4063-b69e-14098ef6ae86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '084e2920eeb1401fbd973d8dcbf81b5c'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:06.166374 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-571e8b9f-c26b-4063-b69e-14098ef6ae86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '084e2920eeb1401fbd973d8dcbf81b5c'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:06.195491 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 838/1677] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:30:06 2022] POST /identity/v3/projects => generated 405 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:30:06.200190 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fefb45a-3966-4187-8532-459fe8bb8bf6 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:06.202580 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-9fefb45a-3966-4187-8532-459fe8bb8bf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:06.271969 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-571e8b9f-c26b-4063-b69e-14098ef6ae86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '084e2920eeb1401fbd973d8dcbf81b5c'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:06.319451 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 840/1678] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:30:05 2022] DELETE /identity/v3/users/084e2920eeb1401fbd973d8dcbf81b5c => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:30:06.325537 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50fe657-4ae3-42b3-be5a-9af127b20641 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:06.325846 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50fe657-4ae3-42b3-be5a-9af127b20641 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:06.326610 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50fe657-4ae3-42b3-be5a-9af127b20641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:06.372851 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-f50fe657-4ae3-42b3-be5a-9af127b20641 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:06.376397 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-f50fe657-4ae3-42b3-be5a-9af127b20641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:06.393717 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fefb45a-3966-4187-8532-459fe8bb8bf6 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:06.466217 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:30:06.569311 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 841/1679] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:30:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:30:06.584679 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50fe657-4ae3-42b3-be5a-9af127b20641 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:06.586651 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-f50fe657-4ae3-42b3-be5a-9af127b20641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:06.621730 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94cc923-91ca-4cbf-bf00-01a48575a2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:06.621730 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94cc923-91ca-4cbf-bf00-01a48575a2e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:06.621730 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94cc923-91ca-4cbf-bf00-01a48575a2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:06.621730 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94cc923-91ca-4cbf-bf00-01a48575a2e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:06.622446 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94cc923-91ca-4cbf-bf00-01a48575a2e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:06.626459 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94cc923-91ca-4cbf-bf00-01a48575a2e9 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:06.771770 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 839/1680] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:30:06 2022] POST /identity/v3/users => generated 303 bytes in 572 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:30:06.775998 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94cc923-91ca-4cbf-bf00-01a48575a2e9 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:06.820116 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94cc923-91ca-4cbf-bf00-01a48575a2e9 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:06.837746 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50fe657-4ae3-42b3-be5a-9af127b20641 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:06.839585 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a54509c-f451-4013-94d7-fa8aff9f689d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:06.842974 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a54509c-f451-4013-94d7-fa8aff9f689d admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:06.851410 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a54509c-f451-4013-94d7-fa8aff9f689d admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:06.851410 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a54509c-f451-4013-94d7-fa8aff9f689d admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:06.854801 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a54509c-f451-4013-94d7-fa8aff9f689d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:06.860586 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6131c376-4fd8-438b-aa2f-f39cb24f7a7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:06.861923 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a54509c-f451-4013-94d7-fa8aff9f689d admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:06.865728 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131c376-4fd8-438b-aa2f-f39cb24f7a7c service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:06.866853 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131c376-4fd8-438b-aa2f-f39cb24f7a7c service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:06.871203 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131c376-4fd8-438b-aa2f-f39cb24f7a7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:06.926378 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6131c376-4fd8-438b-aa2f-f39cb24f7a7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:06.933551 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6131c376-4fd8-438b-aa2f-f39cb24f7a7c service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:06.937394 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 840/1681] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:30:06 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:30:06.940078 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a54509c-f451-4013-94d7-fa8aff9f689d admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:06.948673 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-2a54509c-f451-4013-94d7-fa8aff9f689d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:06.987103 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a54509c-f451-4013-94d7-fa8aff9f689d admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:06.999583 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e4f1be-fb2c-42f3-8076-d10dd75495c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:07.000532 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e4f1be-fb2c-42f3-8076-d10dd75495c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:07.001020 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e4f1be-fb2c-42f3-8076-d10dd75495c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:07.001376 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e4f1be-fb2c-42f3-8076-d10dd75495c1 admin admin] PATH_INFO: `/v3/projects/a40e1d7c6b1b4631bdad3701f9a70ecf` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:07.003396 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e4f1be-fb2c-42f3-8076-d10dd75495c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a40e1d7c6b1b4631bdad3701f9a70ecf)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:07.009083 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e4f1be-fb2c-42f3-8076-d10dd75495c1 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:07.014912 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 842/1682] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:30:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 16:30:07.016053 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6131c376-4fd8-438b-aa2f-f39cb24f7a7c service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:07.062849 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6131c376-4fd8-438b-aa2f-f39cb24f7a7c service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:07.083146 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daca772-a334-4255-bfc8-52941fbfe613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:07.083834 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daca772-a334-4255-bfc8-52941fbfe613 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:07.084117 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daca772-a334-4255-bfc8-52941fbfe613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:07.084409 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daca772-a334-4255-bfc8-52941fbfe613 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:07.085121 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daca772-a334-4255-bfc8-52941fbfe613 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:07.097528 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daca772-a334-4255-bfc8-52941fbfe613 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:07.150587 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 843/1683] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:30:07 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:30:07.163187 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f9505a-f352-4bba-a817-d728da42fc40 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:07.163918 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f9505a-f352-4bba-a817-d728da42fc40 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:07.164563 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f9505a-f352-4bba-a817-d728da42fc40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:07.249397 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-71f9505a-f352-4bba-a817-d728da42fc40 None None] MFA Rules not processed for user `d2aced0927994e97bac1ce1a63f4a911`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:07.249397 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-71f9505a-f352-4bba-a817-d728da42fc40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:07.289174 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-60e4f1be-fb2c-42f3-8076-d10dd75495c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a40e1d7c6b1b4631bdad3701f9a70ecf', 'request_id': 'req-60e4f1be-fb2c-42f3-8076-d10dd75495c1'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:07.308921 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-60e4f1be-fb2c-42f3-8076-d10dd75495c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a40e1d7c6b1b4631bdad3701f9a70ecf', 'request_id': 'req-60e4f1be-fb2c-42f3-8076-d10dd75495c1'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:07.323887 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-60e4f1be-fb2c-42f3-8076-d10dd75495c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a40e1d7c6b1b4631bdad3701f9a70ecf', 'request_id': 'req-60e4f1be-fb2c-42f3-8076-d10dd75495c1'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:07.430971 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-60e4f1be-fb2c-42f3-8076-d10dd75495c1 admin admin] The token cache is being invalidate because project a40e1d7c6b1b4631bdad3701f9a70ecf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80288) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:30:07.431117 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 844/1684] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:30:07 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:30:07.431536 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-60e4f1be-fb2c-42f3-8076-d10dd75495c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:07.432100 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f9505a-f352-4bba-a817-d728da42fc40 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:07.432868 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-60e4f1be-fb2c-42f3-8076-d10dd75495c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:07.439061 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 841/1685] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:30:06 2022] DELETE /identity/v3/projects/a40e1d7c6b1b4631bdad3701f9a70ecf => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:30:07.440699 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a979c-cff5-4ecc-94f6-bbabc257a216 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:07.446109 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a979c-cff5-4ecc-94f6-bbabc257a216 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:07.449629 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a979c-cff5-4ecc-94f6-bbabc257a216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:07.530434 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:30:07.531404 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-369a979c-cff5-4ecc-94f6-bbabc257a216 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:07.532657 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-369a979c-cff5-4ecc-94f6-bbabc257a216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:07.751622 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f9505a-f352-4bba-a817-d728da42fc40 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:07.789251 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd9b9b3-8b50-4d34-b734-17f3a1a35cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:07.804145 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd9b9b3-8b50-4d34-b734-17f3a1a35cc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:07.808019 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd9b9b3-8b50-4d34-b734-17f3a1a35cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:07.808743 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd9b9b3-8b50-4d34-b734-17f3a1a35cc6 admin admin] PATH_INFO: `/v3/projects/c002706e753b425a86ef1c2d950a5a49/users/a2583844afc04274a21390094a191526/roles/c8ce6d197f654598ac45f6016ecccabd` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:07.882339 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd9b9b3-8b50-4d34-b734-17f3a1a35cc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c002706e753b425a86ef1c2d950a5a49, user_id=a2583844afc04274a21390094a191526, role_id=c8ce6d197f654598ac45f6016ecccabd)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:07.895161 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd9b9b3-8b50-4d34-b734-17f3a1a35cc6 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:07.914055 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 842/1686] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:30:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 474 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:30:07.922029 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21304c-34fe-4203-998f-1fe4ee94b605 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:07.923518 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21304c-34fe-4203-998f-1fe4ee94b605 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:07.923518 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21304c-34fe-4203-998f-1fe4ee94b605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:07.983327 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-7c21304c-34fe-4203-998f-1fe4ee94b605 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:07.984645 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-7c21304c-34fe-4203-998f-1fe4ee94b605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:08.061175 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 843/1687] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:30:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:30:08.066081 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c21304c-34fe-4203-998f-1fe4ee94b605 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:08.090357 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c21304c-34fe-4203-998f-1fe4ee94b605 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:08.099580 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 845/1688] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:30:07 2022] PUT /identity/v3/projects/c002706e753b425a86ef1c2d950a5a49/users/a2583844afc04274a21390094a191526/roles/c8ce6d197f654598ac45f6016ecccabd => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:30:08.106367 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df84104a-194c-48eb-873d-d4a43fe6f570 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:08.107207 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df84104a-194c-48eb-873d-d4a43fe6f570 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:08.107890 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df84104a-194c-48eb-873d-d4a43fe6f570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:08.130652 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:30:08.225485 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a28818f-f4d8-4a1d-9942-80329bab0dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:08.226166 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a28818f-f4d8-4a1d-9942-80329bab0dfd admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:08.226483 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a28818f-f4d8-4a1d-9942-80329bab0dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:08.226763 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a28818f-f4d8-4a1d-9942-80329bab0dfd admin admin] PATH_INFO: `/v3/domains` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:08.227512 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a28818f-f4d8-4a1d-9942-80329bab0dfd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:30:08.227815 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a28818f-f4d8-4a1d-9942-80329bab0dfd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:08.229450 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a28818f-f4d8-4a1d-9942-80329bab0dfd admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:08.253084 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-df84104a-194c-48eb-873d-d4a43fe6f570 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:08.255263 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-df84104a-194c-48eb-873d-d4a43fe6f570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:08.281347 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 844/1689] 10.222.0.62 () {58 vars in 1152 bytes} [Fri May 27 16:30:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:30:08.288792 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 846/1690] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:30:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:30:08.288997 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a28818f-f4d8-4a1d-9942-80329bab0dfd admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:08.324368 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a28818f-f4d8-4a1d-9942-80329bab0dfd admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:08.337724 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddca8527-4fc4-4a3d-99c8-eb84d2c8c693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:08.338692 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddca8527-4fc4-4a3d-99c8-eb84d2c8c693 admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:08.340329 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddca8527-4fc4-4a3d-99c8-eb84d2c8c693 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:08.340329 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddca8527-4fc4-4a3d-99c8-eb84d2c8c693 admin admin] PATH_INFO: `/v3/projects` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:08.340565 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddca8527-4fc4-4a3d-99c8-eb84d2c8c693 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:08.342707 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddca8527-4fc4-4a3d-99c8-eb84d2c8c693 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:08.461241 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df84104a-194c-48eb-873d-d4a43fe6f570 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:08.464469 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-df84104a-194c-48eb-873d-d4a43fe6f570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:08.495938 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 845/1691] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:30:08 2022] POST /identity/v3/projects => generated 379 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:30:08.496967 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddca8527-4fc4-4a3d-99c8-eb84d2c8c693 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:08.553570 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df84104a-194c-48eb-873d-d4a43fe6f570 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:08.639210 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddca8527-4fc4-4a3d-99c8-eb84d2c8c693 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:08.646334 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6cae6b-9b7c-450f-ad5f-802d375925b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:08.646334 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6cae6b-9b7c-450f-ad5f-802d375925b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:08.646540 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6cae6b-9b7c-450f-ad5f-802d375925b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:08.647639 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6cae6b-9b7c-450f-ad5f-802d375925b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:08.647749 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6cae6b-9b7c-450f-ad5f-802d375925b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:08.650531 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6cae6b-9b7c-450f-ad5f-802d375925b3 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:08.695708 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf4e9ca-9cdb-4793-995a-812ded719a94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:08.696647 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4e9ca-9cdb-4793-995a-812ded719a94 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:08.696931 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4e9ca-9cdb-4793-995a-812ded719a94 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:08.697205 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4e9ca-9cdb-4793-995a-812ded719a94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:08.720043 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf4e9ca-9cdb-4793-995a-812ded719a94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:08.722015 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf4e9ca-9cdb-4793-995a-812ded719a94 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:08.747686 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 846/1692] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:30:08 2022] POST /identity/v3/users => generated 290 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:30:08.749139 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6cae6b-9b7c-450f-ad5f-802d375925b3 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:08.755375 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-8b6cae6b-9b7c-450f-ad5f-802d375925b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:08.768329 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 847/1693] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:30:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:30:08.769884 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf4e9ca-9cdb-4793-995a-812ded719a94 service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:08.774988 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6cae6b-9b7c-450f-ad5f-802d375925b3 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:08.782714 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00858038-541f-4f08-967b-e8daae55dba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:08.784320 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00858038-541f-4f08-967b-e8daae55dba6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:08.784764 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00858038-541f-4f08-967b-e8daae55dba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:08.785785 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00858038-541f-4f08-967b-e8daae55dba6 admin admin] PATH_INFO: `/v3/projects/56eea53edcdb46f2962bd64b148fed5c` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:08.788397 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00858038-541f-4f08-967b-e8daae55dba6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56eea53edcdb46f2962bd64b148fed5c)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:08.790938 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00858038-541f-4f08-967b-e8daae55dba6 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:08.794481 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf4e9ca-9cdb-4793-995a-812ded719a94 service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:08.810960 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd10ef4-e1b9-497f-bc12-ca395dafc36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:08.811729 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd10ef4-e1b9-497f-bc12-ca395dafc36b admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:08.812087 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd10ef4-e1b9-497f-bc12-ca395dafc36b admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:08.812429 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd10ef4-e1b9-497f-bc12-ca395dafc36b admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:08.813564 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd10ef4-e1b9-497f-bc12-ca395dafc36b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:08.816317 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd10ef4-e1b9-497f-bc12-ca395dafc36b admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:08.837813 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 848/1694] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:30:08.842094 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd10ef4-e1b9-497f-bc12-ca395dafc36b admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:08.862779 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd10ef4-e1b9-497f-bc12-ca395dafc36b admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:08.874978 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7b7fec-3f0e-4830-ba0f-476c78ee7afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:08.876007 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b7fec-3f0e-4830-ba0f-476c78ee7afb admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:08.876393 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b7fec-3f0e-4830-ba0f-476c78ee7afb admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:08.876794 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b7fec-3f0e-4830-ba0f-476c78ee7afb admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:08.878225 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7b7fec-3f0e-4830-ba0f-476c78ee7afb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:08.885001 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7b7fec-3f0e-4830-ba0f-476c78ee7afb admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:08.911892 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 849/1695] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:30:08.916113 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7b7fec-3f0e-4830-ba0f-476c78ee7afb admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:08.930158 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7b7fec-3f0e-4830-ba0f-476c78ee7afb admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:08.936916 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711ab755-aeab-4b4d-a69e-aef9ddb521a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:08.938577 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ab755-aeab-4b4d-a69e-aef9ddb521a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:08.939008 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ab755-aeab-4b4d-a69e-aef9ddb521a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:08.943660 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ab755-aeab-4b4d-a69e-aef9ddb521a6 admin admin] PATH_INFO: `/v3/projects/96acd9463fd440428c11706bcb4c7e7c/users/65be8ae124994561b8bc5e9bd693fe95/roles/c8ce6d197f654598ac45f6016ecccabd` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:08.976620 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711ab755-aeab-4b4d-a69e-aef9ddb521a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96acd9463fd440428c11706bcb4c7e7c, user_id=65be8ae124994561b8bc5e9bd693fe95, role_id=c8ce6d197f654598ac45f6016ecccabd)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:08.985508 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711ab755-aeab-4b4d-a69e-aef9ddb521a6 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:08.997465 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-00858038-541f-4f08-967b-e8daae55dba6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56eea53edcdb46f2962bd64b148fed5c', 'request_id': 'req-00858038-541f-4f08-967b-e8daae55dba6'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:09.023421 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-00858038-541f-4f08-967b-e8daae55dba6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56eea53edcdb46f2962bd64b148fed5c', 'request_id': 'req-00858038-541f-4f08-967b-e8daae55dba6'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:09.040391 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-00858038-541f-4f08-967b-e8daae55dba6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56eea53edcdb46f2962bd64b148fed5c', 'request_id': 'req-00858038-541f-4f08-967b-e8daae55dba6'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:09.106309 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 850/1696] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:30:08 2022] PUT /identity/v3/projects/96acd9463fd440428c11706bcb4c7e7c/users/65be8ae124994561b8bc5e9bd693fe95/roles/c8ce6d197f654598ac45f6016ecccabd => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:30:09.123680 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0f9a8-d01c-40db-9757-84d903c863da None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:09.123680 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0f9a8-d01c-40db-9757-84d903c863da None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:09.124185 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0f9a8-d01c-40db-9757-84d903c863da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:09.160796 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-b6a0f9a8-d01c-40db-9757-84d903c863da None None] MFA Rules not processed for user `eb50bf5f39b04ab689b55f46d3dd2640`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:09.164603 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-b6a0f9a8-d01c-40db-9757-84d903c863da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:09.172017 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-00858038-541f-4f08-967b-e8daae55dba6 admin admin] The token cache is being invalidate because project 56eea53edcdb46f2962bd64b148fed5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80288) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:30:09.172654 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-00858038-541f-4f08-967b-e8daae55dba6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:09.174673 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-00858038-541f-4f08-967b-e8daae55dba6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:09.179628 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 847/1697] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:30:08 2022] DELETE /identity/v3/projects/56eea53edcdb46f2962bd64b148fed5c => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:30:09.187378 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604ec80-fea8-4884-8d05-aaae349803b3 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:09.195815 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604ec80-fea8-4884-8d05-aaae349803b3 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:09.196119 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604ec80-fea8-4884-8d05-aaae349803b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:09.303296 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-0604ec80-fea8-4884-8d05-aaae349803b3 None None] MFA Rules not processed for user `65be8ae124994561b8bc5e9bd693fe95`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:09.304767 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-0604ec80-fea8-4884-8d05-aaae349803b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:09.336626 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 851/1698] 10.222.0.62 () {58 vars in 1009 bytes} [Fri May 27 16:30:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:30:09.352877 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfa7a8c-1989-4663-9d6b-30254dcec6bb None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:09.353185 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfa7a8c-1989-4663-9d6b-30254dcec6bb None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:09.353479 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfa7a8c-1989-4663-9d6b-30254dcec6bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:09.421535 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-7cfa7a8c-1989-4663-9d6b-30254dcec6bb None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:09.426711 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-7cfa7a8c-1989-4663-9d6b-30254dcec6bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:09.515258 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 848/1699] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:30:09 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:30:09.519709 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0604ec80-fea8-4884-8d05-aaae349803b3 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:09.523130 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-0604ec80-fea8-4884-8d05-aaae349803b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:09.604320 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 852/1700] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:30:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:30:09.612237 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45afc64-545f-4cda-9df5-b899ed3453fd None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:09.612582 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45afc64-545f-4cda-9df5-b899ed3453fd None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:09.612915 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45afc64-545f-4cda-9df5-b899ed3453fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:09.653471 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-a45afc64-545f-4cda-9df5-b899ed3453fd None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:09.656184 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-a45afc64-545f-4cda-9df5-b899ed3453fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:09.677178 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 853/1701] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:30:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:30:09.680508 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45afc64-545f-4cda-9df5-b899ed3453fd None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:09.703942 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45afc64-545f-4cda-9df5-b899ed3453fd None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:09.713841 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d9cb6b-c20f-4479-b598-70dac0c10862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:09.718950 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d9cb6b-c20f-4479-b598-70dac0c10862 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:09.719424 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d9cb6b-c20f-4479-b598-70dac0c10862 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:09.719858 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d9cb6b-c20f-4479-b598-70dac0c10862 admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:09.720722 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d9cb6b-c20f-4479-b598-70dac0c10862 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:30:09.721167 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d9cb6b-c20f-4479-b598-70dac0c10862 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:09.732016 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d9cb6b-c20f-4479-b598-70dac0c10862 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:09.741626 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0604ec80-fea8-4884-8d05-aaae349803b3 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:09.755161 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2312afe0-f97d-451b-a864-fcd0d734a5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:09.756100 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2312afe0-f97d-451b-a864-fcd0d734a5c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:09.756403 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2312afe0-f97d-451b-a864-fcd0d734a5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:09.756689 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2312afe0-f97d-451b-a864-fcd0d734a5c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:09.757410 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2312afe0-f97d-451b-a864-fcd0d734a5c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:09.759514 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2312afe0-f97d-451b-a864-fcd0d734a5c5 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:09.765271 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 854/1702] 10.222.0.62 () {58 vars in 1152 bytes} [Fri May 27 16:30:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:30:09.774857 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d9cb6b-c20f-4479-b598-70dac0c10862 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:09.817348 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d9cb6b-c20f-4479-b598-70dac0c10862 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:09.827202 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718689b0-f3d2-462b-a5c1-242b078f0ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:09.828224 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718689b0-f3d2-462b-a5c1-242b078f0ba6 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:09.828696 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718689b0-f3d2-462b-a5c1-242b078f0ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:09.829182 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718689b0-f3d2-462b-a5c1-242b078f0ba6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:09.830119 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718689b0-f3d2-462b-a5c1-242b078f0ba6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:09.833822 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718689b0-f3d2-462b-a5c1-242b078f0ba6 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:10.034309 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 849/1704] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:30:09 2022] POST /identity/v3/projects => generated 379 bytes in 511 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:30:10.034309 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2312afe0-f97d-451b-a864-fcd0d734a5c5 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:10.035746 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 855/1704] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:30:09 2022] POST /identity/v3/projects => generated 365 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:30:10.035746 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718689b0-f3d2-462b-a5c1-242b078f0ba6 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:10.038510 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-2312afe0-f97d-451b-a864-fcd0d734a5c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:10.293302 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718689b0-f3d2-462b-a5c1-242b078f0ba6 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:10.304157 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceddcfae-6df6-4f07-9517-c1702047baf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:10.305966 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceddcfae-6df6-4f07-9517-c1702047baf1 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:10.306270 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceddcfae-6df6-4f07-9517-c1702047baf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:10.306552 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceddcfae-6df6-4f07-9517-c1702047baf1 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:10.311179 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceddcfae-6df6-4f07-9517-c1702047baf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:10.313397 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceddcfae-6df6-4f07-9517-c1702047baf1 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:10.359741 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2312afe0-f97d-451b-a864-fcd0d734a5c5 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:10.479776 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1e6d34-79d1-406a-85db-8284461d00e7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8e6ec55445045fcac5623b9b6ffa9ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:10.490178 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 856/1705] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:30:10 2022] POST /identity/v3/users => generated 296 bytes in 457 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:30:10.491056 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceddcfae-6df6-4f07-9517-c1702047baf1 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:10.493694 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e6d34-79d1-406a-85db-8284461d00e7 service swift] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:10.493972 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e6d34-79d1-406a-85db-8284461d00e7 service swift] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:10.494286 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e6d34-79d1-406a-85db-8284461d00e7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:10.503416 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceddcfae-6df6-4f07-9517-c1702047baf1 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:10.521491 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd589011-1a6d-4008-89c6-e0439be7fea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:10.522281 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd589011-1a6d-4008-89c6-e0439be7fea3 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:10.522593 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd589011-1a6d-4008-89c6-e0439be7fea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:10.522876 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd589011-1a6d-4008-89c6-e0439be7fea3 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:10.524706 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd589011-1a6d-4008-89c6-e0439be7fea3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:10.530215 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd589011-1a6d-4008-89c6-e0439be7fea3 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:10.589304 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1e6d34-79d1-406a-85db-8284461d00e7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:10.591151 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1e6d34-79d1-406a-85db-8284461d00e7 service swift] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:10.607093 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 850/1706] 10.222.0.62 () {60 vars in 1384 bytes} [Fri May 27 16:30:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 576 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 16:30:10.608510 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1e6d34-79d1-406a-85db-8284461d00e7 service swift] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:10.621224 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1e6d34-79d1-406a-85db-8284461d00e7 service swift] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:10.633957 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66913e53-56a7-4d50-9776-ef6091492e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:10.633957 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66913e53-56a7-4d50-9776-ef6091492e0f admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:10.633957 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66913e53-56a7-4d50-9776-ef6091492e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:10.633957 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66913e53-56a7-4d50-9776-ef6091492e0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:10.635462 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66913e53-56a7-4d50-9776-ef6091492e0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:10.638665 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66913e53-56a7-4d50-9776-ef6091492e0f admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:10.671242 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 851/1707] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:30:10 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:30:10.672124 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23db1b-c702-4bcd-8241-bf1826bb87ba None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:10.672429 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23db1b-c702-4bcd-8241-bf1826bb87ba None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:10.672719 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23db1b-c702-4bcd-8241-bf1826bb87ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:10.695532 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 857/1708] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:30:10 2022] POST /identity/v3/users => generated 283 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:30:10.696686 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd589011-1a6d-4008-89c6-e0439be7fea3 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:10.710968 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-dc23db1b-c702-4bcd-8241-bf1826bb87ba None None] MFA Rules not processed for user `820d152f8d5b45a2aca035e7cc2684ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:10.712454 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-dc23db1b-c702-4bcd-8241-bf1826bb87ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:10.734084 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd589011-1a6d-4008-89c6-e0439be7fea3 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:10.746910 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86da3684-ffc0-40a0-94a7-81f263251f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:10.749545 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da3684-ffc0-40a0-94a7-81f263251f1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:10.750022 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da3684-ffc0-40a0-94a7-81f263251f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:10.750487 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da3684-ffc0-40a0-94a7-81f263251f1e admin admin] PATH_INFO: `/v3/projects/6db27eed3e5144f881eeec8c78befbf1/users/60d5dac0b85f40e28c29bae77f160457/roles/e04fe3eb1f714d74901ac83e33ea8a16` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:10.823433 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86da3684-ffc0-40a0-94a7-81f263251f1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6db27eed3e5144f881eeec8c78befbf1, user_id=60d5dac0b85f40e28c29bae77f160457, role_id=e04fe3eb1f714d74901ac83e33ea8a16)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:10.827952 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86da3684-ffc0-40a0-94a7-81f263251f1e admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:10.947570 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 858/1709] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:30:10 2022] PUT /identity/v3/projects/6db27eed3e5144f881eeec8c78befbf1/users/60d5dac0b85f40e28c29bae77f160457/roles/e04fe3eb1f714d74901ac83e33ea8a16 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:30:10.951100 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86da3684-ffc0-40a0-94a7-81f263251f1e admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:10.986125 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:30:11.063278 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 852/1710] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:30:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:30:11.066689 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc23db1b-c702-4bcd-8241-bf1826bb87ba None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:11.105030 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc23db1b-c702-4bcd-8241-bf1826bb87ba None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:11.167679 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:30:11.178600 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86da3684-ffc0-40a0-94a7-81f263251f1e admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:11.198702 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c164430-561f-4bc0-a83a-84f4eeca4be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:11.199992 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c164430-561f-4bc0-a83a-84f4eeca4be8 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:11.200342 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c164430-561f-4bc0-a83a-84f4eeca4be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:11.201129 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c164430-561f-4bc0-a83a-84f4eeca4be8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:11.202372 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c164430-561f-4bc0-a83a-84f4eeca4be8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:11.210350 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c164430-561f-4bc0-a83a-84f4eeca4be8 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:11.215257 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac02ff5-5a10-413d-98a9-d254914033cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:11.217563 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac02ff5-5a10-413d-98a9-d254914033cc admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:11.217854 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac02ff5-5a10-413d-98a9-d254914033cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:11.218158 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac02ff5-5a10-413d-98a9-d254914033cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:11.219149 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac02ff5-5a10-413d-98a9-d254914033cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:11.221174 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac02ff5-5a10-413d-98a9-d254914033cc admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:11.236369 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 853/1711] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:30:11 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:30:11.238779 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac02ff5-5a10-413d-98a9-d254914033cc admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:11.244295 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-0ac02ff5-5a10-413d-98a9-d254914033cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:11.250672 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 859/1712] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:30:10 2022] GET /identity/v3/roles => generated 1420 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:30:11.253028 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c164430-561f-4bc0-a83a-84f4eeca4be8 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:11.299415 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c164430-561f-4bc0-a83a-84f4eeca4be8 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:11.348916 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448b2b43-cdf7-469a-80b6-a700a1a51968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:11.362649 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448b2b43-cdf7-469a-80b6-a700a1a51968 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:11.729339 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448b2b43-cdf7-469a-80b6-a700a1a51968 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:11.729339 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448b2b43-cdf7-469a-80b6-a700a1a51968 admin admin] PATH_INFO: `/v3/projects/6db27eed3e5144f881eeec8c78befbf1/users/60d5dac0b85f40e28c29bae77f160457/roles/e04fe3eb1f714d74901ac83e33ea8a16` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:11.729339 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448b2b43-cdf7-469a-80b6-a700a1a51968 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6db27eed3e5144f881eeec8c78befbf1, user_id=60d5dac0b85f40e28c29bae77f160457, role_id=e04fe3eb1f714d74901ac83e33ea8a16)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:11.729339 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448b2b43-cdf7-469a-80b6-a700a1a51968 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:11.729339 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 860/1713] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:30:11 2022] PUT /identity/v3/projects/6db27eed3e5144f881eeec8c78befbf1/users/60d5dac0b85f40e28c29bae77f160457/roles/e04fe3eb1f714d74901ac83e33ea8a16 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:30:11.732889 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448b2b43-cdf7-469a-80b6-a700a1a51968 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:11.735085 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac02ff5-5a10-413d-98a9-d254914033cc admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:11.738693 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448b2b43-cdf7-469a-80b6-a700a1a51968 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:11.738693 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9da6b8-e3a1-443b-b345-4052308f5f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:11.738693 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9da6b8-e3a1-443b-b345-4052308f5f54 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:11.738693 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9da6b8-e3a1-443b-b345-4052308f5f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:11.739911 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9da6b8-e3a1-443b-b345-4052308f5f54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:11.739911 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9da6b8-e3a1-443b-b345-4052308f5f54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:11.739911 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9da6b8-e3a1-443b-b345-4052308f5f54 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:11.739911 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 861/1714] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:30:11 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:30:11.739911 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff0248-21e3-4fcb-8585-1ac5a4893cb6 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:11.739911 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff0248-21e3-4fcb-8585-1ac5a4893cb6 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:11.740337 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff0248-21e3-4fcb-8585-1ac5a4893cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:11.740445 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b78d6de-e1f8-41c2-92cc-107b1e3d1149 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb13ad6d8b1e46029262556bff398796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:11.740445 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b78d6de-e1f8-41c2-92cc-107b1e3d1149 service nova] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:11.740445 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b78d6de-e1f8-41c2-92cc-107b1e3d1149 service nova] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:11.740445 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b78d6de-e1f8-41c2-92cc-107b1e3d1149 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:11.740808 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-0cff0248-21e3-4fcb-8585-1ac5a4893cb6 None None] MFA Rules not processed for user `60d5dac0b85f40e28c29bae77f160457`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:11.740808 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-0cff0248-21e3-4fcb-8585-1ac5a4893cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:11.765475 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 862/1715] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:30:11 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:30:11.766691 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cff0248-21e3-4fcb-8585-1ac5a4893cb6 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:11.769811 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b78d6de-e1f8-41c2-92cc-107b1e3d1149 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:11.773372 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b78d6de-e1f8-41c2-92cc-107b1e3d1149 service nova] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:11.780222 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cff0248-21e3-4fcb-8585-1ac5a4893cb6 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:11.785955 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041e1b91-366e-405c-937e-3be51a157cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:11.797587 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e1b91-366e-405c-937e-3be51a157cb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:11.797784 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e1b91-366e-405c-937e-3be51a157cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:11.798590 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 854/1716] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:30:11 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:30:11.799304 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b78d6de-e1f8-41c2-92cc-107b1e3d1149 service nova] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:11.800005 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e1b91-366e-405c-937e-3be51a157cb6 admin admin] PATH_INFO: `/v3/projects/79e844ab0bc24e8db0332287eb1c4493/users/672994d1835f411eb643e694f05e0b0a/roles/c8ce6d197f654598ac45f6016ecccabd` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:11.803370 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-7b78d6de-e1f8-41c2-92cc-107b1e3d1149 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:11.873249 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041e1b91-366e-405c-937e-3be51a157cb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79e844ab0bc24e8db0332287eb1c4493, user_id=672994d1835f411eb643e694f05e0b0a, role_id=c8ce6d197f654598ac45f6016ecccabd)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:11.875960 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041e1b91-366e-405c-937e-3be51a157cb6 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:11.928823 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b78d6de-e1f8-41c2-92cc-107b1e3d1149 service nova] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:11.933961 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d24ddc-3a54-489c-b12f-a8038a826cbf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8693a1e72f14fdfb383f11e96330726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:11.934139 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d24ddc-3a54-489c-b12f-a8038a826cbf service cinder] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:11.934351 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d24ddc-3a54-489c-b12f-a8038a826cbf service cinder] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:11.934687 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d24ddc-3a54-489c-b12f-a8038a826cbf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:12.038371 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d24ddc-3a54-489c-b12f-a8038a826cbf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:12.039849 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d24ddc-3a54-489c-b12f-a8038a826cbf service cinder] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:12.061308 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 855/1717] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:30:11 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:30:13.647229 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 863/1718] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:30:11 2022] PUT /identity/v3/projects/79e844ab0bc24e8db0332287eb1c4493/users/672994d1835f411eb643e694f05e0b0a/roles/c8ce6d197f654598ac45f6016ecccabd => generated 0 bytes in 1881 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:30:13.659281 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f506f309-b3b8-4940-846f-fc68ef49a8f1 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:13.659888 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f506f309-b3b8-4940-846f-fc68ef49a8f1 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:13.659985 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f506f309-b3b8-4940-846f-fc68ef49a8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:13.718937 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-f506f309-b3b8-4940-846f-fc68ef49a8f1 None None] MFA Rules not processed for user `672994d1835f411eb643e694f05e0b0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:13.720322 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-f506f309-b3b8-4940-846f-fc68ef49a8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:13.907841 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 856/1719] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:30:13 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:30:13.915401 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041e1b91-366e-405c-937e-3be51a157cb6 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:14.146825 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514cba1c-4c90-456a-b145-19bc3cedd874 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:14.147119 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514cba1c-4c90-456a-b145-19bc3cedd874 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:14.154115 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514cba1c-4c90-456a-b145-19bc3cedd874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:14.209750 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-514cba1c-4c90-456a-b145-19bc3cedd874 None None] MFA Rules not processed for user `b367ccea28d540a0b24ec4e42ebfef65`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:14.211117 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-514cba1c-4c90-456a-b145-19bc3cedd874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:14.274713 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041e1b91-366e-405c-937e-3be51a157cb6 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:14.323779 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d824cb-10ea-47a1-a490-2a85df801812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:14.331125 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d824cb-10ea-47a1-a490-2a85df801812 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:14.331445 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d824cb-10ea-47a1-a490-2a85df801812 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:14.335034 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d824cb-10ea-47a1-a490-2a85df801812 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:14.373333 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d824cb-10ea-47a1-a490-2a85df801812 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:14.408688 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d824cb-10ea-47a1-a490-2a85df801812 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:14.494526 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 857/1720] 10.222.0.79 () {58 vars in 1015 bytes} [Fri May 27 16:30:14 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:30:14.518586 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514cba1c-4c90-456a-b145-19bc3cedd874 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:14.518586 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-514cba1c-4c90-456a-b145-19bc3cedd874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:14.545219 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514cba1c-4c90-456a-b145-19bc3cedd874 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:14.561800 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8b80ba-1aea-45df-9bd1-f8b4b9ded37f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:14.562614 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8b80ba-1aea-45df-9bd1-f8b4b9ded37f service neutron] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:14.562896 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8b80ba-1aea-45df-9bd1-f8b4b9ded37f service neutron] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:14.563175 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8b80ba-1aea-45df-9bd1-f8b4b9ded37f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:14.576847 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8b80ba-1aea-45df-9bd1-f8b4b9ded37f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:14.578295 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8b80ba-1aea-45df-9bd1-f8b4b9ded37f service neutron] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:14.587214 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 858/1721] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:30:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:30:14.710817 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 864/1722] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:30:13 2022] POST /identity/v3/projects => generated 363 bytes in 799 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:30:14.715390 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8b80ba-1aea-45df-9bd1-f8b4b9ded37f service neutron] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:14.753221 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8b80ba-1aea-45df-9bd1-f8b4b9ded37f service neutron] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:14.927196 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeab247-0d91-441d-958f-dcd5a889df74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:14.928247 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeab247-0d91-441d-958f-dcd5a889df74 admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:14.928935 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeab247-0d91-441d-958f-dcd5a889df74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:14.929403 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeab247-0d91-441d-958f-dcd5a889df74 admin admin] PATH_INFO: `/v3/users` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:14.930433 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeab247-0d91-441d-958f-dcd5a889df74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:14.953683 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeab247-0d91-441d-958f-dcd5a889df74 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:15.003879 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d824cb-10ea-47a1-a490-2a85df801812 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:15.006974 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-93d824cb-10ea-47a1-a490-2a85df801812 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:15.049564 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d824cb-10ea-47a1-a490-2a85df801812 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:15.069301 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb63e4a-17bf-4b82-ab0a-1be5582a15da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:15.071771 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb63e4a-17bf-4b82-ab0a-1be5582a15da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:15.072525 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb63e4a-17bf-4b82-ab0a-1be5582a15da admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:15.072820 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb63e4a-17bf-4b82-ab0a-1be5582a15da admin admin] PATH_INFO: `/v3/users/fedac9fe4a414116bdcf9a722bb9fe8c` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:15.077346 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb63e4a-17bf-4b82-ab0a-1be5582a15da admin admin] RBAC: Authorizing `identity:delete_user(user_id=fedac9fe4a414116bdcf9a722bb9fe8c)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:15.090888 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb63e4a-17bf-4b82-ab0a-1be5582a15da admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:15.137778 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 859/1723] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:30:14 2022] POST /identity/v3/users => generated 288 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:30:15.139118 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeab247-0d91-441d-958f-dcd5a889df74 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:15.184897 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeab247-0d91-441d-958f-dcd5a889df74 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:15.196781 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6233f57a-f905-488d-9e72-ef1d2d199747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:15.197886 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233f57a-f905-488d-9e72-ef1d2d199747 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:15.198565 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233f57a-f905-488d-9e72-ef1d2d199747 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:15.199269 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233f57a-f905-488d-9e72-ef1d2d199747 admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:15.200535 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6233f57a-f905-488d-9e72-ef1d2d199747 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:15.203506 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6233f57a-f905-488d-9e72-ef1d2d199747 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:15.235270 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 860/1724] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:30:15 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:30:15.242660 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6233f57a-f905-488d-9e72-ef1d2d199747 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:15.288474 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6233f57a-f905-488d-9e72-ef1d2d199747 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:15.309126 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9ea330-b12a-4eff-ae75-3f9b7dcc0ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:15.309999 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9ea330-b12a-4eff-ae75-3f9b7dcc0ef2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:15.323696 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9ea330-b12a-4eff-ae75-3f9b7dcc0ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:15.323696 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9ea330-b12a-4eff-ae75-3f9b7dcc0ef2 admin admin] PATH_INFO: `/v3/projects/826813d5ba914cc48881b2c5818b33f6/users/97898414cbfe4c498617ecafb5e8805a/roles/e04fe3eb1f714d74901ac83e33ea8a16` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:15.361722 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9ea330-b12a-4eff-ae75-3f9b7dcc0ef2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=826813d5ba914cc48881b2c5818b33f6, user_id=97898414cbfe4c498617ecafb5e8805a, role_id=e04fe3eb1f714d74901ac83e33ea8a16)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:15.375221 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9ea330-b12a-4eff-ae75-3f9b7dcc0ef2 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:15.434854 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-0bb63e4a-17bf-4b82-ab0a-1be5582a15da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fedac9fe4a414116bdcf9a722bb9fe8c'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:15.444764 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:30:15.449707 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-0bb63e4a-17bf-4b82-ab0a-1be5582a15da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fedac9fe4a414116bdcf9a722bb9fe8c'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:15.455630 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-0bb63e4a-17bf-4b82-ab0a-1be5582a15da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fedac9fe4a414116bdcf9a722bb9fe8c'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:15.455630 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-0bb63e4a-17bf-4b82-ab0a-1be5582a15da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fedac9fe4a414116bdcf9a722bb9fe8c'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:15.520466 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 861/1725] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:30:15 2022] PUT /identity/v3/projects/826813d5ba914cc48881b2c5818b33f6/users/97898414cbfe4c498617ecafb5e8805a/roles/e04fe3eb1f714d74901ac83e33ea8a16 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:30:15.526208 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9ea330-b12a-4eff-ae75-3f9b7dcc0ef2 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:15.529893 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-4b9ea330-b12a-4eff-ae75-3f9b7dcc0ef2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:15.541363 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-0bb63e4a-17bf-4b82-ab0a-1be5582a15da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fedac9fe4a414116bdcf9a722bb9fe8c'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:15.590807 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 865/1726] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:30:15 2022] DELETE /identity/v3/users/fedac9fe4a414116bdcf9a722bb9fe8c => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:30:15.592685 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2429da5-a908-4633-b305-956e7b6210f0 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:15.592979 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2429da5-a908-4633-b305-956e7b6210f0 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:15.593752 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2429da5-a908-4633-b305-956e7b6210f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:15.667315 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-f2429da5-a908-4633-b305-956e7b6210f0 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:15.668953 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-f2429da5-a908-4633-b305-956e7b6210f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:15.678585 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9ea330-b12a-4eff-ae75-3f9b7dcc0ef2 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:15.877692 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 866/1727] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:30:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:30:15.884654 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2429da5-a908-4633-b305-956e7b6210f0 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:15.889186 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-f2429da5-a908-4633-b305-956e7b6210f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:15.896745 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ac94e-e87d-43f3-bffe-65d3f63121f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:15.905409 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ac94e-e87d-43f3-bffe-65d3f63121f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:15.905899 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ac94e-e87d-43f3-bffe-65d3f63121f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:15.907131 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ac94e-e87d-43f3-bffe-65d3f63121f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:15.914672 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01ac94e-e87d-43f3-bffe-65d3f63121f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:15.917879 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01ac94e-e87d-43f3-bffe-65d3f63121f5 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:15.966707 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2429da5-a908-4633-b305-956e7b6210f0 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:15.971462 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6334dc-52a7-4e60-91b9-0d3851c30e07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8693a1e72f14fdfb383f11e96330726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:15.972352 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6334dc-52a7-4e60-91b9-0d3851c30e07 service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:15.972778 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6334dc-52a7-4e60-91b9-0d3851c30e07 service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:15.973266 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6334dc-52a7-4e60-91b9-0d3851c30e07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:15.974096 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 862/1728] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:30:15 2022] GET /identity/v3/roles => generated 1420 bytes in 446 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:30:15.975047 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ac94e-e87d-43f3-bffe-65d3f63121f5 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:15.979028 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-5c6334dc-52a7-4e60-91b9-0d3851c30e07 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:15.984427 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-e01ac94e-e87d-43f3-bffe-65d3f63121f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:16.063842 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6334dc-52a7-4e60-91b9-0d3851c30e07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:16.065316 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6334dc-52a7-4e60-91b9-0d3851c30e07 service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:16.102167 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 867/1729] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:30:15 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:30:16.104771 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6334dc-52a7-4e60-91b9-0d3851c30e07 service cinder] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:16.154217 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6334dc-52a7-4e60-91b9-0d3851c30e07 service cinder] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:16.170993 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858a47dd-2282-455f-b94d-27aa48e2b987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:16.171903 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a47dd-2282-455f-b94d-27aa48e2b987 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:16.172187 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a47dd-2282-455f-b94d-27aa48e2b987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:16.172462 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a47dd-2282-455f-b94d-27aa48e2b987 admin admin] PATH_INFO: `/v3/projects/826813d5ba914cc48881b2c5818b33f6/users/97898414cbfe4c498617ecafb5e8805a/roles/e04fe3eb1f714d74901ac83e33ea8a16` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:16.185718 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858a47dd-2282-455f-b94d-27aa48e2b987 admin admin] RBAC: Authorizing `identity:create_grant(project_id=826813d5ba914cc48881b2c5818b33f6, user_id=97898414cbfe4c498617ecafb5e8805a, role_id=e04fe3eb1f714d74901ac83e33ea8a16)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:16.188601 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858a47dd-2282-455f-b94d-27aa48e2b987 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:16.195378 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ac94e-e87d-43f3-bffe-65d3f63121f5 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:16.206932 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f2f32-c652-4866-92d7-bf5bd8090e7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:16.207527 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f2f32-c652-4866-92d7-bf5bd8090e7b service neutron] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:16.211258 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f2f32-c652-4866-92d7-bf5bd8090e7b service neutron] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:16.211598 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f2f32-c652-4866-92d7-bf5bd8090e7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:16.232078 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 868/1730] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:30:16 2022] PUT /identity/v3/projects/826813d5ba914cc48881b2c5818b33f6/users/97898414cbfe4c498617ecafb5e8805a/roles/e04fe3eb1f714d74901ac83e33ea8a16 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:30:16.246550 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436f2f32-c652-4866-92d7-bf5bd8090e7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:16.248076 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436f2f32-c652-4866-92d7-bf5bd8090e7b service neutron] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:16.249110 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a28c971-ea3b-4bdd-8ccb-d9b7392507a7 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:16.249409 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a28c971-ea3b-4bdd-8ccb-d9b7392507a7 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:16.249694 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a28c971-ea3b-4bdd-8ccb-d9b7392507a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:16.279807 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 863/1731] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:30:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:30:16.333970 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-7a28c971-ea3b-4bdd-8ccb-d9b7392507a7 None None] MFA Rules not processed for user `97898414cbfe4c498617ecafb5e8805a`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:16.336072 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-7a28c971-ea3b-4bdd-8ccb-d9b7392507a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:16.614288 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 869/1732] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:30:16 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:30:16.749355 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f2f32-c652-4866-92d7-bf5bd8090e7b service neutron] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:16.777432 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f2f32-c652-4866-92d7-bf5bd8090e7b service neutron] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:17.027231 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:30:17.047375 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb52c1b-e33d-43e9-98ee-88da3039e88e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8693a1e72f14fdfb383f11e96330726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:17.048574 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb52c1b-e33d-43e9-98ee-88da3039e88e service cinder] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:17.048574 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb52c1b-e33d-43e9-98ee-88da3039e88e service cinder] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:17.048574 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb52c1b-e33d-43e9-98ee-88da3039e88e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:17.077475 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb52c1b-e33d-43e9-98ee-88da3039e88e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:17.078889 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb52c1b-e33d-43e9-98ee-88da3039e88e service cinder] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:17.112572 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 864/1733] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:30:16 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 16:30:18.204162 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797ec66-a84c-4f98-a141-624f3f567393 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:18.204162 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797ec66-a84c-4f98-a141-624f3f567393 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:18.204162 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797ec66-a84c-4f98-a141-624f3f567393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:18.288307 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-a797ec66-a84c-4f98-a141-624f3f567393 None None] MFA Rules not processed for user `a2583844afc04274a21390094a191526`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:18.293938 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-a797ec66-a84c-4f98-a141-624f3f567393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:18.398170 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:30:18.568039 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 870/1734] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:30:18 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:30:18.569559 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb52c1b-e33d-43e9-98ee-88da3039e88e service cinder] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:18.571687 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-bfb52c1b-e33d-43e9-98ee-88da3039e88e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:18.662762 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8368e94-83e1-47d7-b311-0c838918d257 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:18.663077 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8368e94-83e1-47d7-b311-0c838918d257 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:18.663543 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8368e94-83e1-47d7-b311-0c838918d257 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:18.665626 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 871/1735] 10.222.0.62 () {54 vars in 921 bytes} [Fri May 27 16:30:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 16:30:18.697207 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec58b6-5957-4b21-8506-a995a49a4d5c None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:18.697659 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec58b6-5957-4b21-8506-a995a49a4d5c None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:18.697832 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec58b6-5957-4b21-8506-a995a49a4d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:18.795093 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-c4ec58b6-5957-4b21-8506-a995a49a4d5c None None] MFA Rules not processed for user `cb13ad6d8b1e46029262556bff398796`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:18.795093 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-c4ec58b6-5957-4b21-8506-a995a49a4d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:18.871561 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb52c1b-e33d-43e9-98ee-88da3039e88e service cinder] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:18.879466 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1edf3a1-bbff-40c0-9422-5fb166b4b39d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:18.880464 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1edf3a1-bbff-40c0-9422-5fb166b4b39d admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:18.895154 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1edf3a1-bbff-40c0-9422-5fb166b4b39d admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:18.896773 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1edf3a1-bbff-40c0-9422-5fb166b4b39d admin admin] PATH_INFO: `/v3/projects` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:18.897723 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1edf3a1-bbff-40c0-9422-5fb166b4b39d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:18.904025 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1edf3a1-bbff-40c0-9422-5fb166b4b39d admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:18.970559 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 872/1736] 10.222.0.62 () {58 vars in 1018 bytes} [Fri May 27 16:30:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:30:19.054484 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 865/1737] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:30:18 2022] POST /identity/v3/projects => generated 405 bytes in 485 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:30:19.059866 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec58b6-5957-4b21-8506-a995a49a4d5c None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:19.077029 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec58b6-5957-4b21-8506-a995a49a4d5c None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:19.239503 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab5aa2-7de2-4bd9-b81c-5b41c07e0a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:19.241494 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab5aa2-7de2-4bd9-b81c-5b41c07e0a82 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:19.242326 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab5aa2-7de2-4bd9-b81c-5b41c07e0a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:19.243153 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab5aa2-7de2-4bd9-b81c-5b41c07e0a82 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:19.244439 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bab5aa2-7de2-4bd9-b81c-5b41c07e0a82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:19.246996 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bab5aa2-7de2-4bd9-b81c-5b41c07e0a82 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:19.370094 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 873/1738] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:30:19 2022] POST /identity/v3/users => generated 309 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:30:19.374626 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1edf3a1-bbff-40c0-9422-5fb166b4b39d admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:19.392072 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1edf3a1-bbff-40c0-9422-5fb166b4b39d admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:19.401501 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e8239d-5ec9-46c1-b266-54d656bbfb04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:19.403564 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e8239d-5ec9-46c1-b266-54d656bbfb04 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:19.405193 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e8239d-5ec9-46c1-b266-54d656bbfb04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:19.407189 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e8239d-5ec9-46c1-b266-54d656bbfb04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:19.408605 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e8239d-5ec9-46c1-b266-54d656bbfb04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:19.411604 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e8239d-5ec9-46c1-b266-54d656bbfb04 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:19.439742 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 866/1739] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:30:19 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:30:19.444493 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab5aa2-7de2-4bd9-b81c-5b41c07e0a82 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:19.464688 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab5aa2-7de2-4bd9-b81c-5b41c07e0a82 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:19.472645 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e8239d-5ec9-46c1-b266-54d656bbfb04 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:19.474443 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-e3e8239d-5ec9-46c1-b266-54d656bbfb04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:19.493521 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5011153-f6e0-437a-9ac6-fe4b2b754534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:19.493521 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5011153-f6e0-437a-9ac6-fe4b2b754534 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:19.493521 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5011153-f6e0-437a-9ac6-fe4b2b754534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:19.514339 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5011153-f6e0-437a-9ac6-fe4b2b754534 admin admin] PATH_INFO: `/v3/projects/df4ef64a723c4d5c947a68c5ab4e0daf/users/de093098f4154dc58a245452d3e6590c/roles/e04fe3eb1f714d74901ac83e33ea8a16` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:19.525844 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e8239d-5ec9-46c1-b266-54d656bbfb04 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:19.548366 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5c7061-fd44-470d-9454-c5683243cf94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:19.552223 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5011153-f6e0-437a-9ac6-fe4b2b754534 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df4ef64a723c4d5c947a68c5ab4e0daf, user_id=de093098f4154dc58a245452d3e6590c, role_id=e04fe3eb1f714d74901ac83e33ea8a16)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:19.556431 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c7061-fd44-470d-9454-c5683243cf94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:19.556431 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c7061-fd44-470d-9454-c5683243cf94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:19.556431 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c7061-fd44-470d-9454-c5683243cf94 admin admin] PATH_INFO: `/v3/projects/e71a743c256a4a9b91acb075079af933` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:19.556431 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5c7061-fd44-470d-9454-c5683243cf94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e71a743c256a4a9b91acb075079af933)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:19.557432 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5011153-f6e0-437a-9ac6-fe4b2b754534 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:19.560204 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5c7061-fd44-470d-9454-c5683243cf94 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:19.816707 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 874/1740] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:30:19 2022] PUT /identity/v3/projects/df4ef64a723c4d5c947a68c5ab4e0daf/users/de093098f4154dc58a245452d3e6590c/roles/e04fe3eb1f714d74901ac83e33ea8a16 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:30:19.818676 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5011153-f6e0-437a-9ac6-fe4b2b754534 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:19.825520 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-b5011153-f6e0-437a-9ac6-fe4b2b754534 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:19.847233 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-bf5c7061-fd44-470d-9454-c5683243cf94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e71a743c256a4a9b91acb075079af933', 'request_id': 'req-bf5c7061-fd44-470d-9454-c5683243cf94'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:19.877872 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-bf5c7061-fd44-470d-9454-c5683243cf94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e71a743c256a4a9b91acb075079af933', 'request_id': 'req-bf5c7061-fd44-470d-9454-c5683243cf94'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:19.896259 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-bf5c7061-fd44-470d-9454-c5683243cf94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e71a743c256a4a9b91acb075079af933', 'request_id': 'req-bf5c7061-fd44-470d-9454-c5683243cf94'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:19.987796 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5011153-f6e0-437a-9ac6-fe4b2b754534 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:20.059746 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-bf5c7061-fd44-470d-9454-c5683243cf94 admin admin] The token cache is being invalidate because project e71a743c256a4a9b91acb075079af933 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80288) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:30:20.060463 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-bf5c7061-fd44-470d-9454-c5683243cf94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:20.061318 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-bf5c7061-fd44-470d-9454-c5683243cf94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:20.070518 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 867/1741] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:30:19 2022] DELETE /identity/v3/projects/e71a743c256a4a9b91acb075079af933 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:30:20.077519 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5c7061-fd44-470d-9454-c5683243cf94 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:20.077519 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-bf5c7061-fd44-470d-9454-c5683243cf94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:20.107648 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d5010-1c47-4e50-b4e3-b8fe7d4932d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb13ad6d8b1e46029262556bff398796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:20.108113 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d5010-1c47-4e50-b4e3-b8fe7d4932d6 service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:20.108498 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d5010-1c47-4e50-b4e3-b8fe7d4932d6 service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:20.108761 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d5010-1c47-4e50-b4e3-b8fe7d4932d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:20.119593 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-451d5010-1c47-4e50-b4e3-b8fe7d4932d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:20.143066 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451d5010-1c47-4e50-b4e3-b8fe7d4932d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:20.144928 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451d5010-1c47-4e50-b4e3-b8fe7d4932d6 service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:20.173719 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 875/1742] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:30:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:30:20.178269 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d5010-1c47-4e50-b4e3-b8fe7d4932d6 service nova] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:20.183144 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-451d5010-1c47-4e50-b4e3-b8fe7d4932d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:20.348688 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d5010-1c47-4e50-b4e3-b8fe7d4932d6 service nova] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:20.353839 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5c7061-fd44-470d-9454-c5683243cf94 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:20.368567 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa9fa0a-247c-4c3e-8bdb-f77bb681c7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:20.369102 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1bc706-5553-4f9a-8efb-e7bbf6a18d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:20.370022 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1bc706-5553-4f9a-8efb-e7bbf6a18d14 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:20.370397 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa9fa0a-247c-4c3e-8bdb-f77bb681c7fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:20.370500 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1bc706-5553-4f9a-8efb-e7bbf6a18d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:20.370859 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1bc706-5553-4f9a-8efb-e7bbf6a18d14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:20.371463 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa9fa0a-247c-4c3e-8bdb-f77bb681c7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:20.371921 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa9fa0a-247c-4c3e-8bdb-f77bb681c7fd admin admin] PATH_INFO: `/v3/users/672994d1835f411eb643e694f05e0b0a` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:20.372250 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1bc706-5553-4f9a-8efb-e7bbf6a18d14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:20.373936 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa9fa0a-247c-4c3e-8bdb-f77bb681c7fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=672994d1835f411eb643e694f05e0b0a)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:20.374692 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1bc706-5553-4f9a-8efb-e7bbf6a18d14 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:20.376610 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa9fa0a-247c-4c3e-8bdb-f77bb681c7fd admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:20.430285 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 876/1743] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:30:20 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:30:20.431448 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1bc706-5553-4f9a-8efb-e7bbf6a18d14 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:20.439022 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-1e1bc706-5553-4f9a-8efb-e7bbf6a18d14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:20.480780 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1bc706-5553-4f9a-8efb-e7bbf6a18d14 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:20.497303 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50698e58-a4e1-4a35-8aba-2a07ccc20878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:20.498224 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50698e58-a4e1-4a35-8aba-2a07ccc20878 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:20.498566 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50698e58-a4e1-4a35-8aba-2a07ccc20878 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:20.498884 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50698e58-a4e1-4a35-8aba-2a07ccc20878 admin admin] PATH_INFO: `/v3/users/f3dc7eec10374695a35ee0072b876af1` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:20.501076 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50698e58-a4e1-4a35-8aba-2a07ccc20878 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3dc7eec10374695a35ee0072b876af1)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:20.504421 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50698e58-a4e1-4a35-8aba-2a07ccc20878 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:20.872531 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-dfa9fa0a-247c-4c3e-8bdb-f77bb681c7fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '672994d1835f411eb643e694f05e0b0a'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:20.912370 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-dfa9fa0a-247c-4c3e-8bdb-f77bb681c7fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '672994d1835f411eb643e694f05e0b0a'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:20.913160 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-dfa9fa0a-247c-4c3e-8bdb-f77bb681c7fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '672994d1835f411eb643e694f05e0b0a'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:20.913965 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-dfa9fa0a-247c-4c3e-8bdb-f77bb681c7fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '672994d1835f411eb643e694f05e0b0a'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:21.153409 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-dfa9fa0a-247c-4c3e-8bdb-f77bb681c7fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '672994d1835f411eb643e694f05e0b0a'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:21.174926 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-50698e58-a4e1-4a35-8aba-2a07ccc20878 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3dc7eec10374695a35ee0072b876af1'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:21.190073 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 868/1744] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:30:20 2022] DELETE /identity/v3/users/672994d1835f411eb643e694f05e0b0a => generated 0 bytes in 1119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:30:21.190993 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa9fa0a-247c-4c3e-8bdb-f77bb681c7fd admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:21.194394 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-50698e58-a4e1-4a35-8aba-2a07ccc20878 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3dc7eec10374695a35ee0072b876af1'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:21.194787 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-dfa9fa0a-247c-4c3e-8bdb-f77bb681c7fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:21.195278 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-50698e58-a4e1-4a35-8aba-2a07ccc20878 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3dc7eec10374695a35ee0072b876af1'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:21.197006 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-50698e58-a4e1-4a35-8aba-2a07ccc20878 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3dc7eec10374695a35ee0072b876af1'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:21.306937 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa9fa0a-247c-4c3e-8bdb-f77bb681c7fd admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:21.312668 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfe1406-9699-4630-a711-e6849e130026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:21.313580 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfe1406-9699-4630-a711-e6849e130026 admin admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:21.313921 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfe1406-9699-4630-a711-e6849e130026 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:21.314199 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfe1406-9699-4630-a711-e6849e130026 admin admin] PATH_INFO: `/v3/projects/df4ef64a723c4d5c947a68c5ab4e0daf/users/de093098f4154dc58a245452d3e6590c/roles/e04fe3eb1f714d74901ac83e33ea8a16` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:21.316302 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfe1406-9699-4630-a711-e6849e130026 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df4ef64a723c4d5c947a68c5ab4e0daf, user_id=de093098f4154dc58a245452d3e6590c, role_id=e04fe3eb1f714d74901ac83e33ea8a16)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:21.319214 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfe1406-9699-4630-a711-e6849e130026 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:21.334337 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 869/1745] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:30:21 2022] PUT /identity/v3/projects/df4ef64a723c4d5c947a68c5ab4e0daf/users/de093098f4154dc58a245452d3e6590c/roles/e04fe3eb1f714d74901ac83e33ea8a16 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:30:21.338850 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a835b-6503-4fad-80a9-1b174c89308e None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:21.338850 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a835b-6503-4fad-80a9-1b174c89308e None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:21.338850 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a835b-6503-4fad-80a9-1b174c89308e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:21.369165 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-50698e58-a4e1-4a35-8aba-2a07ccc20878 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3dc7eec10374695a35ee0072b876af1'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:21.376294 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-745a835b-6503-4fad-80a9-1b174c89308e None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:21.379059 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-745a835b-6503-4fad-80a9-1b174c89308e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:21.417851 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 877/1746] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:30:20 2022] DELETE /identity/v3/users/f3dc7eec10374695a35ee0072b876af1 => generated 0 bytes in 989 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:30:21.460444 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:30:21.497645 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 870/1747] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:30:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:30:21.565362 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50698e58-a4e1-4a35-8aba-2a07ccc20878 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:21.566976 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-50698e58-a4e1-4a35-8aba-2a07ccc20878 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:21.681703 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50698e58-a4e1-4a35-8aba-2a07ccc20878 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:21.698310 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76b09cd-d95f-4915-aa2a-e68a69b7bd4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:21.699900 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b09cd-d95f-4915-aa2a-e68a69b7bd4a service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:21.701349 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b09cd-d95f-4915-aa2a-e68a69b7bd4a service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:21.702803 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b09cd-d95f-4915-aa2a-e68a69b7bd4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:21.753566 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:30:21.890601 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76b09cd-d95f-4915-aa2a-e68a69b7bd4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:21.893447 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76b09cd-d95f-4915-aa2a-e68a69b7bd4a service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:21.922320 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 878/1748] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:30:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:30:22.300658 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04963bae-9b1b-4c72-9aa2-c275fa69cd1a None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:22.301305 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04963bae-9b1b-4c72-9aa2-c275fa69cd1a None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:22.301597 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04963bae-9b1b-4c72-9aa2-c275fa69cd1a None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:22.304934 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 871/1749] 10.222.0.62 () {54 vars in 921 bytes} [Fri May 27 16:30:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:30:22.334338 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba9cfd-f92c-48cf-a25d-3dda20255373 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:22.334660 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba9cfd-f92c-48cf-a25d-3dda20255373 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:22.334954 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba9cfd-f92c-48cf-a25d-3dda20255373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:22.375737 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-b6ba9cfd-f92c-48cf-a25d-3dda20255373 None None] MFA Rules not processed for user `cb13ad6d8b1e46029262556bff398796`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:22.378715 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-b6ba9cfd-f92c-48cf-a25d-3dda20255373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:22.510899 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04963bae-9b1b-4c72-9aa2-c275fa69cd1a None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:22.513138 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-04963bae-9b1b-4c72-9aa2-c275fa69cd1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:22.552234 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04963bae-9b1b-4c72-9aa2-c275fa69cd1a None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:22.564654 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ff791d-9032-4992-81fb-0cbc939722b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:22.569692 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff791d-9032-4992-81fb-0cbc939722b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:22.569917 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff791d-9032-4992-81fb-0cbc939722b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:22.570487 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff791d-9032-4992-81fb-0cbc939722b6 admin admin] PATH_INFO: `/v3/users/65be8ae124994561b8bc5e9bd693fe95` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:22.575205 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ff791d-9032-4992-81fb-0cbc939722b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65be8ae124994561b8bc5e9bd693fe95)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:22.595173 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ff791d-9032-4992-81fb-0cbc939722b6 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:22.595255 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 879/1750] 10.222.0.62 () {58 vars in 1018 bytes} [Fri May 27 16:30:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:30:22.602352 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081cb1f9-f90c-4e4d-8db9-02c5e5f0438a None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:22.604742 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081cb1f9-f90c-4e4d-8db9-02c5e5f0438a None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:22.604742 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081cb1f9-f90c-4e4d-8db9-02c5e5f0438a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:22.674542 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-081cb1f9-f90c-4e4d-8db9-02c5e5f0438a None None] MFA Rules not processed for user `820d152f8d5b45a2aca035e7cc2684ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:22.689587 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-081cb1f9-f90c-4e4d-8db9-02c5e5f0438a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:22.806984 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 880/1751] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:30:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:30:22.904727 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-e8ff791d-9032-4992-81fb-0cbc939722b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65be8ae124994561b8bc5e9bd693fe95'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:22.949310 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081cb1f9-f90c-4e4d-8db9-02c5e5f0438a None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:22.952285 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-081cb1f9-f90c-4e4d-8db9-02c5e5f0438a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:22.956745 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-e8ff791d-9032-4992-81fb-0cbc939722b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65be8ae124994561b8bc5e9bd693fe95'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:22.959029 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-e8ff791d-9032-4992-81fb-0cbc939722b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65be8ae124994561b8bc5e9bd693fe95'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:22.960247 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-e8ff791d-9032-4992-81fb-0cbc939722b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65be8ae124994561b8bc5e9bd693fe95'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:22.978463 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081cb1f9-f90c-4e4d-8db9-02c5e5f0438a None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:22.994153 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1774dd-b4b1-4353-81b5-d7ccc5355fb9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb13ad6d8b1e46029262556bff398796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:22.994876 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1774dd-b4b1-4353-81b5-d7ccc5355fb9 service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:22.995165 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1774dd-b4b1-4353-81b5-d7ccc5355fb9 service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:22.995446 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1774dd-b4b1-4353-81b5-d7ccc5355fb9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:23.001472 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-af1774dd-b4b1-4353-81b5-d7ccc5355fb9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:23.022177 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1774dd-b4b1-4353-81b5-d7ccc5355fb9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:23.023848 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1774dd-b4b1-4353-81b5-d7ccc5355fb9 service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:23.057785 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 881/1752] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:30:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:30:23.124246 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-e8ff791d-9032-4992-81fb-0cbc939722b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65be8ae124994561b8bc5e9bd693fe95'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:23.150301 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 872/1753] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:30:22 2022] DELETE /identity/v3/users/65be8ae124994561b8bc5e9bd693fe95 => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:30:23.152912 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0045bf1-360c-4df4-9d5a-a28f767eb312 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:23.153400 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0045bf1-360c-4df4-9d5a-a28f767eb312 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:23.153860 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0045bf1-360c-4df4-9d5a-a28f767eb312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:23.201215 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-f0045bf1-360c-4df4-9d5a-a28f767eb312 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:23.203906 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-f0045bf1-360c-4df4-9d5a-a28f767eb312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:23.351207 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 882/1754] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:30:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:30:23.377255 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ff791d-9032-4992-81fb-0cbc939722b6 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:23.378939 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-e8ff791d-9032-4992-81fb-0cbc939722b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:23.481198 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ff791d-9032-4992-81fb-0cbc939722b6 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:23.486851 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a901eb7-8532-405b-9dd4-2ac206c28894 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:23.488697 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a901eb7-8532-405b-9dd4-2ac206c28894 service neutron] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:23.489182 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a901eb7-8532-405b-9dd4-2ac206c28894 service neutron] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:23.489614 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a901eb7-8532-405b-9dd4-2ac206c28894 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:23.508551 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a901eb7-8532-405b-9dd4-2ac206c28894 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:23.522795 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a901eb7-8532-405b-9dd4-2ac206c28894 service neutron] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:23.539485 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 873/1755] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:30:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:30:23.704258 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0045bf1-360c-4df4-9d5a-a28f767eb312 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:23.705959 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-f0045bf1-360c-4df4-9d5a-a28f767eb312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:23.718396 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0045bf1-360c-4df4-9d5a-a28f767eb312 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:23.727404 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc34a91-2619-4427-91e4-4578087f981f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:23.728298 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc34a91-2619-4427-91e4-4578087f981f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:23.728644 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc34a91-2619-4427-91e4-4578087f981f admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:23.728932 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc34a91-2619-4427-91e4-4578087f981f admin admin] PATH_INFO: `/v3/projects/783a43312a194100a2bd36ff703d2867` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:23.735124 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc34a91-2619-4427-91e4-4578087f981f admin admin] RBAC: Authorizing `identity:delete_project(project_id=783a43312a194100a2bd36ff703d2867)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:23.741200 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc34a91-2619-4427-91e4-4578087f981f admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:23.793374 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a901eb7-8532-405b-9dd4-2ac206c28894 service neutron] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:23.795003 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-1a901eb7-8532-405b-9dd4-2ac206c28894 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:23.809614 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a901eb7-8532-405b-9dd4-2ac206c28894 service neutron] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:23.814460 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96cb4e3-a2ab-40b6-a7be-71edfe5ea4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:23.815924 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96cb4e3-a2ab-40b6-a7be-71edfe5ea4eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:23.817702 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96cb4e3-a2ab-40b6-a7be-71edfe5ea4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:23.817702 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96cb4e3-a2ab-40b6-a7be-71edfe5ea4eb admin admin] PATH_INFO: `/v3/projects/79e844ab0bc24e8db0332287eb1c4493` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:23.819882 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96cb4e3-a2ab-40b6-a7be-71edfe5ea4eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=79e844ab0bc24e8db0332287eb1c4493)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:23.822888 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96cb4e3-a2ab-40b6-a7be-71edfe5ea4eb admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:24.023551 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-9dc34a91-2619-4427-91e4-4578087f981f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '783a43312a194100a2bd36ff703d2867', 'request_id': 'req-9dc34a91-2619-4427-91e4-4578087f981f'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:24.030445 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-9dc34a91-2619-4427-91e4-4578087f981f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '783a43312a194100a2bd36ff703d2867', 'request_id': 'req-9dc34a91-2619-4427-91e4-4578087f981f'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:24.034023 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:30:24.060112 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-e96cb4e3-a2ab-40b6-a7be-71edfe5ea4eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79e844ab0bc24e8db0332287eb1c4493', 'request_id': 'req-e96cb4e3-a2ab-40b6-a7be-71edfe5ea4eb'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:24.070216 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-e96cb4e3-a2ab-40b6-a7be-71edfe5ea4eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79e844ab0bc24e8db0332287eb1c4493', 'request_id': 'req-e96cb4e3-a2ab-40b6-a7be-71edfe5ea4eb'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:24.080176 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-e96cb4e3-a2ab-40b6-a7be-71edfe5ea4eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79e844ab0bc24e8db0332287eb1c4493', 'request_id': 'req-e96cb4e3-a2ab-40b6-a7be-71edfe5ea4eb'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:24.175404 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-9dc34a91-2619-4427-91e4-4578087f981f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '783a43312a194100a2bd36ff703d2867', 'request_id': 'req-9dc34a91-2619-4427-91e4-4578087f981f'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:24.193757 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-9dc34a91-2619-4427-91e4-4578087f981f admin admin] The token cache is being invalidate because project 783a43312a194100a2bd36ff703d2867 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:30:24.194142 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-9dc34a91-2619-4427-91e4-4578087f981f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:24.194901 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-9dc34a91-2619-4427-91e4-4578087f981f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:24.196950 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 883/1756] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:30:23 2022] DELETE /identity/v3/projects/783a43312a194100a2bd36ff703d2867 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:30:24.201190 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d160c0-7642-4477-aeeb-cccfbfe3932f None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:24.201488 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d160c0-7642-4477-aeeb-cccfbfe3932f None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:24.201775 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d160c0-7642-4477-aeeb-cccfbfe3932f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:24.221464 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-06d160c0-7642-4477-aeeb-cccfbfe3932f None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:24.223294 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-06d160c0-7642-4477-aeeb-cccfbfe3932f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:24.285753 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-e96cb4e3-a2ab-40b6-a7be-71edfe5ea4eb admin admin] The token cache is being invalidate because project 79e844ab0bc24e8db0332287eb1c4493 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80288) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:30:24.286080 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-e96cb4e3-a2ab-40b6-a7be-71edfe5ea4eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:24.297822 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-e96cb4e3-a2ab-40b6-a7be-71edfe5ea4eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:24.314233 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 874/1757] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:30:23 2022] DELETE /identity/v3/projects/79e844ab0bc24e8db0332287eb1c4493 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:30:24.317109 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96cb4e3-a2ab-40b6-a7be-71edfe5ea4eb admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:24.325704 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-e96cb4e3-a2ab-40b6-a7be-71edfe5ea4eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:24.374677 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 884/1758] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:30:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:30:24.378747 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70969eb-71de-4e80-b230-7801572d707a None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:24.384324 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70969eb-71de-4e80-b230-7801572d707a None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:24.384998 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70969eb-71de-4e80-b230-7801572d707a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:24.429499 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-b70969eb-71de-4e80-b230-7801572d707a None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:24.430748 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-b70969eb-71de-4e80-b230-7801572d707a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:24.444586 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96cb4e3-a2ab-40b6-a7be-71edfe5ea4eb admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:24.449859 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 885/1759] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:30:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:30:24.450848 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70969eb-71de-4e80-b230-7801572d707a None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:24.454328 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-b70969eb-71de-4e80-b230-7801572d707a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:24.468262 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70969eb-71de-4e80-b230-7801572d707a None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:24.474336 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45582ce-69c5-4519-b408-03248f3c94f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:24.475225 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45582ce-69c5-4519-b408-03248f3c94f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:24.475515 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45582ce-69c5-4519-b408-03248f3c94f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:24.475844 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45582ce-69c5-4519-b408-03248f3c94f5 admin admin] PATH_INFO: `/v3/projects/96acd9463fd440428c11706bcb4c7e7c` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:24.477113 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45582ce-69c5-4519-b408-03248f3c94f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96acd9463fd440428c11706bcb4c7e7c)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:24.479028 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45582ce-69c5-4519-b408-03248f3c94f5 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:24.515380 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e8fae1-6234-41cd-ac61-75911adef87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:24.516309 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e8fae1-6234-41cd-ac61-75911adef87b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:24.522051 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e8fae1-6234-41cd-ac61-75911adef87b admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:24.522523 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e8fae1-6234-41cd-ac61-75911adef87b admin admin] PATH_INFO: `/v3/users/97898414cbfe4c498617ecafb5e8805a` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:24.529029 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e8fae1-6234-41cd-ac61-75911adef87b admin admin] RBAC: Authorizing `identity:delete_user(user_id=97898414cbfe4c498617ecafb5e8805a)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:24.535661 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e8fae1-6234-41cd-ac61-75911adef87b admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:24.609112 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-e45582ce-69c5-4519-b408-03248f3c94f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96acd9463fd440428c11706bcb4c7e7c', 'request_id': 'req-e45582ce-69c5-4519-b408-03248f3c94f5'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:24.616648 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-e45582ce-69c5-4519-b408-03248f3c94f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96acd9463fd440428c11706bcb4c7e7c', 'request_id': 'req-e45582ce-69c5-4519-b408-03248f3c94f5'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:24.792709 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-e45582ce-69c5-4519-b408-03248f3c94f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96acd9463fd440428c11706bcb4c7e7c', 'request_id': 'req-e45582ce-69c5-4519-b408-03248f3c94f5'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:24.807681 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-e45582ce-69c5-4519-b408-03248f3c94f5 admin admin] The token cache is being invalidate because project 96acd9463fd440428c11706bcb4c7e7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:30:24.807974 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-e45582ce-69c5-4519-b408-03248f3c94f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:24.808644 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-e45582ce-69c5-4519-b408-03248f3c94f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:24.810306 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 886/1760] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:30:24 2022] DELETE /identity/v3/projects/96acd9463fd440428c11706bcb4c7e7c => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:30:24.811080 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45582ce-69c5-4519-b408-03248f3c94f5 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:24.812997 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-e45582ce-69c5-4519-b408-03248f3c94f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:24.858063 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-79e8fae1-6234-41cd-ac61-75911adef87b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97898414cbfe4c498617ecafb5e8805a'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:24.870885 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-79e8fae1-6234-41cd-ac61-75911adef87b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97898414cbfe4c498617ecafb5e8805a'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:24.871763 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-79e8fae1-6234-41cd-ac61-75911adef87b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97898414cbfe4c498617ecafb5e8805a'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:24.872389 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-79e8fae1-6234-41cd-ac61-75911adef87b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97898414cbfe4c498617ecafb5e8805a'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:24.882663 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45582ce-69c5-4519-b408-03248f3c94f5 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:24.887349 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9139757c-e26c-4d13-9518-212111772ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:24.888013 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9139757c-e26c-4d13-9518-212111772ebe admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:24.888301 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9139757c-e26c-4d13-9518-212111772ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:24.888581 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9139757c-e26c-4d13-9518-212111772ebe admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:24.889309 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9139757c-e26c-4d13-9518-212111772ebe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:30:24.889625 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9139757c-e26c-4d13-9518-212111772ebe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:24.891277 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9139757c-e26c-4d13-9518-212111772ebe admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:24.905565 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 887/1761] 10.222.0.62 () {58 vars in 1152 bytes} [Fri May 27 16:30:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:30:24.906454 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9139757c-e26c-4d13-9518-212111772ebe admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:24.910628 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-9139757c-e26c-4d13-9518-212111772ebe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:24.924075 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9139757c-e26c-4d13-9518-212111772ebe admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:24.929771 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed63cfcd-a4a9-41e5-a0ec-3382e7a1a98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:24.930700 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed63cfcd-a4a9-41e5-a0ec-3382e7a1a98f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:24.930990 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed63cfcd-a4a9-41e5-a0ec-3382e7a1a98f admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:24.931274 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed63cfcd-a4a9-41e5-a0ec-3382e7a1a98f admin admin] PATH_INFO: `/v3/users/60d5dac0b85f40e28c29bae77f160457` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:24.932498 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed63cfcd-a4a9-41e5-a0ec-3382e7a1a98f admin admin] RBAC: Authorizing `identity:delete_user(user_id=60d5dac0b85f40e28c29bae77f160457)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:24.934509 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed63cfcd-a4a9-41e5-a0ec-3382e7a1a98f admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:25.061251 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-79e8fae1-6234-41cd-ac61-75911adef87b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97898414cbfe4c498617ecafb5e8805a'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:25.098053 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 875/1762] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:30:24 2022] DELETE /identity/v3/users/97898414cbfe4c498617ecafb5e8805a => generated 0 bytes in 781 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:30:25.099678 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e8fae1-6234-41cd-ac61-75911adef87b admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:25.103732 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-79e8fae1-6234-41cd-ac61-75911adef87b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:25.190540 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e8fae1-6234-41cd-ac61-75911adef87b admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:25.208247 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0da8e1b-0e4f-48a6-a804-38094c32eed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:25.208247 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0da8e1b-0e4f-48a6-a804-38094c32eed2 admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:25.208247 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0da8e1b-0e4f-48a6-a804-38094c32eed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:25.208247 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0da8e1b-0e4f-48a6-a804-38094c32eed2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:25.208657 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0da8e1b-0e4f-48a6-a804-38094c32eed2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:25.211206 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0da8e1b-0e4f-48a6-a804-38094c32eed2 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:25.311619 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 876/1763] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:30:25 2022] POST /identity/v3/projects => generated 375 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:30:25.313102 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e531a-7e51-40f1-817c-c249a53d6694 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:25.313404 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e531a-7e51-40f1-817c-c249a53d6694 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:25.313711 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e531a-7e51-40f1-817c-c249a53d6694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:25.325433 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-ed63cfcd-a4a9-41e5-a0ec-3382e7a1a98f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60d5dac0b85f40e28c29bae77f160457'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:25.340899 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-ed63cfcd-a4a9-41e5-a0ec-3382e7a1a98f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60d5dac0b85f40e28c29bae77f160457'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:25.340899 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-ed63cfcd-a4a9-41e5-a0ec-3382e7a1a98f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60d5dac0b85f40e28c29bae77f160457'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:25.347112 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-ed63cfcd-a4a9-41e5-a0ec-3382e7a1a98f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60d5dac0b85f40e28c29bae77f160457'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:25.360005 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:30:25.382220 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-661e531a-7e51-40f1-817c-c249a53d6694 None None] MFA Rules not processed for user `de093098f4154dc58a245452d3e6590c`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:25.383569 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-661e531a-7e51-40f1-817c-c249a53d6694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:25.477768 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-ed63cfcd-a4a9-41e5-a0ec-3382e7a1a98f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60d5dac0b85f40e28c29bae77f160457'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:25.499075 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 888/1764] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:30:24 2022] DELETE /identity/v3/users/60d5dac0b85f40e28c29bae77f160457 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:30:25.500172 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed63cfcd-a4a9-41e5-a0ec-3382e7a1a98f admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:25.501477 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-ed63cfcd-a4a9-41e5-a0ec-3382e7a1a98f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:25.521264 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 877/1765] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:30:25 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:30:25.650945 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed63cfcd-a4a9-41e5-a0ec-3382e7a1a98f admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:25.658660 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b47b8-058b-48d5-b898-8566d69a03cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:25.673560 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b47b8-058b-48d5-b898-8566d69a03cc admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:25.674184 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b47b8-058b-48d5-b898-8566d69a03cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:25.674601 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b47b8-058b-48d5-b898-8566d69a03cc admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:25.676290 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998b47b8-058b-48d5-b898-8566d69a03cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:25.681313 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998b47b8-058b-48d5-b898-8566d69a03cc admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:25.909718 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 889/1766] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:30:25 2022] POST /identity/v3/users => generated 288 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:30:25.920713 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e531a-7e51-40f1-817c-c249a53d6694 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:25.977713 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b47b8-058b-48d5-b898-8566d69a03cc admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:25.979598 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-998b47b8-058b-48d5-b898-8566d69a03cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:25.993785 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b47b8-058b-48d5-b898-8566d69a03cc admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:25.999601 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5fcc9f-1fd1-4317-8f9c-fbd5e46038fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:26.001386 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5fcc9f-1fd1-4317-8f9c-fbd5e46038fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:26.001987 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5fcc9f-1fd1-4317-8f9c-fbd5e46038fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:26.002544 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5fcc9f-1fd1-4317-8f9c-fbd5e46038fd admin admin] PATH_INFO: `/v3/projects/826813d5ba914cc48881b2c5818b33f6` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:26.004593 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5fcc9f-1fd1-4317-8f9c-fbd5e46038fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=826813d5ba914cc48881b2c5818b33f6)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:26.006294 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e531a-7e51-40f1-817c-c249a53d6694 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:26.008226 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5fcc9f-1fd1-4317-8f9c-fbd5e46038fd admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:26.016628 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d88642a-1aaa-4e39-b28f-3663bb9d13ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:26.017406 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88642a-1aaa-4e39-b28f-3663bb9d13ad admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:26.017700 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88642a-1aaa-4e39-b28f-3663bb9d13ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:26.017982 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88642a-1aaa-4e39-b28f-3663bb9d13ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:26.019089 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d88642a-1aaa-4e39-b28f-3663bb9d13ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:26.022311 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d88642a-1aaa-4e39-b28f-3663bb9d13ad admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:26.037248 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 878/1767] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:30:25 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:30:26.041407 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d88642a-1aaa-4e39-b28f-3663bb9d13ad admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:26.054409 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d88642a-1aaa-4e39-b28f-3663bb9d13ad admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:26.060998 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e74761-47ee-48fa-ab92-1632011b0414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:26.060998 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e74761-47ee-48fa-ab92-1632011b0414 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:26.060998 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e74761-47ee-48fa-ab92-1632011b0414 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:26.060998 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e74761-47ee-48fa-ab92-1632011b0414 admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:26.061790 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e74761-47ee-48fa-ab92-1632011b0414 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:26.063493 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e74761-47ee-48fa-ab92-1632011b0414 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:26.080184 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 879/1768] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:30:26 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 16:30:26.081617 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e74761-47ee-48fa-ab92-1632011b0414 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:26.095090 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e74761-47ee-48fa-ab92-1632011b0414 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:26.103359 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11378bf-4b15-43a2-9928-b540ed12ef91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:26.105512 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11378bf-4b15-43a2-9928-b540ed12ef91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:26.106274 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11378bf-4b15-43a2-9928-b540ed12ef91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:26.110992 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11378bf-4b15-43a2-9928-b540ed12ef91 admin admin] PATH_INFO: `/v3/projects/a17442805f6f4f72b37352c7746941d3/users/f5d5435c39d64dcebac4afb2e7242b85/roles/c8ce6d197f654598ac45f6016ecccabd` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:26.148511 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11378bf-4b15-43a2-9928-b540ed12ef91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a17442805f6f4f72b37352c7746941d3, user_id=f5d5435c39d64dcebac4afb2e7242b85, role_id=c8ce6d197f654598ac45f6016ecccabd)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:26.150875 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11378bf-4b15-43a2-9928-b540ed12ef91 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:26.274627 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 880/1769] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:30:26 2022] PUT /identity/v3/projects/a17442805f6f4f72b37352c7746941d3/users/f5d5435c39d64dcebac4afb2e7242b85/roles/c8ce6d197f654598ac45f6016ecccabd => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:30:26.276298 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e1c23-4d5e-4d5f-9580-2c58b81e9977 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:26.277297 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e1c23-4d5e-4d5f-9580-2c58b81e9977 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:26.280350 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e1c23-4d5e-4d5f-9580-2c58b81e9977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:26.292591 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-cd5fcc9f-1fd1-4317-8f9c-fbd5e46038fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '826813d5ba914cc48881b2c5818b33f6', 'request_id': 'req-cd5fcc9f-1fd1-4317-8f9c-fbd5e46038fd'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:26.301777 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-cd5fcc9f-1fd1-4317-8f9c-fbd5e46038fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '826813d5ba914cc48881b2c5818b33f6', 'request_id': 'req-cd5fcc9f-1fd1-4317-8f9c-fbd5e46038fd'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:26.335751 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-b52e1c23-4d5e-4d5f-9580-2c58b81e9977 None None] MFA Rules not processed for user `f5d5435c39d64dcebac4afb2e7242b85`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:26.338838 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-b52e1c23-4d5e-4d5f-9580-2c58b81e9977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:26.382802 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-cd5fcc9f-1fd1-4317-8f9c-fbd5e46038fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '826813d5ba914cc48881b2c5818b33f6', 'request_id': 'req-cd5fcc9f-1fd1-4317-8f9c-fbd5e46038fd'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:26.406644 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-cd5fcc9f-1fd1-4317-8f9c-fbd5e46038fd admin admin] The token cache is being invalidate because project 826813d5ba914cc48881b2c5818b33f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:30:26.407106 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-cd5fcc9f-1fd1-4317-8f9c-fbd5e46038fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:26.411492 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-cd5fcc9f-1fd1-4317-8f9c-fbd5e46038fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:26.414381 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 890/1770] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:30:25 2022] DELETE /identity/v3/projects/826813d5ba914cc48881b2c5818b33f6 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:30:26.420390 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daadc3b-2e2e-48f0-86ee-be03c7bd2179 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:26.420909 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daadc3b-2e2e-48f0-86ee-be03c7bd2179 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:26.421340 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daadc3b-2e2e-48f0-86ee-be03c7bd2179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:26.448660 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-3daadc3b-2e2e-48f0-86ee-be03c7bd2179 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:26.452351 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-3daadc3b-2e2e-48f0-86ee-be03c7bd2179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:26.466151 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 881/1771] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:30:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:30:26.471217 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52e1c23-4d5e-4d5f-9580-2c58b81e9977 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:26.475681 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-b52e1c23-4d5e-4d5f-9580-2c58b81e9977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:26.588351 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 891/1772] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:30:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:30:26.589980 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0752481-531b-4917-bf77-f8df4825a4ee None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:26.590410 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0752481-531b-4917-bf77-f8df4825a4ee None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:26.590794 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0752481-531b-4917-bf77-f8df4825a4ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:26.609570 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52e1c23-4d5e-4d5f-9580-2c58b81e9977 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:26.613281 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-c0752481-531b-4917-bf77-f8df4825a4ee None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:26.614894 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-c0752481-531b-4917-bf77-f8df4825a4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:26.620969 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c83edd-e38f-484a-8308-b51502c72846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:26.621658 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c83edd-e38f-484a-8308-b51502c72846 admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:26.621940 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c83edd-e38f-484a-8308-b51502c72846 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:26.622217 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c83edd-e38f-484a-8308-b51502c72846 admin admin] PATH_INFO: `/v3/projects` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:26.625468 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c83edd-e38f-484a-8308-b51502c72846 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:26.631260 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c83edd-e38f-484a-8308-b51502c72846 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:26.637223 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 892/1773] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:30:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:30:26.641042 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0752481-531b-4917-bf77-f8df4825a4ee None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:26.652362 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0752481-531b-4917-bf77-f8df4825a4ee None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:26.658892 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eed004-66fb-42f1-9d47-525e6eca42ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:26.660377 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eed004-66fb-42f1-9d47-525e6eca42ed admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:26.660979 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eed004-66fb-42f1-9d47-525e6eca42ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:26.661373 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eed004-66fb-42f1-9d47-525e6eca42ed admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:26.662223 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eed004-66fb-42f1-9d47-525e6eca42ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:30:26.663502 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eed004-66fb-42f1-9d47-525e6eca42ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:26.664962 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eed004-66fb-42f1-9d47-525e6eca42ed admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:26.681041 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 893/1774] 10.222.0.62 () {58 vars in 1152 bytes} [Fri May 27 16:30:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:30:26.685106 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eed004-66fb-42f1-9d47-525e6eca42ed admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:26.697105 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eed004-66fb-42f1-9d47-525e6eca42ed admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:26.718410 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6757f09-c0d0-4e03-b28e-1d6605635648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:26.719146 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6757f09-c0d0-4e03-b28e-1d6605635648 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:26.719437 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6757f09-c0d0-4e03-b28e-1d6605635648 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:26.719722 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6757f09-c0d0-4e03-b28e-1d6605635648 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:26.720422 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6757f09-c0d0-4e03-b28e-1d6605635648 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:26.723023 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6757f09-c0d0-4e03-b28e-1d6605635648 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:26.832755 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 882/1775] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:30:26 2022] POST /identity/v3/projects => generated 375 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:30:26.833692 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c83edd-e38f-484a-8308-b51502c72846 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:26.942811 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 894/1776] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:30:26 2022] POST /identity/v3/projects => generated 385 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:30:26.947885 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6757f09-c0d0-4e03-b28e-1d6605635648 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:27.005560 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c83edd-e38f-484a-8308-b51502c72846 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:27.122048 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6757f09-c0d0-4e03-b28e-1d6605635648 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:27.128015 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b8c332-e49e-434a-939e-afb210cac065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:27.128972 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b8c332-e49e-434a-939e-afb210cac065 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:27.139641 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b8c332-e49e-434a-939e-afb210cac065 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:27.140417 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b8c332-e49e-434a-939e-afb210cac065 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:27.141039 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df61e913-36a6-4fd6-ae20-3ef3ec96c430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:27.141548 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b8c332-e49e-434a-939e-afb210cac065 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:27.141729 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61e913-36a6-4fd6-ae20-3ef3ec96c430 admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:27.142021 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61e913-36a6-4fd6-ae20-3ef3ec96c430 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:27.142334 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61e913-36a6-4fd6-ae20-3ef3ec96c430 admin admin] PATH_INFO: `/v3/users` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:27.143038 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df61e913-36a6-4fd6-ae20-3ef3ec96c430 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:27.144907 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b8c332-e49e-434a-939e-afb210cac065 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:27.145211 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df61e913-36a6-4fd6-ae20-3ef3ec96c430 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:27.262406 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 883/1777] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:30:26 2022] POST /identity/v3/users => generated 294 bytes in 429 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:30:27.263803 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a894d0-b76e-4f62-9919-e30ca8cabf8c None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:27.264157 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a894d0-b76e-4f62-9919-e30ca8cabf8c None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:27.264499 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a894d0-b76e-4f62-9919-e30ca8cabf8c None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:27.266359 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 884/1778] 10.222.0.62 () {54 vars in 921 bytes} [Fri May 27 16:30:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:30:27.267207 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a894d0-b76e-4f62-9919-e30ca8cabf8c None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:27.268850 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-06a894d0-b76e-4f62-9919-e30ca8cabf8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:27.286003 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a894d0-b76e-4f62-9919-e30ca8cabf8c None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:27.291257 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a532b42d-35fa-4203-bbb1-6970b67ae25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:27.292180 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a532b42d-35fa-4203-bbb1-6970b67ae25d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:27.292464 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a532b42d-35fa-4203-bbb1-6970b67ae25d admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:27.292742 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a532b42d-35fa-4203-bbb1-6970b67ae25d admin admin] PATH_INFO: `/v3/projects/6db27eed3e5144f881eeec8c78befbf1` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:27.294665 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a532b42d-35fa-4203-bbb1-6970b67ae25d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6db27eed3e5144f881eeec8c78befbf1)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:27.297009 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a532b42d-35fa-4203-bbb1-6970b67ae25d admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:27.306902 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 895/1779] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:30:26 2022] POST /identity/v3/users => generated 293 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:30:27.308845 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b8c332-e49e-434a-939e-afb210cac065 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:27.325201 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b8c332-e49e-434a-939e-afb210cac065 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:27.333539 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f314b361-87f1-423b-a38b-5b0d82b53703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:27.334526 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f314b361-87f1-423b-a38b-5b0d82b53703 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:27.334906 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f314b361-87f1-423b-a38b-5b0d82b53703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:27.335257 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f314b361-87f1-423b-a38b-5b0d82b53703 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:27.336113 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f314b361-87f1-423b-a38b-5b0d82b53703 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:27.337921 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f314b361-87f1-423b-a38b-5b0d82b53703 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:27.359087 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 896/1780] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:30:27 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:30:27.359087 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41cc8b5-2ea1-42e6-a1f7-1e01999bd006 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:27.359087 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41cc8b5-2ea1-42e6-a1f7-1e01999bd006 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:27.359087 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41cc8b5-2ea1-42e6-a1f7-1e01999bd006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:27.385960 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-e41cc8b5-2ea1-42e6-a1f7-1e01999bd006 None None] MFA Rules not processed for user `35d98c4a2af546d8b655d649d655f447`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:27.387248 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-e41cc8b5-2ea1-42e6-a1f7-1e01999bd006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:27.466604 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-a532b42d-35fa-4203-bbb1-6970b67ae25d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6db27eed3e5144f881eeec8c78befbf1', 'request_id': 'req-a532b42d-35fa-4203-bbb1-6970b67ae25d'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:27.469901 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:30:27.476164 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 897/1781] 10.222.0.62 () {58 vars in 1018 bytes} [Fri May 27 16:30:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:30:27.477016 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41cc8b5-2ea1-42e6-a1f7-1e01999bd006 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:27.483858 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-a532b42d-35fa-4203-bbb1-6970b67ae25d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6db27eed3e5144f881eeec8c78befbf1', 'request_id': 'req-a532b42d-35fa-4203-bbb1-6970b67ae25d'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:27.491162 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-a532b42d-35fa-4203-bbb1-6970b67ae25d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6db27eed3e5144f881eeec8c78befbf1', 'request_id': 'req-a532b42d-35fa-4203-bbb1-6970b67ae25d'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:27.494800 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41cc8b5-2ea1-42e6-a1f7-1e01999bd006 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:27.566450 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6560a98-537c-4b8d-9e35-84a5f7e1627f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:27.567080 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6560a98-537c-4b8d-9e35-84a5f7e1627f admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:27.567364 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6560a98-537c-4b8d-9e35-84a5f7e1627f admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:27.567640 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6560a98-537c-4b8d-9e35-84a5f7e1627f admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:27.568367 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6560a98-537c-4b8d-9e35-84a5f7e1627f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:27.570046 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6560a98-537c-4b8d-9e35-84a5f7e1627f admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:27.580735 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 898/1782] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:30:27 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:30:27.581399 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6560a98-537c-4b8d-9e35-84a5f7e1627f admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:27.591351 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6560a98-537c-4b8d-9e35-84a5f7e1627f admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:27.595990 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef3ba4d-d950-4acc-bdaf-623b04520f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:27.596906 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3ba4d-d950-4acc-bdaf-623b04520f3f admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:27.597222 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3ba4d-d950-4acc-bdaf-623b04520f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:27.598056 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3ba4d-d950-4acc-bdaf-623b04520f3f admin admin] PATH_INFO: `/v3/projects/58dab7f5a3b443259dac5fe54099d4ce/users/bd1478ceca7749d6b2dbab0eb05f59ae/roles/e04fe3eb1f714d74901ac83e33ea8a16` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:27.613642 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef3ba4d-d950-4acc-bdaf-623b04520f3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=58dab7f5a3b443259dac5fe54099d4ce, user_id=bd1478ceca7749d6b2dbab0eb05f59ae, role_id=e04fe3eb1f714d74901ac83e33ea8a16)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:27.616390 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef3ba4d-d950-4acc-bdaf-623b04520f3f admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:27.661243 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-a532b42d-35fa-4203-bbb1-6970b67ae25d admin admin] The token cache is being invalidate because project 6db27eed3e5144f881eeec8c78befbf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80288) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:30:27.661744 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-a532b42d-35fa-4203-bbb1-6970b67ae25d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:27.662155 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-a532b42d-35fa-4203-bbb1-6970b67ae25d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:27.663753 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 885/1783] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:30:27 2022] DELETE /identity/v3/projects/6db27eed3e5144f881eeec8c78befbf1 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:30:27.664525 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a532b42d-35fa-4203-bbb1-6970b67ae25d admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:27.666020 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-a532b42d-35fa-4203-bbb1-6970b67ae25d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:27.732594 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a532b42d-35fa-4203-bbb1-6970b67ae25d admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:27.737584 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8306d52e-f773-4764-9720-e9618a327087 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35d98c4a2af546d8b655d649d655f447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:27.738279 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8306d52e-f773-4764-9720-e9618a327087 service placement] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:27.738559 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8306d52e-f773-4764-9720-e9618a327087 service placement] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:27.738836 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8306d52e-f773-4764-9720-e9618a327087 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:27.740740 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-8306d52e-f773-4764-9720-e9618a327087 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:27.752421 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8306d52e-f773-4764-9720-e9618a327087 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:27.753995 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8306d52e-f773-4764-9720-e9618a327087 service placement] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:27.763891 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 886/1784] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:30:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:30:27.764672 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8306d52e-f773-4764-9720-e9618a327087 service placement] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:27.765976 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-8306d52e-f773-4764-9720-e9618a327087 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:27.782351 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8306d52e-f773-4764-9720-e9618a327087 service placement] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:27.787859 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5057a12-9616-4587-bc5f-cb2ad9f5edaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:27.788532 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5057a12-9616-4587-bc5f-cb2ad9f5edaf admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:27.788825 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5057a12-9616-4587-bc5f-cb2ad9f5edaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:27.789106 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5057a12-9616-4587-bc5f-cb2ad9f5edaf admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:27.789842 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5057a12-9616-4587-bc5f-cb2ad9f5edaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:27.791530 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5057a12-9616-4587-bc5f-cb2ad9f5edaf admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:27.802738 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 887/1785] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:30:27 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:30:27.809237 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8c111-bd0d-484b-a021-1d7ee1a82cfc None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:27.809595 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8c111-bd0d-484b-a021-1d7ee1a82cfc None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:27.809865 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8c111-bd0d-484b-a021-1d7ee1a82cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:27.829258 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-04a8c111-bd0d-484b-a021-1d7ee1a82cfc None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:27.830518 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-04a8c111-bd0d-484b-a021-1d7ee1a82cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:27.846918 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 888/1786] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:30:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:30:27.861847 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 899/1787] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:30:27 2022] PUT /identity/v3/projects/58dab7f5a3b443259dac5fe54099d4ce/users/bd1478ceca7749d6b2dbab0eb05f59ae/roles/e04fe3eb1f714d74901ac83e33ea8a16 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:30:27.864261 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a8c111-bd0d-484b-a021-1d7ee1a82cfc None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:27.869753 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c142dd70-516e-418b-98e3-25deda04a4c9 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:27.870425 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c142dd70-516e-418b-98e3-25deda04a4c9 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:27.871100 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c142dd70-516e-418b-98e3-25deda04a4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:27.882762 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a8c111-bd0d-484b-a021-1d7ee1a82cfc None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:27.899233 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-c142dd70-516e-418b-98e3-25deda04a4c9 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:27.901747 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-c142dd70-516e-418b-98e3-25deda04a4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:27.963870 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a4ddd6-ce36-4480-9ac2-e579f9d762b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:27.964087 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4ddd6-ce36-4480-9ac2-e579f9d762b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:27.964339 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4ddd6-ce36-4480-9ac2-e579f9d762b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:27.964619 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4ddd6-ce36-4480-9ac2-e579f9d762b5 admin admin] PATH_INFO: `/v3/projects/0ddb694cefc34a4c9155787818965b2b/users/048ec9a12a774d0c930e327ed7dae60a/roles/c8ce6d197f654598ac45f6016ecccabd` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:27.984939 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a4ddd6-ce36-4480-9ac2-e579f9d762b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ddb694cefc34a4c9155787818965b2b, user_id=048ec9a12a774d0c930e327ed7dae60a, role_id=c8ce6d197f654598ac45f6016ecccabd)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:27.988295 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a4ddd6-ce36-4480-9ac2-e579f9d762b5 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:27.992653 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 900/1788] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:30:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:30:27.995264 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c142dd70-516e-418b-98e3-25deda04a4c9 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:28.001088 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-c142dd70-516e-418b-98e3-25deda04a4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:28.036743 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c142dd70-516e-418b-98e3-25deda04a4c9 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:28.040682 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:30:28.051545 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42819a5-5c01-41ee-9118-686be08ad971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:28.052234 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42819a5-5c01-41ee-9118-686be08ad971 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:28.052518 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42819a5-5c01-41ee-9118-686be08ad971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:28.052836 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42819a5-5c01-41ee-9118-686be08ad971 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:28.053573 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42819a5-5c01-41ee-9118-686be08ad971 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:28.055187 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42819a5-5c01-41ee-9118-686be08ad971 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:28.079936 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 889/1789] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:30:27 2022] PUT /identity/v3/projects/0ddb694cefc34a4c9155787818965b2b/users/048ec9a12a774d0c930e327ed7dae60a/roles/c8ce6d197f654598ac45f6016ecccabd => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:30:28.080513 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a4ddd6-ce36-4480-9ac2-e579f9d762b5 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:28.088644 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 901/1790] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:30:27 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:30:28.099832 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42819a5-5c01-41ee-9118-686be08ad971 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:28.146225 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42819a5-5c01-41ee-9118-686be08ad971 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:28.169974 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a4ddd6-ce36-4480-9ac2-e579f9d762b5 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:28.187517 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce31b7c-e717-422f-a1cf-6d67daffc849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:28.192215 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce31b7c-e717-422f-a1cf-6d67daffc849 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:28.192215 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce31b7c-e717-422f-a1cf-6d67daffc849 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:28.192215 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce31b7c-e717-422f-a1cf-6d67daffc849 admin admin] PATH_INFO: `/v3/domains` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:28.192215 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce31b7c-e717-422f-a1cf-6d67daffc849 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:30:28.192215 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce31b7c-e717-422f-a1cf-6d67daffc849 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:28.194153 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce31b7c-e717-422f-a1cf-6d67daffc849 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:28.226863 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 890/1791] 10.222.0.62 () {58 vars in 1152 bytes} [Fri May 27 16:30:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:30:28.228949 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a973bb3-9b30-4b30-90a4-89d24367e2cf None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:28.229100 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a973bb3-9b30-4b30-90a4-89d24367e2cf None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:28.229300 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a973bb3-9b30-4b30-90a4-89d24367e2cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:28.303922 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48893249-1daf-434a-abc4-99f22d5d7244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:28.305429 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48893249-1daf-434a-abc4-99f22d5d7244 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:28.305950 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48893249-1daf-434a-abc4-99f22d5d7244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:28.306687 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48893249-1daf-434a-abc4-99f22d5d7244 admin admin] PATH_INFO: `/v3/projects/58dab7f5a3b443259dac5fe54099d4ce/users/bd1478ceca7749d6b2dbab0eb05f59ae/roles/e04fe3eb1f714d74901ac83e33ea8a16` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:28.310053 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48893249-1daf-434a-abc4-99f22d5d7244 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58dab7f5a3b443259dac5fe54099d4ce, user_id=bd1478ceca7749d6b2dbab0eb05f59ae, role_id=e04fe3eb1f714d74901ac83e33ea8a16)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:28.314033 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-9a973bb3-9b30-4b30-90a4-89d24367e2cf None None] MFA Rules not processed for user `048ec9a12a774d0c930e327ed7dae60a`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:28.318334 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-9a973bb3-9b30-4b30-90a4-89d24367e2cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:28.318604 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48893249-1daf-434a-abc4-99f22d5d7244 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:28.328287 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 902/1792] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:30:28 2022] PUT /identity/v3/projects/58dab7f5a3b443259dac5fe54099d4ce/users/bd1478ceca7749d6b2dbab0eb05f59ae/roles/e04fe3eb1f714d74901ac83e33ea8a16 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:30:28.329749 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48893249-1daf-434a-abc4-99f22d5d7244 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:28.428559 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 891/1793] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:30:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:30:28.428559 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5662a4-2721-4efc-a0e2-8b10a80fe074 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:28.428559 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5662a4-2721-4efc-a0e2-8b10a80fe074 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:28.428559 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5662a4-2721-4efc-a0e2-8b10a80fe074 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:28.430366 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 892/1794] 10.222.0.62 () {54 vars in 921 bytes} [Fri May 27 16:30:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:30:28.433067 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8448276c-3004-41be-beb5-3a628bd5fea2 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:28.436477 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8448276c-3004-41be-beb5-3a628bd5fea2 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:28.436932 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8448276c-3004-41be-beb5-3a628bd5fea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:28.446295 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48893249-1daf-434a-abc4-99f22d5d7244 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:28.463320 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f30a3-f01e-44b9-bde0-73eee6d0cb4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:28.464140 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f30a3-f01e-44b9-bde0-73eee6d0cb4b admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:28.464448 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f30a3-f01e-44b9-bde0-73eee6d0cb4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:28.464704 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f30a3-f01e-44b9-bde0-73eee6d0cb4b admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:28.465509 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3f30a3-f01e-44b9-bde0-73eee6d0cb4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:28.468540 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3f30a3-f01e-44b9-bde0-73eee6d0cb4b admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:28.474287 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-8448276c-3004-41be-beb5-3a628bd5fea2 None None] MFA Rules not processed for user `bd1478ceca7749d6b2dbab0eb05f59ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:28.479803 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-8448276c-3004-41be-beb5-3a628bd5fea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:28.579110 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 893/1795] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:30:28 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:30:28.580207 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8448276c-3004-41be-beb5-3a628bd5fea2 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:28.592124 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8448276c-3004-41be-beb5-3a628bd5fea2 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:28.597020 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b020ae5c-ac33-4060-b7de-ccda0f2b74bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:28.598205 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020ae5c-ac33-4060-b7de-ccda0f2b74bf admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:28.598520 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020ae5c-ac33-4060-b7de-ccda0f2b74bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:28.598799 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020ae5c-ac33-4060-b7de-ccda0f2b74bf admin admin] PATH_INFO: `/v3/projects` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:28.599529 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b020ae5c-ac33-4060-b7de-ccda0f2b74bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:28.601474 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b020ae5c-ac33-4060-b7de-ccda0f2b74bf admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:28.660634 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 903/1796] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:30:28 2022] POST /identity/v3/projects => generated 399 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:30:28.662347 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf64c87-0c83-4b1d-aae4-6d0aec80e8c0 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:28.662711 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf64c87-0c83-4b1d-aae4-6d0aec80e8c0 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:28.663061 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf64c87-0c83-4b1d-aae4-6d0aec80e8c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:28.683780 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-acf64c87-0c83-4b1d-aae4-6d0aec80e8c0 None None] MFA Rules not processed for user `35d98c4a2af546d8b655d649d655f447`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:28.685312 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-acf64c87-0c83-4b1d-aae4-6d0aec80e8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:28.777397 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 904/1797] 10.222.0.62 () {58 vars in 1018 bytes} [Fri May 27 16:30:28 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:30:28.778348 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf64c87-0c83-4b1d-aae4-6d0aec80e8c0 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:28.780473 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 894/1798] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:30:28 2022] POST /identity/v3/projects => generated 387 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:30:28.782715 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b020ae5c-ac33-4060-b7de-ccda0f2b74bf admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:28.782941 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-acf64c87-0c83-4b1d-aae4-6d0aec80e8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:28.811366 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-b020ae5c-ac33-4060-b7de-ccda0f2b74bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:28.889856 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf64c87-0c83-4b1d-aae4-6d0aec80e8c0 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:28.894396 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b020ae5c-ac33-4060-b7de-ccda0f2b74bf admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:28.900944 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e600fc86-0292-4b8f-84c4-59c327b059d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8693a1e72f14fdfb383f11e96330726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:28.905338 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e600fc86-0292-4b8f-84c4-59c327b059d2 service cinder] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:28.905338 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e600fc86-0292-4b8f-84c4-59c327b059d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:28.905338 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e600fc86-0292-4b8f-84c4-59c327b059d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:28.907403 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-e600fc86-0292-4b8f-84c4-59c327b059d2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:28.973977 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb793610-888a-4161-9b44-07f3d13bf470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:28.974968 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb793610-888a-4161-9b44-07f3d13bf470 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:28.975336 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb793610-888a-4161-9b44-07f3d13bf470 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:28.975688 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb793610-888a-4161-9b44-07f3d13bf470 admin admin] PATH_INFO: `/v3/users/a2583844afc04274a21390094a191526` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:28.977024 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb793610-888a-4161-9b44-07f3d13bf470 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2583844afc04274a21390094a191526)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:28.979598 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb793610-888a-4161-9b44-07f3d13bf470 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:29.022545 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e600fc86-0292-4b8f-84c4-59c327b059d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:29.025999 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e600fc86-0292-4b8f-84c4-59c327b059d2 service cinder] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:29.045322 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 895/1799] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:30:28 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:30:29.055211 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e600fc86-0292-4b8f-84c4-59c327b059d2 service cinder] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:29.067945 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e600fc86-0292-4b8f-84c4-59c327b059d2 service cinder] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:29.075600 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48d87e2-90ad-4631-b706-c9a443eeea1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:29.076442 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d87e2-90ad-4631-b706-c9a443eeea1a admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:29.076726 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d87e2-90ad-4631-b706-c9a443eeea1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:29.077003 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d87e2-90ad-4631-b706-c9a443eeea1a admin admin] PATH_INFO: `/v3/users` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:29.077698 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48d87e2-90ad-4631-b706-c9a443eeea1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:29.079654 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48d87e2-90ad-4631-b706-c9a443eeea1a admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:29.279523 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 896/1800] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:30:29 2022] POST /identity/v3/users => generated 300 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:30:29.282118 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48d87e2-90ad-4631-b706-c9a443eeea1a admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:29.311456 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48d87e2-90ad-4631-b706-c9a443eeea1a admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:29.324865 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1420983-6c9a-489f-8ab5-162325ee756b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:29.325564 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1420983-6c9a-489f-8ab5-162325ee756b admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:29.325850 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1420983-6c9a-489f-8ab5-162325ee756b admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:29.326131 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1420983-6c9a-489f-8ab5-162325ee756b admin admin] PATH_INFO: `/v3/users` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:29.327063 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1420983-6c9a-489f-8ab5-162325ee756b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:29.331245 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1420983-6c9a-489f-8ab5-162325ee756b admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:29.386940 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-eb793610-888a-4161-9b44-07f3d13bf470 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2583844afc04274a21390094a191526'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:29.404823 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-eb793610-888a-4161-9b44-07f3d13bf470 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2583844afc04274a21390094a191526'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:29.407135 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-eb793610-888a-4161-9b44-07f3d13bf470 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2583844afc04274a21390094a191526'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:29.408018 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-eb793610-888a-4161-9b44-07f3d13bf470 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2583844afc04274a21390094a191526'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:29.470090 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 897/1801] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:30:29 2022] POST /identity/v3/users => generated 300 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:30:29.471054 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1420983-6c9a-489f-8ab5-162325ee756b admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:29.476778 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-a1420983-6c9a-489f-8ab5-162325ee756b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:29.490690 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-eb793610-888a-4161-9b44-07f3d13bf470 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2583844afc04274a21390094a191526'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:29.548456 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 905/1802] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:30:28 2022] DELETE /identity/v3/users/a2583844afc04274a21390094a191526 => generated 0 bytes in 771 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:30:29.556000 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb793610-888a-4161-9b44-07f3d13bf470 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:29.562133 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-eb793610-888a-4161-9b44-07f3d13bf470 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:29.676403 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1420983-6c9a-489f-8ab5-162325ee756b admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:29.721168 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb793610-888a-4161-9b44-07f3d13bf470 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:29.731629 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967266a7-7c81-4bdc-803f-0f2133511444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:29.734496 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967266a7-7c81-4bdc-803f-0f2133511444 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:29.744137 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967266a7-7c81-4bdc-803f-0f2133511444 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:29.744137 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967266a7-7c81-4bdc-803f-0f2133511444 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:29.744137 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967266a7-7c81-4bdc-803f-0f2133511444 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:29.747284 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967266a7-7c81-4bdc-803f-0f2133511444 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:29.767278 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 906/1803] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:30:29 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:30:29.767278 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967266a7-7c81-4bdc-803f-0f2133511444 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:29.769040 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-967266a7-7c81-4bdc-803f-0f2133511444 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:29.789601 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967266a7-7c81-4bdc-803f-0f2133511444 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:29.801187 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3614b60e-8fbf-4a8d-8700-a0f93bd68a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:29.802033 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3614b60e-8fbf-4a8d-8700-a0f93bd68a4c admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:29.803085 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3614b60e-8fbf-4a8d-8700-a0f93bd68a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:29.803477 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3614b60e-8fbf-4a8d-8700-a0f93bd68a4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:29.804612 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3614b60e-8fbf-4a8d-8700-a0f93bd68a4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:29.806751 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3614b60e-8fbf-4a8d-8700-a0f93bd68a4c admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:29.812101 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551b8a2b-3be1-4d9c-8746-37465759164b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35d98c4a2af546d8b655d649d655f447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:29.813739 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b8a2b-3be1-4d9c-8746-37465759164b service placement] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:29.814094 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b8a2b-3be1-4d9c-8746-37465759164b service placement] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:29.815276 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b8a2b-3be1-4d9c-8746-37465759164b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:29.820302 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-551b8a2b-3be1-4d9c-8746-37465759164b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:29.837589 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551b8a2b-3be1-4d9c-8746-37465759164b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:29.848892 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 907/1804] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:30:29 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:30:29.849107 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551b8a2b-3be1-4d9c-8746-37465759164b service placement] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:29.849757 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3614b60e-8fbf-4a8d-8700-a0f93bd68a4c admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:29.865653 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3614b60e-8fbf-4a8d-8700-a0f93bd68a4c admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:29.867442 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 898/1805] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:30:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:30:29.868604 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551b8a2b-3be1-4d9c-8746-37465759164b service placement] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:29.885148 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2335d347-4d0c-45c1-9fcf-6cfcdd0c7156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:29.885972 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2335d347-4d0c-45c1-9fcf-6cfcdd0c7156 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:29.886271 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2335d347-4d0c-45c1-9fcf-6cfcdd0c7156 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:29.886553 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2335d347-4d0c-45c1-9fcf-6cfcdd0c7156 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:29.887288 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2335d347-4d0c-45c1-9fcf-6cfcdd0c7156 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:29.888892 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2335d347-4d0c-45c1-9fcf-6cfcdd0c7156 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:29.901520 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551b8a2b-3be1-4d9c-8746-37465759164b service placement] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:29.909298 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3d04b7-a077-4645-bf68-271355119e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:29.910270 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d04b7-a077-4645-bf68-271355119e54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:29.910554 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d04b7-a077-4645-bf68-271355119e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:29.910835 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d04b7-a077-4645-bf68-271355119e54 admin admin] PATH_INFO: `/v3/projects/27600cf73457447781b80930780bdcc5/users/d7fe4a9751f94beabbfa0dd659656f2c/roles/e04fe3eb1f714d74901ac83e33ea8a16` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:29.913805 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 908/1806] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:30:29 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:30:29.917789 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2335d347-4d0c-45c1-9fcf-6cfcdd0c7156 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:29.938340 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2335d347-4d0c-45c1-9fcf-6cfcdd0c7156 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:29.943232 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3d04b7-a077-4645-bf68-271355119e54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27600cf73457447781b80930780bdcc5, user_id=d7fe4a9751f94beabbfa0dd659656f2c, role_id=e04fe3eb1f714d74901ac83e33ea8a16)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:29.946190 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4223fd87-483b-4496-ae13-c166dda3d619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:29.947101 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3d04b7-a077-4645-bf68-271355119e54 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:29.947441 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4223fd87-483b-4496-ae13-c166dda3d619 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:29.947862 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4223fd87-483b-4496-ae13-c166dda3d619 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:29.948232 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4223fd87-483b-4496-ae13-c166dda3d619 admin admin] PATH_INFO: `/v3/projects/72f59f8b7aed4474a3018c42baa26d96/users/43c11bf65ad94a7b8333677c008f5844/roles/c8ce6d197f654598ac45f6016ecccabd` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:29.965602 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4223fd87-483b-4496-ae13-c166dda3d619 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72f59f8b7aed4474a3018c42baa26d96, user_id=43c11bf65ad94a7b8333677c008f5844, role_id=c8ce6d197f654598ac45f6016ecccabd)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:29.968615 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4223fd87-483b-4496-ae13-c166dda3d619 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:30.106583 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 899/1807] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:30:29 2022] PUT /identity/v3/projects/27600cf73457447781b80930780bdcc5/users/d7fe4a9751f94beabbfa0dd659656f2c/roles/e04fe3eb1f714d74901ac83e33ea8a16 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:30:30.120358 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3d04b7-a077-4645-bf68-271355119e54 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:30.123033 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-2f3d04b7-a077-4645-bf68-271355119e54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:30.131535 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 909/1808] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:30:29 2022] PUT /identity/v3/projects/72f59f8b7aed4474a3018c42baa26d96/users/43c11bf65ad94a7b8333677c008f5844/roles/c8ce6d197f654598ac45f6016ecccabd => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:30:30.132649 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4223fd87-483b-4496-ae13-c166dda3d619 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:30.151841 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:30:30.219922 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4223fd87-483b-4496-ae13-c166dda3d619 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:30.221826 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3d04b7-a077-4645-bf68-271355119e54 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:30.226126 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f539fa86-1b76-4965-8141-9ea839450dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:30.226995 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f539fa86-1b76-4965-8141-9ea839450dab admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:30.227201 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a228c5c-9360-4e42-b05d-d7826787468c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:30.227372 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f539fa86-1b76-4965-8141-9ea839450dab admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:30.227719 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f539fa86-1b76-4965-8141-9ea839450dab admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:30.228060 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a228c5c-9360-4e42-b05d-d7826787468c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:30.228341 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a228c5c-9360-4e42-b05d-d7826787468c admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:30.228446 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f539fa86-1b76-4965-8141-9ea839450dab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:30.228613 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a228c5c-9360-4e42-b05d-d7826787468c admin admin] PATH_INFO: `/v3/projects/c002706e753b425a86ef1c2d950a5a49` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:30.229801 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a228c5c-9360-4e42-b05d-d7826787468c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c002706e753b425a86ef1c2d950a5a49)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:30.231138 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f539fa86-1b76-4965-8141-9ea839450dab admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:30.231714 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a228c5c-9360-4e42-b05d-d7826787468c admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:30.245507 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 910/1809] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:30:30 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:30:30.246396 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f539fa86-1b76-4965-8141-9ea839450dab admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:30.253499 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-f539fa86-1b76-4965-8141-9ea839450dab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:30.266764 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f539fa86-1b76-4965-8141-9ea839450dab admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:30.271384 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f22b74f-7a95-4113-ae56-5d7aabd59357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:30.272253 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f22b74f-7a95-4113-ae56-5d7aabd59357 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:30.272534 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f22b74f-7a95-4113-ae56-5d7aabd59357 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:30.272807 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f22b74f-7a95-4113-ae56-5d7aabd59357 admin admin] PATH_INFO: `/v3/users/e0c686bafd66451b9c0eb75d3b59e2c9` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:30.273999 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f22b74f-7a95-4113-ae56-5d7aabd59357 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0c686bafd66451b9c0eb75d3b59e2c9)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:30.275939 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f22b74f-7a95-4113-ae56-5d7aabd59357 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:30.408103 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-8a228c5c-9360-4e42-b05d-d7826787468c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c002706e753b425a86ef1c2d950a5a49', 'request_id': 'req-8a228c5c-9360-4e42-b05d-d7826787468c'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:30.420586 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-8a228c5c-9360-4e42-b05d-d7826787468c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c002706e753b425a86ef1c2d950a5a49', 'request_id': 'req-8a228c5c-9360-4e42-b05d-d7826787468c'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:30.428654 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-8a228c5c-9360-4e42-b05d-d7826787468c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c002706e753b425a86ef1c2d950a5a49', 'request_id': 'req-8a228c5c-9360-4e42-b05d-d7826787468c'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:30.610238 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-8a228c5c-9360-4e42-b05d-d7826787468c admin admin] The token cache is being invalidate because project c002706e753b425a86ef1c2d950a5a49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80288) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:30:30.616055 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-8a228c5c-9360-4e42-b05d-d7826787468c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:30.616883 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-8a228c5c-9360-4e42-b05d-d7826787468c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:30.621355 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 900/1810] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:30:30 2022] DELETE /identity/v3/projects/c002706e753b425a86ef1c2d950a5a49 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:30:30.623210 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae38e14-617f-4e0d-9276-41792405b078 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:30.623506 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae38e14-617f-4e0d-9276-41792405b078 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:30.624135 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae38e14-617f-4e0d-9276-41792405b078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:30.664361 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-1f22b74f-7a95-4113-ae56-5d7aabd59357 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0c686bafd66451b9c0eb75d3b59e2c9'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:30.689520 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-1f22b74f-7a95-4113-ae56-5d7aabd59357 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0c686bafd66451b9c0eb75d3b59e2c9'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:30.690885 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-1f22b74f-7a95-4113-ae56-5d7aabd59357 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0c686bafd66451b9c0eb75d3b59e2c9'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:30.691726 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-1f22b74f-7a95-4113-ae56-5d7aabd59357 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0c686bafd66451b9c0eb75d3b59e2c9'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:30.693796 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-0ae38e14-617f-4e0d-9276-41792405b078 None None] MFA Rules not processed for user `43c11bf65ad94a7b8333677c008f5844`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:30.699553 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-0ae38e14-617f-4e0d-9276-41792405b078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:30.803374 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 901/1811] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:30:30 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:30:30.804937 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae38e14-617f-4e0d-9276-41792405b078 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:30.806492 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-0ae38e14-617f-4e0d-9276-41792405b078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:30.823606 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-1f22b74f-7a95-4113-ae56-5d7aabd59357 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0c686bafd66451b9c0eb75d3b59e2c9'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:30.866109 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 911/1812] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:30:30 2022] DELETE /identity/v3/users/e0c686bafd66451b9c0eb75d3b59e2c9 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:30:30.870920 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c67f6-1531-4e00-a790-a383cd380271 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:30.871223 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c67f6-1531-4e00-a790-a383cd380271 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:30.871519 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c67f6-1531-4e00-a790-a383cd380271 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:30.874404 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 912/1813] 10.222.0.62 () {54 vars in 921 bytes} [Fri May 27 16:30:30 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:30:30.879912 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292c67f6-1531-4e00-a790-a383cd380271 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:30.884874 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-292c67f6-1531-4e00-a790-a383cd380271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:30.907333 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae38e14-617f-4e0d-9276-41792405b078 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:31.008952 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292c67f6-1531-4e00-a790-a383cd380271 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:31.019410 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da09cde4-87de-4884-be10-b5fc72a1d113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:31.019410 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da09cde4-87de-4884-be10-b5fc72a1d113 admin admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:31.019410 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da09cde4-87de-4884-be10-b5fc72a1d113 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:31.019410 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da09cde4-87de-4884-be10-b5fc72a1d113 admin admin] PATH_INFO: `/v3/projects/27600cf73457447781b80930780bdcc5/users/d7fe4a9751f94beabbfa0dd659656f2c/roles/e04fe3eb1f714d74901ac83e33ea8a16` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:31.019774 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da09cde4-87de-4884-be10-b5fc72a1d113 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27600cf73457447781b80930780bdcc5, user_id=d7fe4a9751f94beabbfa0dd659656f2c, role_id=e04fe3eb1f714d74901ac83e33ea8a16)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:31.023094 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec2fda-4432-45cd-8497-87cfd4785a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:31.023999 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec2fda-4432-45cd-8497-87cfd4785a4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:31.024290 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec2fda-4432-45cd-8497-87cfd4785a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:31.025173 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec2fda-4432-45cd-8497-87cfd4785a4e admin admin] PATH_INFO: `/v3/users/de093098f4154dc58a245452d3e6590c` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:31.025290 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da09cde4-87de-4884-be10-b5fc72a1d113 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:31.029523 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ec2fda-4432-45cd-8497-87cfd4785a4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=de093098f4154dc58a245452d3e6590c)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:31.032345 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ec2fda-4432-45cd-8497-87cfd4785a4e admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:31.054452 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 902/1814] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:30:30 2022] PUT /identity/v3/projects/27600cf73457447781b80930780bdcc5/users/d7fe4a9751f94beabbfa0dd659656f2c/roles/e04fe3eb1f714d74901ac83e33ea8a16 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:30:31.054452 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da09cde4-87de-4884-be10-b5fc72a1d113 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:31.054452 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-da09cde4-87de-4884-be10-b5fc72a1d113 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:31.168904 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da09cde4-87de-4884-be10-b5fc72a1d113 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:31.176807 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d76128-86b1-4029-a4a3-ca4388b63321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:31.177802 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d76128-86b1-4029-a4a3-ca4388b63321 admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:31.178234 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d76128-86b1-4029-a4a3-ca4388b63321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:31.178937 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d76128-86b1-4029-a4a3-ca4388b63321 admin admin] PATH_INFO: `/v3/projects` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:31.180923 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d76128-86b1-4029-a4a3-ca4388b63321 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:31.183586 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d76128-86b1-4029-a4a3-ca4388b63321 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:31.190749 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:30:31.334448 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 903/1815] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:30:31 2022] POST /identity/v3/projects => generated 401 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:30:31.334448 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c476b-6406-433e-9b5e-dad8d3e9f5cd None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:31.334448 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c476b-6406-433e-9b5e-dad8d3e9f5cd None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:31.334448 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c476b-6406-433e-9b5e-dad8d3e9f5cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:31.353787 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-820c476b-6406-433e-9b5e-dad8d3e9f5cd None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:31.354963 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-820c476b-6406-433e-9b5e-dad8d3e9f5cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:31.398946 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-73ec2fda-4432-45cd-8497-87cfd4785a4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de093098f4154dc58a245452d3e6590c'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:31.421208 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-73ec2fda-4432-45cd-8497-87cfd4785a4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de093098f4154dc58a245452d3e6590c'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:31.422320 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-73ec2fda-4432-45cd-8497-87cfd4785a4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de093098f4154dc58a245452d3e6590c'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:31.423143 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-73ec2fda-4432-45cd-8497-87cfd4785a4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de093098f4154dc58a245452d3e6590c'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:31.445480 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 904/1816] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:30:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:30:31.460251 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1e5725-9712-4212-96c6-e5fc13f7d95a None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:31.461229 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1e5725-9712-4212-96c6-e5fc13f7d95a None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:31.461229 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1e5725-9712-4212-96c6-e5fc13f7d95a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:31.486269 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-2c1e5725-9712-4212-96c6-e5fc13f7d95a None None] MFA Rules not processed for user `cb13ad6d8b1e46029262556bff398796`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:31.487554 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-2c1e5725-9712-4212-96c6-e5fc13f7d95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:31.580178 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 905/1817] 10.222.0.62 () {58 vars in 1018 bytes} [Fri May 27 16:30:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:30:31.582268 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe48910-13a4-4402-bf5c-e88f9a21a03c None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:31.582590 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe48910-13a4-4402-bf5c-e88f9a21a03c None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:31.582880 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe48910-13a4-4402-bf5c-e88f9a21a03c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:31.592535 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-73ec2fda-4432-45cd-8497-87cfd4785a4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de093098f4154dc58a245452d3e6590c'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:31.629053 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-abe48910-13a4-4402-bf5c-e88f9a21a03c None None] MFA Rules not processed for user `d7fe4a9751f94beabbfa0dd659656f2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:31.631147 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-abe48910-13a4-4402-bf5c-e88f9a21a03c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:31.645936 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 913/1818] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:30:30 2022] DELETE /identity/v3/users/de093098f4154dc58a245452d3e6590c => generated 0 bytes in 770 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:30:31.647300 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec2fda-4432-45cd-8497-87cfd4785a4e admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:31.648914 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-73ec2fda-4432-45cd-8497-87cfd4785a4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:31.727772 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 906/1819] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:30:31 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:30:31.732764 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe48910-13a4-4402-bf5c-e88f9a21a03c None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:31.736573 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-abe48910-13a4-4402-bf5c-e88f9a21a03c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:31.764479 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec2fda-4432-45cd-8497-87cfd4785a4e admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:31.783272 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f1e24a-33c7-448d-8063-4530d3f792e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:31.784301 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1e24a-33c7-448d-8063-4530d3f792e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:31.784758 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1e24a-33c7-448d-8063-4530d3f792e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:31.785183 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1e24a-33c7-448d-8063-4530d3f792e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:31.786036 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f1e24a-33c7-448d-8063-4530d3f792e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:31.788214 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f1e24a-33c7-448d-8063-4530d3f792e1 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:31.862270 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:30:31.879629 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe48910-13a4-4402-bf5c-e88f9a21a03c None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:31.922797 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 914/1820] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:30:31 2022] POST /identity/v3/users => generated 307 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:30:31.923565 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f1e24a-33c7-448d-8063-4530d3f792e1 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:31.929113 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-68f1e24a-33c7-448d-8063-4530d3f792e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:31.980243 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b2e90d-2786-4bea-8b0c-c1b228d59a58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:31.980992 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b2e90d-2786-4bea-8b0c-c1b228d59a58 service neutron] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:31.981278 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b2e90d-2786-4bea-8b0c-c1b228d59a58 service neutron] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:31.981559 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b2e90d-2786-4bea-8b0c-c1b228d59a58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:31.996302 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b2e90d-2786-4bea-8b0c-c1b228d59a58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:31.998291 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b2e90d-2786-4bea-8b0c-c1b228d59a58 service neutron] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:32.014562 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 907/1821] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:30:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:30:32.019356 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b2e90d-2786-4bea-8b0c-c1b228d59a58 service neutron] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:32.019356 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-84b2e90d-2786-4bea-8b0c-c1b228d59a58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:32.112720 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f1e24a-33c7-448d-8063-4530d3f792e1 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:32.134986 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a993aa89-1fdc-45c9-918f-d26f66134f22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb13ad6d8b1e46029262556bff398796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:32.134986 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a993aa89-1fdc-45c9-918f-d26f66134f22 service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:32.134986 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a993aa89-1fdc-45c9-918f-d26f66134f22 service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:32.134986 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a993aa89-1fdc-45c9-918f-d26f66134f22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:32.143796 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a993aa89-1fdc-45c9-918f-d26f66134f22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:32.145589 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a993aa89-1fdc-45c9-918f-d26f66134f22 service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:32.176687 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 915/1822] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:30:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:30:32.180156 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a993aa89-1fdc-45c9-918f-d26f66134f22 service nova] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:32.210943 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b2e90d-2786-4bea-8b0c-c1b228d59a58 service neutron] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:32.224155 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a993aa89-1fdc-45c9-918f-d26f66134f22 service nova] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:32.229830 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8360eb2-8805-4eaa-aeab-a5c6469ee0d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8693a1e72f14fdfb383f11e96330726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:32.233634 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8360eb2-8805-4eaa-aeab-a5c6469ee0d6 service cinder] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:32.233634 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8360eb2-8805-4eaa-aeab-a5c6469ee0d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:32.233634 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8360eb2-8805-4eaa-aeab-a5c6469ee0d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:32.247128 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c105294d-7d58-42fe-9703-1f69afe56345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:32.249683 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c105294d-7d58-42fe-9703-1f69afe56345 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:32.249683 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c105294d-7d58-42fe-9703-1f69afe56345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:32.249683 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c105294d-7d58-42fe-9703-1f69afe56345 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:32.254421 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c105294d-7d58-42fe-9703-1f69afe56345 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:32.256502 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c105294d-7d58-42fe-9703-1f69afe56345 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:32.289864 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 916/1823] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:30:32 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:30:32.297518 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c105294d-7d58-42fe-9703-1f69afe56345 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:32.314060 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c105294d-7d58-42fe-9703-1f69afe56345 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:32.334307 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29d8a97-7e06-4464-b5a5-8ed5c2892ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:32.338215 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d8a97-7e06-4464-b5a5-8ed5c2892ea7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:32.338215 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d8a97-7e06-4464-b5a5-8ed5c2892ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:32.338215 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d8a97-7e06-4464-b5a5-8ed5c2892ea7 admin admin] PATH_INFO: `/v3/projects/4f2ede4310034fbb87427d730b98ddc0/users/ed10b9051e324993aef833640f983c38/roles/e04fe3eb1f714d74901ac83e33ea8a16` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:32.377652 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29d8a97-7e06-4464-b5a5-8ed5c2892ea7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f2ede4310034fbb87427d730b98ddc0, user_id=ed10b9051e324993aef833640f983c38, role_id=e04fe3eb1f714d74901ac83e33ea8a16)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:32.384097 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29d8a97-7e06-4464-b5a5-8ed5c2892ea7 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:32.427493 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:30:32.451602 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8360eb2-8805-4eaa-aeab-a5c6469ee0d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:32.453258 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8360eb2-8805-4eaa-aeab-a5c6469ee0d6 service cinder] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:32.487625 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 917/1824] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:30:32 2022] PUT /identity/v3/projects/4f2ede4310034fbb87427d730b98ddc0/users/ed10b9051e324993aef833640f983c38/roles/e04fe3eb1f714d74901ac83e33ea8a16 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:30:32.489186 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29d8a97-7e06-4464-b5a5-8ed5c2892ea7 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:32.493531 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-c29d8a97-7e06-4464-b5a5-8ed5c2892ea7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:32.516630 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 908/1825] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:30:32 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:30:32.520096 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8360eb2-8805-4eaa-aeab-a5c6469ee0d6 service cinder] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:32.581702 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8360eb2-8805-4eaa-aeab-a5c6469ee0d6 service cinder] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:32.702058 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29d8a97-7e06-4464-b5a5-8ed5c2892ea7 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:32.708717 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6439c4e5-a142-4dbc-b539-8e777f68b985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:32.715899 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6439c4e5-a142-4dbc-b539-8e777f68b985 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:32.715899 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6439c4e5-a142-4dbc-b539-8e777f68b985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:32.715899 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6439c4e5-a142-4dbc-b539-8e777f68b985 admin admin] PATH_INFO: `/v3/projects/df4ef64a723c4d5c947a68c5ab4e0daf` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:32.715899 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6439c4e5-a142-4dbc-b539-8e777f68b985 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df4ef64a723c4d5c947a68c5ab4e0daf)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:32.716856 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6439c4e5-a142-4dbc-b539-8e777f68b985 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:32.742454 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b227fc-fc30-4e33-aef0-9bdedaaf312b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:32.743161 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b227fc-fc30-4e33-aef0-9bdedaaf312b admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:32.744135 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b227fc-fc30-4e33-aef0-9bdedaaf312b admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:32.744430 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b227fc-fc30-4e33-aef0-9bdedaaf312b admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:32.745187 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b227fc-fc30-4e33-aef0-9bdedaaf312b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:32.747708 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b227fc-fc30-4e33-aef0-9bdedaaf312b admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:32.773065 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 909/1826] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:30:32 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:30:32.773065 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b227fc-fc30-4e33-aef0-9bdedaaf312b admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:32.775599 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-98b227fc-fc30-4e33-aef0-9bdedaaf312b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:32.796246 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b227fc-fc30-4e33-aef0-9bdedaaf312b admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:32.815497 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ec5e47-f699-463a-9a39-24cce24eea5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:32.816560 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec5e47-f699-463a-9a39-24cce24eea5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:32.817296 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec5e47-f699-463a-9a39-24cce24eea5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:32.817585 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec5e47-f699-463a-9a39-24cce24eea5b admin admin] PATH_INFO: `/v3/users/048ec9a12a774d0c930e327ed7dae60a` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:32.819544 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ec5e47-f699-463a-9a39-24cce24eea5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=048ec9a12a774d0c930e327ed7dae60a)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:32.821587 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ec5e47-f699-463a-9a39-24cce24eea5b admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:32.956352 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-6439c4e5-a142-4dbc-b539-8e777f68b985 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df4ef64a723c4d5c947a68c5ab4e0daf', 'request_id': 'req-6439c4e5-a142-4dbc-b539-8e777f68b985'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:32.965728 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-6439c4e5-a142-4dbc-b539-8e777f68b985 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df4ef64a723c4d5c947a68c5ab4e0daf', 'request_id': 'req-6439c4e5-a142-4dbc-b539-8e777f68b985'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:33.094974 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-6439c4e5-a142-4dbc-b539-8e777f68b985 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df4ef64a723c4d5c947a68c5ab4e0daf', 'request_id': 'req-6439c4e5-a142-4dbc-b539-8e777f68b985'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:33.110772 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-6439c4e5-a142-4dbc-b539-8e777f68b985 admin admin] The token cache is being invalidate because project df4ef64a723c4d5c947a68c5ab4e0daf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:30:33.111151 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-6439c4e5-a142-4dbc-b539-8e777f68b985 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:33.114372 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-6439c4e5-a142-4dbc-b539-8e777f68b985 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:33.118325 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 918/1827] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:30:32 2022] DELETE /identity/v3/projects/df4ef64a723c4d5c947a68c5ab4e0daf => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:30:33.119798 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6439c4e5-a142-4dbc-b539-8e777f68b985 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:33.128372 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-6439c4e5-a142-4dbc-b539-8e777f68b985 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:33.171560 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-e2ec5e47-f699-463a-9a39-24cce24eea5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '048ec9a12a774d0c930e327ed7dae60a'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:33.200386 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-e2ec5e47-f699-463a-9a39-24cce24eea5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '048ec9a12a774d0c930e327ed7dae60a'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:33.203903 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-e2ec5e47-f699-463a-9a39-24cce24eea5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '048ec9a12a774d0c930e327ed7dae60a'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:33.209995 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-e2ec5e47-f699-463a-9a39-24cce24eea5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '048ec9a12a774d0c930e327ed7dae60a'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:33.241523 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6439c4e5-a142-4dbc-b539-8e777f68b985 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:33.247132 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3265709-cd6f-4eec-8c48-5938a6760bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:33.248036 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3265709-cd6f-4eec-8c48-5938a6760bed admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:33.248315 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3265709-cd6f-4eec-8c48-5938a6760bed admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:33.248585 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3265709-cd6f-4eec-8c48-5938a6760bed admin admin] PATH_INFO: `/v3/projects/4f2ede4310034fbb87427d730b98ddc0/users/ed10b9051e324993aef833640f983c38/roles/e04fe3eb1f714d74901ac83e33ea8a16` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:33.251074 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3265709-cd6f-4eec-8c48-5938a6760bed admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f2ede4310034fbb87427d730b98ddc0, user_id=ed10b9051e324993aef833640f983c38, role_id=e04fe3eb1f714d74901ac83e33ea8a16)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:33.253996 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3265709-cd6f-4eec-8c48-5938a6760bed admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:33.268279 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 919/1828] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:30:33 2022] PUT /identity/v3/projects/4f2ede4310034fbb87427d730b98ddc0/users/ed10b9051e324993aef833640f983c38/roles/e04fe3eb1f714d74901ac83e33ea8a16 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:30:33.270804 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133bc1fb-a122-4b12-9f53-4e0cbb55b413 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:33.271101 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133bc1fb-a122-4b12-9f53-4e0cbb55b413 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:33.271385 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133bc1fb-a122-4b12-9f53-4e0cbb55b413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:33.306849 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-133bc1fb-a122-4b12-9f53-4e0cbb55b413 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:33.308252 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-133bc1fb-a122-4b12-9f53-4e0cbb55b413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:33.377339 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 920/1829] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:30:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:30:33.378349 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133bc1fb-a122-4b12-9f53-4e0cbb55b413 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:33.379668 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-133bc1fb-a122-4b12-9f53-4e0cbb55b413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:33.391711 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133bc1fb-a122-4b12-9f53-4e0cbb55b413 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:33.397081 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5188e9c9-6fc0-4ca0-be51-9589cb966677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:33.397934 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188e9c9-6fc0-4ca0-be51-9589cb966677 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:33.398220 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188e9c9-6fc0-4ca0-be51-9589cb966677 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:33.398536 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188e9c9-6fc0-4ca0-be51-9589cb966677 admin admin] PATH_INFO: `/v3/projects/10335f4dca1f4b5f84859eb7907677f2` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:33.399723 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5188e9c9-6fc0-4ca0-be51-9589cb966677 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10335f4dca1f4b5f84859eb7907677f2)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:33.401641 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5188e9c9-6fc0-4ca0-be51-9589cb966677 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:33.412286 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-e2ec5e47-f699-463a-9a39-24cce24eea5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '048ec9a12a774d0c930e327ed7dae60a'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:33.431050 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 910/1830] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:30:32 2022] DELETE /identity/v3/users/048ec9a12a774d0c930e327ed7dae60a => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:30:33.432721 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f901de-82a4-44f8-a33c-338422a71e7e None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:33.433013 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f901de-82a4-44f8-a33c-338422a71e7e None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:33.433296 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f901de-82a4-44f8-a33c-338422a71e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:33.463191 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-71f901de-82a4-44f8-a33c-338422a71e7e None None] MFA Rules not processed for user `ed10b9051e324993aef833640f983c38`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:33.464502 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-71f901de-82a4-44f8-a33c-338422a71e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:33.527401 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-5188e9c9-6fc0-4ca0-be51-9589cb966677 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10335f4dca1f4b5f84859eb7907677f2', 'request_id': 'req-5188e9c9-6fc0-4ca0-be51-9589cb966677'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:33.535300 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-5188e9c9-6fc0-4ca0-be51-9589cb966677 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10335f4dca1f4b5f84859eb7907677f2', 'request_id': 'req-5188e9c9-6fc0-4ca0-be51-9589cb966677'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:33.549788 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 911/1831] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:30:33 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:30:33.551171 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb42f2b-d6b1-4ad9-bf5b-c09afcbe9f1f None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:33.551458 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb42f2b-d6b1-4ad9-bf5b-c09afcbe9f1f None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:33.561060 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb42f2b-d6b1-4ad9-bf5b-c09afcbe9f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:33.571072 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-3eb42f2b-d6b1-4ad9-bf5b-c09afcbe9f1f None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:33.572362 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-3eb42f2b-d6b1-4ad9-bf5b-c09afcbe9f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:33.637646 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 912/1832] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:30:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:30:33.642834 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854891fc-0097-448c-8cde-95ea078b45a9 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:33.643209 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854891fc-0097-448c-8cde-95ea078b45a9 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:33.643509 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854891fc-0097-448c-8cde-95ea078b45a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:33.663951 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-854891fc-0097-448c-8cde-95ea078b45a9 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:33.665077 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-854891fc-0097-448c-8cde-95ea078b45a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:33.678445 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 913/1833] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:30:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:30:33.678445 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854891fc-0097-448c-8cde-95ea078b45a9 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:33.678445 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-854891fc-0097-448c-8cde-95ea078b45a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:33.717088 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-5188e9c9-6fc0-4ca0-be51-9589cb966677 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10335f4dca1f4b5f84859eb7907677f2', 'request_id': 'req-5188e9c9-6fc0-4ca0-be51-9589cb966677'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:33.729159 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-5188e9c9-6fc0-4ca0-be51-9589cb966677 admin admin] The token cache is being invalidate because project 10335f4dca1f4b5f84859eb7907677f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:30:33.729941 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-5188e9c9-6fc0-4ca0-be51-9589cb966677 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:33.730873 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-5188e9c9-6fc0-4ca0-be51-9589cb966677 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:33.736141 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 921/1834] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:30:33 2022] DELETE /identity/v3/projects/10335f4dca1f4b5f84859eb7907677f2 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:30:33.736141 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5188e9c9-6fc0-4ca0-be51-9589cb966677 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:33.736141 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-5188e9c9-6fc0-4ca0-be51-9589cb966677 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:33.754651 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854891fc-0097-448c-8cde-95ea078b45a9 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:33.760353 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5188e9c9-6fc0-4ca0-be51-9589cb966677 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:33.761020 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51ccd74-1c7b-404b-8ed3-fd707815d0d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8693a1e72f14fdfb383f11e96330726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:33.762285 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ccd74-1c7b-404b-8ed3-fd707815d0d2 service cinder] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:33.762285 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ccd74-1c7b-404b-8ed3-fd707815d0d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:33.763765 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ccd74-1c7b-404b-8ed3-fd707815d0d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:33.764669 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-a51ccd74-1c7b-404b-8ed3-fd707815d0d2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:33.770916 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bb709d-6a94-4267-b64d-ccc8610058d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:33.771957 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb709d-6a94-4267-b64d-ccc8610058d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:33.771957 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb709d-6a94-4267-b64d-ccc8610058d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:33.773787 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb709d-6a94-4267-b64d-ccc8610058d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:33.774798 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bb709d-6a94-4267-b64d-ccc8610058d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:30:33.775110 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bb709d-6a94-4267-b64d-ccc8610058d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:33.776758 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bb709d-6a94-4267-b64d-ccc8610058d0 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:33.794353 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 922/1835] 10.222.0.62 () {58 vars in 1152 bytes} [Fri May 27 16:30:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:30:33.796175 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bb709d-6a94-4267-b64d-ccc8610058d0 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:33.799435 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-62bb709d-6a94-4267-b64d-ccc8610058d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:33.848462 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51ccd74-1c7b-404b-8ed3-fd707815d0d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:33.849919 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51ccd74-1c7b-404b-8ed3-fd707815d0d2 service cinder] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:33.860953 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 914/1836] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:30:33 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:30:33.874001 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51ccd74-1c7b-404b-8ed3-fd707815d0d2 service cinder] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:33.874001 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-a51ccd74-1c7b-404b-8ed3-fd707815d0d2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:33.879872 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51ccd74-1c7b-404b-8ed3-fd707815d0d2 service cinder] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:33.885152 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0369af78-cf90-4e74-87f8-089a591cad43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:33.886711 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0369af78-cf90-4e74-87f8-089a591cad43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:33.887002 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0369af78-cf90-4e74-87f8-089a591cad43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:33.888677 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0369af78-cf90-4e74-87f8-089a591cad43 admin admin] PATH_INFO: `/v3/users/faaebf52c7b74c098bf9d110906a0b7b` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:33.890014 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0369af78-cf90-4e74-87f8-089a591cad43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=faaebf52c7b74c098bf9d110906a0b7b)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:33.892232 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0369af78-cf90-4e74-87f8-089a591cad43 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:33.910485 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bb709d-6a94-4267-b64d-ccc8610058d0 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:33.916645 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63694bfa-e89c-4a85-9480-7f48865ff1ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:33.917439 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63694bfa-e89c-4a85-9480-7f48865ff1ba service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:33.917838 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63694bfa-e89c-4a85-9480-7f48865ff1ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:33.918289 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63694bfa-e89c-4a85-9480-7f48865ff1ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:33.921498 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-63694bfa-e89c-4a85-9480-7f48865ff1ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:33.939431 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63694bfa-e89c-4a85-9480-7f48865ff1ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:33.940877 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63694bfa-e89c-4a85-9480-7f48865ff1ba service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:33.951598 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 923/1837] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:30:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:30:33.952428 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63694bfa-e89c-4a85-9480-7f48865ff1ba service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:33.963591 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63694bfa-e89c-4a85-9480-7f48865ff1ba service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:33.973977 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4279b47c-f654-4f2e-9dcf-16fdb1ab6161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:33.973977 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4279b47c-f654-4f2e-9dcf-16fdb1ab6161 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:33.973977 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4279b47c-f654-4f2e-9dcf-16fdb1ab6161 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:33.973977 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4279b47c-f654-4f2e-9dcf-16fdb1ab6161 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:33.974567 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4279b47c-f654-4f2e-9dcf-16fdb1ab6161 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:33.974567 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4279b47c-f654-4f2e-9dcf-16fdb1ab6161 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:34.110222 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 924/1838] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:30:33 2022] POST /identity/v3/projects => generated 381 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:30:34.112571 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4279b47c-f654-4f2e-9dcf-16fdb1ab6161 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:34.213689 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4279b47c-f654-4f2e-9dcf-16fdb1ab6161 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:34.230350 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9dafa4-febe-4557-9d84-9eca4b0c331a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:34.230350 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9dafa4-febe-4557-9d84-9eca4b0c331a admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:34.230350 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9dafa4-febe-4557-9d84-9eca4b0c331a admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:34.230350 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9dafa4-febe-4557-9d84-9eca4b0c331a admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:34.230771 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9dafa4-febe-4557-9d84-9eca4b0c331a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:34.230843 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-0369af78-cf90-4e74-87f8-089a591cad43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'faaebf52c7b74c098bf9d110906a0b7b'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:34.231249 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9dafa4-febe-4557-9d84-9eca4b0c331a admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:34.250472 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-0369af78-cf90-4e74-87f8-089a591cad43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'faaebf52c7b74c098bf9d110906a0b7b'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:34.251632 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-0369af78-cf90-4e74-87f8-089a591cad43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'faaebf52c7b74c098bf9d110906a0b7b'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:34.252353 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-0369af78-cf90-4e74-87f8-089a591cad43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'faaebf52c7b74c098bf9d110906a0b7b'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:34.302668 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:30:34.398451 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-0369af78-cf90-4e74-87f8-089a591cad43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'faaebf52c7b74c098bf9d110906a0b7b'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:34.412468 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 925/1839] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:30:34 2022] POST /identity/v3/users => generated 291 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:30:34.413254 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9dafa4-febe-4557-9d84-9eca4b0c331a admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:34.417700 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-2b9dafa4-febe-4557-9d84-9eca4b0c331a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:34.428044 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 915/1840] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:30:33 2022] DELETE /identity/v3/users/faaebf52c7b74c098bf9d110906a0b7b => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:30:34.429236 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0369af78-cf90-4e74-87f8-089a591cad43 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:34.433527 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-0369af78-cf90-4e74-87f8-089a591cad43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:34.537224 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0369af78-cf90-4e74-87f8-089a591cad43 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:34.544553 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2865548f-393c-4e0f-9360-0a6102a73210 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8693a1e72f14fdfb383f11e96330726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:34.545862 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2865548f-393c-4e0f-9360-0a6102a73210 service cinder] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:34.546099 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2865548f-393c-4e0f-9360-0a6102a73210 service cinder] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:34.546640 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2865548f-393c-4e0f-9360-0a6102a73210 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:34.549228 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-2865548f-393c-4e0f-9360-0a6102a73210 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:34.565113 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9dafa4-febe-4557-9d84-9eca4b0c331a admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:34.577269 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3d20cd-25d1-4ec0-a2e5-41ac3525931d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8693a1e72f14fdfb383f11e96330726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:34.577882 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d20cd-25d1-4ec0-a2e5-41ac3525931d service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:34.580834 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d20cd-25d1-4ec0-a2e5-41ac3525931d service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:34.581136 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d20cd-25d1-4ec0-a2e5-41ac3525931d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:34.583555 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-ce3d20cd-25d1-4ec0-a2e5-41ac3525931d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:34.646198 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2865548f-393c-4e0f-9360-0a6102a73210 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:34.647708 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2865548f-393c-4e0f-9360-0a6102a73210 service cinder] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:34.658981 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 916/1841] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:30:34 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:30:34.660956 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2865548f-393c-4e0f-9360-0a6102a73210 service cinder] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:34.662469 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-2865548f-393c-4e0f-9360-0a6102a73210 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:34.669621 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3d20cd-25d1-4ec0-a2e5-41ac3525931d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:34.671203 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3d20cd-25d1-4ec0-a2e5-41ac3525931d service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:34.681674 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 926/1842] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:30:34 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:30:34.682821 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3d20cd-25d1-4ec0-a2e5-41ac3525931d service cinder] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:34.693836 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-ce3d20cd-25d1-4ec0-a2e5-41ac3525931d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:34.742734 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2865548f-393c-4e0f-9360-0a6102a73210 service cinder] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:34.751055 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15f6388-05ad-48f9-8250-7c6ea59055e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:34.751934 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f6388-05ad-48f9-8250-7c6ea59055e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:34.752321 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f6388-05ad-48f9-8250-7c6ea59055e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:34.752693 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f6388-05ad-48f9-8250-7c6ea59055e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:34.753866 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15f6388-05ad-48f9-8250-7c6ea59055e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:34.758929 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15f6388-05ad-48f9-8250-7c6ea59055e5 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:34.771202 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 917/1843] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:30:34 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:30:34.775275 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15f6388-05ad-48f9-8250-7c6ea59055e5 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:34.784619 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3d20cd-25d1-4ec0-a2e5-41ac3525931d service cinder] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:34.786638 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15f6388-05ad-48f9-8250-7c6ea59055e5 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:34.791380 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc8b99e-25f2-4c55-9092-cab440a6f8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:34.792262 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d14baa4-bacf-46f0-955e-cb51782078f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:34.792737 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc8b99e-25f2-4c55-9092-cab440a6f8c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:34.792998 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d14baa4-bacf-46f0-955e-cb51782078f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:34.793284 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d14baa4-bacf-46f0-955e-cb51782078f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:34.793560 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d14baa4-bacf-46f0-955e-cb51782078f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:34.793703 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc8b99e-25f2-4c55-9092-cab440a6f8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:34.794120 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc8b99e-25f2-4c55-9092-cab440a6f8c7 admin admin] PATH_INFO: `/v3/projects/0ddb694cefc34a4c9155787818965b2b` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:34.795251 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d14baa4-bacf-46f0-955e-cb51782078f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:34.796104 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc8b99e-25f2-4c55-9092-cab440a6f8c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ddb694cefc34a4c9155787818965b2b)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:34.797312 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d14baa4-bacf-46f0-955e-cb51782078f6 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:34.798909 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc8b99e-25f2-4c55-9092-cab440a6f8c7 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:34.811152 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 918/1844] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:30:34 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:30:34.816703 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d14baa4-bacf-46f0-955e-cb51782078f6 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:34.828280 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d14baa4-bacf-46f0-955e-cb51782078f6 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:34.833685 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc1e84b-0cf1-46e9-92b4-ec1c31141928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:34.834784 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc1e84b-0cf1-46e9-92b4-ec1c31141928 admin admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:34.835075 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc1e84b-0cf1-46e9-92b4-ec1c31141928 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:34.835353 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc1e84b-0cf1-46e9-92b4-ec1c31141928 admin admin] PATH_INFO: `/v3/projects/23c7dd7906bd4068b2d704e014522bdd/users/99df66a233b0457c83eb07f59916c3f1/roles/c8ce6d197f654598ac45f6016ecccabd` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:34.851451 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:30:34.857501 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc1e84b-0cf1-46e9-92b4-ec1c31141928 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23c7dd7906bd4068b2d704e014522bdd, user_id=99df66a233b0457c83eb07f59916c3f1, role_id=c8ce6d197f654598ac45f6016ecccabd)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:34.857501 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc1e84b-0cf1-46e9-92b4-ec1c31141928 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:35.018445 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 919/1845] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:30:34 2022] PUT /identity/v3/projects/23c7dd7906bd4068b2d704e014522bdd/users/99df66a233b0457c83eb07f59916c3f1/roles/c8ce6d197f654598ac45f6016ecccabd => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:30:35.031663 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619d89ad-eb47-4608-b990-0add8f229698 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:35.033390 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619d89ad-eb47-4608-b990-0add8f229698 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:35.035201 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619d89ad-eb47-4608-b990-0add8f229698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:35.049186 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-6bc8b99e-25f2-4c55-9092-cab440a6f8c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ddb694cefc34a4c9155787818965b2b', 'request_id': 'req-6bc8b99e-25f2-4c55-9092-cab440a6f8c7'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:35.056596 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-6bc8b99e-25f2-4c55-9092-cab440a6f8c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ddb694cefc34a4c9155787818965b2b', 'request_id': 'req-6bc8b99e-25f2-4c55-9092-cab440a6f8c7'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:35.094836 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-619d89ad-eb47-4608-b990-0add8f229698 None None] MFA Rules not processed for user `99df66a233b0457c83eb07f59916c3f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:35.096752 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-619d89ad-eb47-4608-b990-0add8f229698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:35.164005 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-6bc8b99e-25f2-4c55-9092-cab440a6f8c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ddb694cefc34a4c9155787818965b2b', 'request_id': 'req-6bc8b99e-25f2-4c55-9092-cab440a6f8c7'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:35.185382 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-6bc8b99e-25f2-4c55-9092-cab440a6f8c7 admin admin] The token cache is being invalidate because project 0ddb694cefc34a4c9155787818965b2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:30:35.185847 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-6bc8b99e-25f2-4c55-9092-cab440a6f8c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:35.192621 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-6bc8b99e-25f2-4c55-9092-cab440a6f8c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:35.195382 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 920/1846] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:30:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:30:35.199483 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619d89ad-eb47-4608-b990-0add8f229698 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:35.202314 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 927/1847] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:30:34 2022] DELETE /identity/v3/projects/0ddb694cefc34a4c9155787818965b2b => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:30:35.217350 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc8b99e-25f2-4c55-9092-cab440a6f8c7 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:35.222588 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-6bc8b99e-25f2-4c55-9092-cab440a6f8c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:35.352860 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619d89ad-eb47-4608-b990-0add8f229698 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:35.359566 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4ea900-7ab2-4c5c-9591-fbb631cfb6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:35.360271 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ea900-7ab2-4c5c-9591-fbb631cfb6c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:35.360563 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ea900-7ab2-4c5c-9591-fbb631cfb6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:35.360841 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ea900-7ab2-4c5c-9591-fbb631cfb6c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:35.365165 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4ea900-7ab2-4c5c-9591-fbb631cfb6c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:35.387447 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4ea900-7ab2-4c5c-9591-fbb631cfb6c3 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:35.390337 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:30:35.412658 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc8b99e-25f2-4c55-9092-cab440a6f8c7 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:35.436881 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d902b7f9-12cc-414b-9bbc-bed0d5623325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:35.442074 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d902b7f9-12cc-414b-9bbc-bed0d5623325 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:35.442074 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d902b7f9-12cc-414b-9bbc-bed0d5623325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:35.442074 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d902b7f9-12cc-414b-9bbc-bed0d5623325 admin admin] PATH_INFO: `/v3/users/d7fe4a9751f94beabbfa0dd659656f2c` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:35.442074 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d902b7f9-12cc-414b-9bbc-bed0d5623325 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7fe4a9751f94beabbfa0dd659656f2c)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:35.445257 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d902b7f9-12cc-414b-9bbc-bed0d5623325 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:35.568028 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 921/1848] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:30:35 2022] POST /identity/v3/projects => generated 381 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:30:35.568028 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4ea900-7ab2-4c5c-9591-fbb631cfb6c3 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:35.569185 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-bb4ea900-7ab2-4c5c-9591-fbb631cfb6c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:35.688618 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4ea900-7ab2-4c5c-9591-fbb631cfb6c3 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:35.694615 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2d2e45-3659-4fde-bd00-89aff8970657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:35.695524 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d2e45-3659-4fde-bd00-89aff8970657 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:35.695784 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d2e45-3659-4fde-bd00-89aff8970657 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:35.696139 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d2e45-3659-4fde-bd00-89aff8970657 admin admin] PATH_INFO: `/v3/projects/4b5cb0becc644fe89534957510d795ae` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:35.697289 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2d2e45-3659-4fde-bd00-89aff8970657 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b5cb0becc644fe89534957510d795ae)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:35.700244 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2d2e45-3659-4fde-bd00-89aff8970657 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:35.890661 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-d902b7f9-12cc-414b-9bbc-bed0d5623325 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7fe4a9751f94beabbfa0dd659656f2c'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:35.892170 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-2c2d2e45-3659-4fde-bd00-89aff8970657 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b5cb0becc644fe89534957510d795ae', 'request_id': 'req-2c2d2e45-3659-4fde-bd00-89aff8970657'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:35.900213 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-d902b7f9-12cc-414b-9bbc-bed0d5623325 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7fe4a9751f94beabbfa0dd659656f2c'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:35.900965 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-d902b7f9-12cc-414b-9bbc-bed0d5623325 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7fe4a9751f94beabbfa0dd659656f2c'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:35.901579 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-d902b7f9-12cc-414b-9bbc-bed0d5623325 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7fe4a9751f94beabbfa0dd659656f2c'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:35.902359 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-2c2d2e45-3659-4fde-bd00-89aff8970657 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b5cb0becc644fe89534957510d795ae', 'request_id': 'req-2c2d2e45-3659-4fde-bd00-89aff8970657'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:35.910048 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-2c2d2e45-3659-4fde-bd00-89aff8970657 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b5cb0becc644fe89534957510d795ae', 'request_id': 'req-2c2d2e45-3659-4fde-bd00-89aff8970657'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:36.043644 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-d902b7f9-12cc-414b-9bbc-bed0d5623325 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7fe4a9751f94beabbfa0dd659656f2c'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:36.063715 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 928/1849] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:30:35 2022] DELETE /identity/v3/users/d7fe4a9751f94beabbfa0dd659656f2c => generated 0 bytes in 847 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:30:36.064734 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d902b7f9-12cc-414b-9bbc-bed0d5623325 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:36.067774 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-d902b7f9-12cc-414b-9bbc-bed0d5623325 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:36.137387 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d902b7f9-12cc-414b-9bbc-bed0d5623325 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:36.142942 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3f89cf-8787-4168-a5b1-d36a031fe896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:36.143831 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3f89cf-8787-4168-a5b1-d36a031fe896 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:36.147281 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3f89cf-8787-4168-a5b1-d36a031fe896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:36.147281 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3f89cf-8787-4168-a5b1-d36a031fe896 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:36.147281 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3f89cf-8787-4168-a5b1-d36a031fe896 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:36.147657 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-2c2d2e45-3659-4fde-bd00-89aff8970657 admin admin] The token cache is being invalidate because project 4b5cb0becc644fe89534957510d795ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80288) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:30:36.147759 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3f89cf-8787-4168-a5b1-d36a031fe896 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:36.147845 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-2c2d2e45-3659-4fde-bd00-89aff8970657 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:36.149349 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-2c2d2e45-3659-4fde-bd00-89aff8970657 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:36.154376 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 922/1850] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:30:35 2022] DELETE /identity/v3/projects/4b5cb0becc644fe89534957510d795ae => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:30:36.158168 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e555bbd-98b0-43d9-b24b-33da9a59f68a None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:36.158490 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e555bbd-98b0-43d9-b24b-33da9a59f68a None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:36.158790 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e555bbd-98b0-43d9-b24b-33da9a59f68a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:36.182505 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-8e555bbd-98b0-43d9-b24b-33da9a59f68a None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:36.183997 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-8e555bbd-98b0-43d9-b24b-33da9a59f68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:36.191926 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 923/1851] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:30:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:30:36.199500 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cdd49c-d111-4b3b-b8e6-2bc863edbcc5 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:36.199795 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cdd49c-d111-4b3b-b8e6-2bc863edbcc5 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:36.200075 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cdd49c-d111-4b3b-b8e6-2bc863edbcc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:36.218531 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-55cdd49c-d111-4b3b-b8e6-2bc863edbcc5 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:36.219793 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-55cdd49c-d111-4b3b-b8e6-2bc863edbcc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:36.228895 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 924/1852] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:30:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:30:36.232975 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cdd49c-d111-4b3b-b8e6-2bc863edbcc5 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:36.242376 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cdd49c-d111-4b3b-b8e6-2bc863edbcc5 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:36.247335 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96faeda9-2831-49a9-b7c9-39f1cb80f0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:36.275198 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96faeda9-2831-49a9-b7c9-39f1cb80f0c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:36.275198 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96faeda9-2831-49a9-b7c9-39f1cb80f0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:36.276020 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 929/1853] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:30:36 2022] POST /identity/v3/users => generated 297 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:30:36.276298 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96faeda9-2831-49a9-b7c9-39f1cb80f0c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:36.276298 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96faeda9-2831-49a9-b7c9-39f1cb80f0c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:30:36.276298 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96faeda9-2831-49a9-b7c9-39f1cb80f0c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:36.276298 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96faeda9-2831-49a9-b7c9-39f1cb80f0c1 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:36.276298 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 925/1854] 10.222.0.62 () {58 vars in 1152 bytes} [Fri May 27 16:30:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:30:36.277919 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3f89cf-8787-4168-a5b1-d36a031fe896 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:36.278807 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96faeda9-2831-49a9-b7c9-39f1cb80f0c1 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:36.279955 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-2b3f89cf-8787-4168-a5b1-d36a031fe896 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:36.301653 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96faeda9-2831-49a9-b7c9-39f1cb80f0c1 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:36.307494 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c5c442-922f-424d-914a-ba77afc65e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:36.308300 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5c442-922f-424d-914a-ba77afc65e61 admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:36.309146 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5c442-922f-424d-914a-ba77afc65e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:36.309146 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5c442-922f-424d-914a-ba77afc65e61 admin admin] PATH_INFO: `/v3/projects` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:36.309801 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c5c442-922f-424d-914a-ba77afc65e61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:36.312488 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c5c442-922f-424d-914a-ba77afc65e61 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:36.314388 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3f89cf-8787-4168-a5b1-d36a031fe896 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:36.320136 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c38d7-2241-4e3f-b249-b97f591f211d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:36.320818 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c38d7-2241-4e3f-b249-b97f591f211d admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:36.321103 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c38d7-2241-4e3f-b249-b97f591f211d admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:36.321381 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c38d7-2241-4e3f-b249-b97f591f211d admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:36.322120 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6c38d7-2241-4e3f-b249-b97f591f211d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:36.323870 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6c38d7-2241-4e3f-b249-b97f591f211d admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:36.335391 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 930/1855] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:30:36.339574 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c38d7-2241-4e3f-b249-b97f591f211d admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:36.351150 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c38d7-2241-4e3f-b249-b97f591f211d admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:36.356195 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e54835-d544-468d-a223-477b13275105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:36.357539 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e54835-d544-468d-a223-477b13275105 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:36.357539 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e54835-d544-468d-a223-477b13275105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:36.357731 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e54835-d544-468d-a223-477b13275105 admin admin] PATH_INFO: `/v3/projects/0d8c8982a9db4fd393c21cd21fbdffea/users/1ba3de53a92e4051a92318a5348b98c3/roles/e04fe3eb1f714d74901ac83e33ea8a16` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:36.375081 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e54835-d544-468d-a223-477b13275105 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d8c8982a9db4fd393c21cd21fbdffea, user_id=1ba3de53a92e4051a92318a5348b98c3, role_id=e04fe3eb1f714d74901ac83e33ea8a16)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:36.377824 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e54835-d544-468d-a223-477b13275105 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:36.450223 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 926/1856] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:30:36 2022] POST /identity/v3/projects => generated 361 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:30:36.454935 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c5c442-922f-424d-914a-ba77afc65e61 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:36.480406 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 931/1857] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:30:36 2022] PUT /identity/v3/projects/0d8c8982a9db4fd393c21cd21fbdffea/users/1ba3de53a92e4051a92318a5348b98c3/roles/e04fe3eb1f714d74901ac83e33ea8a16 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:30:36.486052 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e54835-d544-468d-a223-477b13275105 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:36.570456 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c5c442-922f-424d-914a-ba77afc65e61 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:36.570690 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e54835-d544-468d-a223-477b13275105 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:36.575563 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435c609d-0d0b-4f5f-854e-a635192c05c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:36.575840 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e989c9-e41b-43fc-8023-4492e5e72c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:36.576273 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c609d-0d0b-4f5f-854e-a635192c05c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:36.576580 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c609d-0d0b-4f5f-854e-a635192c05c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:36.576686 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e989c9-e41b-43fc-8023-4492e5e72c93 admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:36.576859 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c609d-0d0b-4f5f-854e-a635192c05c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:36.577110 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e989c9-e41b-43fc-8023-4492e5e72c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:36.577461 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e989c9-e41b-43fc-8023-4492e5e72c93 admin admin] PATH_INFO: `/v3/users` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:36.577660 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435c609d-0d0b-4f5f-854e-a635192c05c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:36.578585 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e989c9-e41b-43fc-8023-4492e5e72c93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:36.579597 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435c609d-0d0b-4f5f-854e-a635192c05c3 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:36.580632 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e989c9-e41b-43fc-8023-4492e5e72c93 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:36.594303 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 932/1858] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 16:30:36.598139 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435c609d-0d0b-4f5f-854e-a635192c05c3 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:36.608747 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435c609d-0d0b-4f5f-854e-a635192c05c3 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:36.614198 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb90631-e0ae-44bc-971e-3eee48150846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:36.615152 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb90631-e0ae-44bc-971e-3eee48150846 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:36.617870 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb90631-e0ae-44bc-971e-3eee48150846 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:36.617870 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb90631-e0ae-44bc-971e-3eee48150846 admin admin] PATH_INFO: `/v3/projects/0d8c8982a9db4fd393c21cd21fbdffea/users/1ba3de53a92e4051a92318a5348b98c3/roles/e04fe3eb1f714d74901ac83e33ea8a16` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:36.617870 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb90631-e0ae-44bc-971e-3eee48150846 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d8c8982a9db4fd393c21cd21fbdffea, user_id=1ba3de53a92e4051a92318a5348b98c3, role_id=e04fe3eb1f714d74901ac83e33ea8a16)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:36.620242 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb90631-e0ae-44bc-971e-3eee48150846 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:36.637344 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 933/1859] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:30:36 2022] PUT /identity/v3/projects/0d8c8982a9db4fd393c21cd21fbdffea/users/1ba3de53a92e4051a92318a5348b98c3/roles/e04fe3eb1f714d74901ac83e33ea8a16 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:30:36.648101 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ddfbd-360d-4298-a06a-831c92c9be58 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:36.648568 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ddfbd-360d-4298-a06a-831c92c9be58 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:36.648747 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ddfbd-360d-4298-a06a-831c92c9be58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:36.682675 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-8a8ddfbd-360d-4298-a06a-831c92c9be58 None None] MFA Rules not processed for user `1ba3de53a92e4051a92318a5348b98c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:36.686533 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-8a8ddfbd-360d-4298-a06a-831c92c9be58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:36.693412 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 927/1860] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:30:36 2022] POST /identity/v3/users => generated 281 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:30:36.693412 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e989c9-e41b-43fc-8023-4492e5e72c93 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:36.698629 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-65e989c9-e41b-43fc-8023-4492e5e72c93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:36.720464 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e989c9-e41b-43fc-8023-4492e5e72c93 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:36.807831 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08242f34-e0cb-4606-b590-6083fbe01c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:36.808810 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08242f34-e0cb-4606-b590-6083fbe01c7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:36.810063 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08242f34-e0cb-4606-b590-6083fbe01c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:36.810063 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08242f34-e0cb-4606-b590-6083fbe01c7e admin admin] PATH_INFO: `/v3/projects/27600cf73457447781b80930780bdcc5` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:36.811895 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 934/1861] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:30:36 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:30:36.812453 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8ddfbd-360d-4298-a06a-831c92c9be58 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:36.816431 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08242f34-e0cb-4606-b590-6083fbe01c7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=27600cf73457447781b80930780bdcc5)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:36.818695 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08242f34-e0cb-4606-b590-6083fbe01c7e admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:36.839431 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8ddfbd-360d-4298-a06a-831c92c9be58 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:36.846857 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd2792-354b-4bed-8243-b38133947b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:36.849329 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd2792-354b-4bed-8243-b38133947b13 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:36.849329 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd2792-354b-4bed-8243-b38133947b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:36.849329 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd2792-354b-4bed-8243-b38133947b13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:36.850275 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffd2792-354b-4bed-8243-b38133947b13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:36.853122 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffd2792-354b-4bed-8243-b38133947b13 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:36.871958 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 935/1862] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:30:36.874745 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd2792-354b-4bed-8243-b38133947b13 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:36.876599 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-0ffd2792-354b-4bed-8243-b38133947b13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:36.985587 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd2792-354b-4bed-8243-b38133947b13 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:36.989753 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c41b3a-7ff3-4913-a417-31ac914a217d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8693a1e72f14fdfb383f11e96330726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:36.990618 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c41b3a-7ff3-4913-a417-31ac914a217d service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:36.990905 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c41b3a-7ff3-4913-a417-31ac914a217d service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:36.991185 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c41b3a-7ff3-4913-a417-31ac914a217d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:37.002969 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c41b3a-7ff3-4913-a417-31ac914a217d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:37.005553 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c41b3a-7ff3-4913-a417-31ac914a217d service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:37.012456 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-08242f34-e0cb-4606-b590-6083fbe01c7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27600cf73457447781b80930780bdcc5', 'request_id': 'req-08242f34-e0cb-4606-b590-6083fbe01c7e'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:37.024076 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-08242f34-e0cb-4606-b590-6083fbe01c7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27600cf73457447781b80930780bdcc5', 'request_id': 'req-08242f34-e0cb-4606-b590-6083fbe01c7e'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:37.024712 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 936/1863] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:30:36 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:30:37.031372 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c41b3a-7ff3-4913-a417-31ac914a217d service cinder] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:37.032174 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-08242f34-e0cb-4606-b590-6083fbe01c7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27600cf73457447781b80930780bdcc5', 'request_id': 'req-08242f34-e0cb-4606-b590-6083fbe01c7e'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:37.046993 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c41b3a-7ff3-4913-a417-31ac914a217d service cinder] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:37.130110 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c86270-bc94-4183-a509-b0b9352ada19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:37.131482 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c86270-bc94-4183-a509-b0b9352ada19 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:37.131840 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c86270-bc94-4183-a509-b0b9352ada19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:37.132157 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c86270-bc94-4183-a509-b0b9352ada19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:37.133892 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c86270-bc94-4183-a509-b0b9352ada19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:37.145656 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-08242f34-e0cb-4606-b590-6083fbe01c7e admin admin] The token cache is being invalidate because project 27600cf73457447781b80930780bdcc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80288) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:30:37.146535 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-08242f34-e0cb-4606-b590-6083fbe01c7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:37.146877 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c86270-bc94-4183-a509-b0b9352ada19 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:37.147871 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-08242f34-e0cb-4606-b590-6083fbe01c7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:37.160551 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 928/1864] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:30:36 2022] DELETE /identity/v3/projects/27600cf73457447781b80930780bdcc5 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:30:37.161492 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 937/1865] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:30:37 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:30:37.164117 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9212df-95ca-4e17-bd4d-d07ed6fcd82d None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:37.164663 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9212df-95ca-4e17-bd4d-d07ed6fcd82d None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:37.165031 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9212df-95ca-4e17-bd4d-d07ed6fcd82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:37.169863 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c86270-bc94-4183-a509-b0b9352ada19 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:37.176950 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-b2c86270-bc94-4183-a509-b0b9352ada19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:37.197398 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c86270-bc94-4183-a509-b0b9352ada19 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:37.197580 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-9e9212df-95ca-4e17-bd4d-d07ed6fcd82d None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:37.198745 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-9e9212df-95ca-4e17-bd4d-d07ed6fcd82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:37.207855 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 929/1866] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:30:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:30:37.214461 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4d4f25-592e-4e1d-b245-fe960675d804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:37.214461 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d4f25-592e-4e1d-b245-fe960675d804 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:37.214461 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d4f25-592e-4e1d-b245-fe960675d804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:37.214461 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d4f25-592e-4e1d-b245-fe960675d804 admin admin] PATH_INFO: `/v3/projects/76e57f1b024a4e57a73d1ed07cbcc999/users/adaeba97e82e4533a9cd1e7f698aac91/roles/c8ce6d197f654598ac45f6016ecccabd` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:37.216831 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d75e88-feaf-42a1-b27a-67b3f65a0e79 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:37.217453 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d75e88-feaf-42a1-b27a-67b3f65a0e79 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:37.217841 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d75e88-feaf-42a1-b27a-67b3f65a0e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:37.229068 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4d4f25-592e-4e1d-b245-fe960675d804 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76e57f1b024a4e57a73d1ed07cbcc999, user_id=adaeba97e82e4533a9cd1e7f698aac91, role_id=c8ce6d197f654598ac45f6016ecccabd)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:37.231810 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4d4f25-592e-4e1d-b245-fe960675d804 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:37.241685 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-75d75e88-feaf-42a1-b27a-67b3f65a0e79 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:37.243241 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-75d75e88-feaf-42a1-b27a-67b3f65a0e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:37.257545 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 930/1867] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:30:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:30:37.258646 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d75e88-feaf-42a1-b27a-67b3f65a0e79 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:37.271810 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d75e88-feaf-42a1-b27a-67b3f65a0e79 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:37.284459 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77173b60-6562-4b6c-bba1-9a65b98e9f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:37.285314 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77173b60-6562-4b6c-bba1-9a65b98e9f6b admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:37.285674 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77173b60-6562-4b6c-bba1-9a65b98e9f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:37.286042 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77173b60-6562-4b6c-bba1-9a65b98e9f6b admin admin] PATH_INFO: `/v3/domains` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:37.287054 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77173b60-6562-4b6c-bba1-9a65b98e9f6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:30:37.287452 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77173b60-6562-4b6c-bba1-9a65b98e9f6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:37.289246 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77173b60-6562-4b6c-bba1-9a65b98e9f6b admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:37.302788 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 931/1868] 10.222.0.62 () {58 vars in 1152 bytes} [Fri May 27 16:30:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:30:37.306842 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77173b60-6562-4b6c-bba1-9a65b98e9f6b admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:37.317519 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77173b60-6562-4b6c-bba1-9a65b98e9f6b admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:37.322335 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93578799-122a-43c4-b72a-ad4afdacc39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:37.322999 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93578799-122a-43c4-b72a-ad4afdacc39f admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:37.323286 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93578799-122a-43c4-b72a-ad4afdacc39f admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:37.323568 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93578799-122a-43c4-b72a-ad4afdacc39f admin admin] PATH_INFO: `/v3/projects` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:37.324260 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93578799-122a-43c4-b72a-ad4afdacc39f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:37.326173 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93578799-122a-43c4-b72a-ad4afdacc39f admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:37.362917 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 938/1869] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:30:37 2022] PUT /identity/v3/projects/76e57f1b024a4e57a73d1ed07cbcc999/users/adaeba97e82e4533a9cd1e7f698aac91/roles/c8ce6d197f654598ac45f6016ecccabd => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:30:37.368275 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16fc5b7-b3ae-4466-b4a4-ee605dfb2eb3 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:37.368577 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16fc5b7-b3ae-4466-b4a4-ee605dfb2eb3 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:37.368857 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16fc5b7-b3ae-4466-b4a4-ee605dfb2eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:37.398272 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-b16fc5b7-b3ae-4466-b4a4-ee605dfb2eb3 None None] MFA Rules not processed for user `adaeba97e82e4533a9cd1e7f698aac91`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:37.400865 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-b16fc5b7-b3ae-4466-b4a4-ee605dfb2eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:37.464931 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 932/1870] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:30:37 2022] POST /identity/v3/projects => generated 381 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:30:37.464931 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93578799-122a-43c4-b72a-ad4afdacc39f admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:37.466460 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-93578799-122a-43c4-b72a-ad4afdacc39f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:37.474576 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 939/1871] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:30:37 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:30:37.475180 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16fc5b7-b3ae-4466-b4a4-ee605dfb2eb3 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:37.535372 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93578799-122a-43c4-b72a-ad4afdacc39f admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:37.545108 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705e0f7e-9115-4279-909b-602b6d92e021 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8693a1e72f14fdfb383f11e96330726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:37.546410 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e0f7e-9115-4279-909b-602b6d92e021 service cinder] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:37.546711 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e0f7e-9115-4279-909b-602b6d92e021 service cinder] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:37.547139 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e0f7e-9115-4279-909b-602b6d92e021 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:37.549416 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-705e0f7e-9115-4279-909b-602b6d92e021 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:37.564448 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16fc5b7-b3ae-4466-b4a4-ee605dfb2eb3 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:37.626983 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705e0f7e-9115-4279-909b-602b6d92e021 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:37.630166 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705e0f7e-9115-4279-909b-602b6d92e021 service cinder] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:37.639915 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0ba7ad-ee1d-4aa6-bab8-3ff3578d5bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:37.642658 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0ba7ad-ee1d-4aa6-bab8-3ff3578d5bd1 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:37.643190 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0ba7ad-ee1d-4aa6-bab8-3ff3578d5bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:37.643816 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 933/1872] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:30:37 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:30:37.643950 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0ba7ad-ee1d-4aa6-bab8-3ff3578d5bd1 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:37.644419 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0ba7ad-ee1d-4aa6-bab8-3ff3578d5bd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:37.646694 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0ba7ad-ee1d-4aa6-bab8-3ff3578d5bd1 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:37.648903 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705e0f7e-9115-4279-909b-602b6d92e021 service cinder] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:37.667285 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705e0f7e-9115-4279-909b-602b6d92e021 service cinder] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:37.674876 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9f74bd-1af9-4002-9797-28cd5d5c8e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:37.676953 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f74bd-1af9-4002-9797-28cd5d5c8e31 admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:37.676953 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f74bd-1af9-4002-9797-28cd5d5c8e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:37.677163 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f74bd-1af9-4002-9797-28cd5d5c8e31 admin admin] PATH_INFO: `/v3/projects` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:37.679000 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9f74bd-1af9-4002-9797-28cd5d5c8e31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:37.681143 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9f74bd-1af9-4002-9797-28cd5d5c8e31 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:37.748013 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 940/1873] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:30:37 2022] POST /identity/v3/users => generated 291 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:30:37.751614 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0ba7ad-ee1d-4aa6-bab8-3ff3578d5bd1 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:37.764608 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0ba7ad-ee1d-4aa6-bab8-3ff3578d5bd1 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:37.769972 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb0362-eb9e-4e14-ac42-c42b48f58b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:37.770757 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb0362-eb9e-4e14-ac42-c42b48f58b7d admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:37.771067 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb0362-eb9e-4e14-ac42-c42b48f58b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:37.771495 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb0362-eb9e-4e14-ac42-c42b48f58b7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:37.775082 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfb0362-eb9e-4e14-ac42-c42b48f58b7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:37.775082 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfb0362-eb9e-4e14-ac42-c42b48f58b7d admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:37.786293 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 941/1874] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:30:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 16:30:37.789331 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb0362-eb9e-4e14-ac42-c42b48f58b7d admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:37.800898 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb0362-eb9e-4e14-ac42-c42b48f58b7d admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:37.807036 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37750cf4-024b-4097-8460-70974cd7c236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:37.807936 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37750cf4-024b-4097-8460-70974cd7c236 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:37.808306 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37750cf4-024b-4097-8460-70974cd7c236 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:37.808594 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37750cf4-024b-4097-8460-70974cd7c236 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:37.809333 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37750cf4-024b-4097-8460-70974cd7c236 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:37.811126 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37750cf4-024b-4097-8460-70974cd7c236 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:37.825374 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 942/1875] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:30:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 16:30:37.828809 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37750cf4-024b-4097-8460-70974cd7c236 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:37.847488 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37750cf4-024b-4097-8460-70974cd7c236 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:37.855335 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975691f8-375e-4eba-9071-e1c300f2dcc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:37.857077 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975691f8-375e-4eba-9071-e1c300f2dcc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:37.857569 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975691f8-375e-4eba-9071-e1c300f2dcc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:37.857914 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975691f8-375e-4eba-9071-e1c300f2dcc6 admin admin] PATH_INFO: `/v3/projects/08294b15465e4e2f95287968ca768cd4/users/4f32f75cf1444173b47613fa080245cd/roles/c8ce6d197f654598ac45f6016ecccabd` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:37.880638 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975691f8-375e-4eba-9071-e1c300f2dcc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08294b15465e4e2f95287968ca768cd4, user_id=4f32f75cf1444173b47613fa080245cd, role_id=c8ce6d197f654598ac45f6016ecccabd)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:37.885196 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975691f8-375e-4eba-9071-e1c300f2dcc6 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:37.900008 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 934/1876] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:30:37 2022] POST /identity/v3/projects => generated 365 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:30:37.901038 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9f74bd-1af9-4002-9797-28cd5d5c8e31 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:38.027599 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9f74bd-1af9-4002-9797-28cd5d5c8e31 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:38.033697 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 943/1877] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:30:37 2022] PUT /identity/v3/projects/08294b15465e4e2f95287968ca768cd4/users/4f32f75cf1444173b47613fa080245cd/roles/c8ce6d197f654598ac45f6016ecccabd => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:30:38.045003 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e96dda-1b5c-476d-aa12-009df40abb5d None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:38.046681 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e96dda-1b5c-476d-aa12-009df40abb5d None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:38.047103 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e96dda-1b5c-476d-aa12-009df40abb5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:38.099758 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-72e96dda-1b5c-476d-aa12-009df40abb5d None None] MFA Rules not processed for user `4f32f75cf1444173b47613fa080245cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:38.101200 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-72e96dda-1b5c-476d-aa12-009df40abb5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:38.137565 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3166698-813b-4252-8135-4a4032cac051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:38.139303 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3166698-813b-4252-8135-4a4032cac051 admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:38.141049 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3166698-813b-4252-8135-4a4032cac051 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:38.143211 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3166698-813b-4252-8135-4a4032cac051 admin admin] PATH_INFO: `/v3/users` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:38.144871 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3166698-813b-4252-8135-4a4032cac051 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:38.147131 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3166698-813b-4252-8135-4a4032cac051 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:38.230707 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 944/1878] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:30:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:30:38.234968 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e96dda-1b5c-476d-aa12-009df40abb5d None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:38.248356 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e96dda-1b5c-476d-aa12-009df40abb5d None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:38.254002 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1b3b46-41eb-4049-b169-cfb0c889efb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:38.254804 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b3b46-41eb-4049-b169-cfb0c889efb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:38.255168 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b3b46-41eb-4049-b169-cfb0c889efb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:38.255527 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b3b46-41eb-4049-b169-cfb0c889efb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:38.256562 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1b3b46-41eb-4049-b169-cfb0c889efb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:38.258748 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1b3b46-41eb-4049-b169-cfb0c889efb7 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:38.268378 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 935/1879] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:30:37 2022] POST /identity/v3/users => generated 289 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:30:38.278927 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3166698-813b-4252-8135-4a4032cac051 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:38.290692 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3166698-813b-4252-8135-4a4032cac051 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:38.295784 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc07b9fc-6ba1-4283-96e7-62a81a167a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:38.296542 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07b9fc-6ba1-4283-96e7-62a81a167a75 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:38.296828 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07b9fc-6ba1-4283-96e7-62a81a167a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:38.297105 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07b9fc-6ba1-4283-96e7-62a81a167a75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:38.297845 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc07b9fc-6ba1-4283-96e7-62a81a167a75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:38.299492 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc07b9fc-6ba1-4283-96e7-62a81a167a75 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:38.311617 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 936/1880] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:30:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:30:38.316642 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc07b9fc-6ba1-4283-96e7-62a81a167a75 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:38.330328 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc07b9fc-6ba1-4283-96e7-62a81a167a75 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:38.340855 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d091a2-2cef-47f5-b65f-331d20fb7ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:38.341862 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d091a2-2cef-47f5-b65f-331d20fb7ce9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:38.342589 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d091a2-2cef-47f5-b65f-331d20fb7ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:38.342589 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d091a2-2cef-47f5-b65f-331d20fb7ce9 admin admin] PATH_INFO: `/v3/projects/12ff33c7452e4d7db365a718059ee46b/users/d0a3f4f086ab45b3abd5c42c6013a9dd/roles/e04fe3eb1f714d74901ac83e33ea8a16` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:38.363812 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d091a2-2cef-47f5-b65f-331d20fb7ce9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12ff33c7452e4d7db365a718059ee46b, user_id=d0a3f4f086ab45b3abd5c42c6013a9dd, role_id=e04fe3eb1f714d74901ac83e33ea8a16)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:38.367764 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d091a2-2cef-47f5-b65f-331d20fb7ce9 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:38.396101 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 945/1881] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:30:38 2022] POST /identity/v3/projects => generated 381 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:30:38.399003 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1b3b46-41eb-4049-b169-cfb0c889efb7 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:38.472709 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 937/1882] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:30:38 2022] PUT /identity/v3/projects/12ff33c7452e4d7db365a718059ee46b/users/d0a3f4f086ab45b3abd5c42c6013a9dd/roles/e04fe3eb1f714d74901ac83e33ea8a16 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:30:38.473668 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d091a2-2cef-47f5-b65f-331d20fb7ce9 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:38.482298 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1b3b46-41eb-4049-b169-cfb0c889efb7 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:38.571336 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aaa5c8-34f1-4cb8-9db9-66f3947de148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:38.572154 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aaa5c8-34f1-4cb8-9db9-66f3947de148 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:38.572444 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aaa5c8-34f1-4cb8-9db9-66f3947de148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:38.572918 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aaa5c8-34f1-4cb8-9db9-66f3947de148 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:38.577458 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aaa5c8-34f1-4cb8-9db9-66f3947de148 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:38.578018 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aaa5c8-34f1-4cb8-9db9-66f3947de148 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:38.595401 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d091a2-2cef-47f5-b65f-331d20fb7ce9 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:38.602300 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd31a89-25de-4fbe-b5e3-705d54709223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:38.607202 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd31a89-25de-4fbe-b5e3-705d54709223 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:38.607202 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd31a89-25de-4fbe-b5e3-705d54709223 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:38.607202 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd31a89-25de-4fbe-b5e3-705d54709223 admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:38.607202 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd31a89-25de-4fbe-b5e3-705d54709223 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:38.607202 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd31a89-25de-4fbe-b5e3-705d54709223 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:38.620798 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 938/1883] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:30:38 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:30:38.626749 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd31a89-25de-4fbe-b5e3-705d54709223 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:38.639789 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd31a89-25de-4fbe-b5e3-705d54709223 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:38.645300 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a495064-297a-483e-9320-c93fa2d99ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:38.655630 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a495064-297a-483e-9320-c93fa2d99ab5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:38.655630 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a495064-297a-483e-9320-c93fa2d99ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:38.655630 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a495064-297a-483e-9320-c93fa2d99ab5 admin admin] PATH_INFO: `/v3/projects/12ff33c7452e4d7db365a718059ee46b/users/d0a3f4f086ab45b3abd5c42c6013a9dd/roles/e04fe3eb1f714d74901ac83e33ea8a16` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:38.655630 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a495064-297a-483e-9320-c93fa2d99ab5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12ff33c7452e4d7db365a718059ee46b, user_id=d0a3f4f086ab45b3abd5c42c6013a9dd, role_id=e04fe3eb1f714d74901ac83e33ea8a16)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:38.655630 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a495064-297a-483e-9320-c93fa2d99ab5 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:38.664262 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 939/1884] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:30:38 2022] PUT /identity/v3/projects/12ff33c7452e4d7db365a718059ee46b/users/d0a3f4f086ab45b3abd5c42c6013a9dd/roles/e04fe3eb1f714d74901ac83e33ea8a16 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:30:38.677029 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc5d250-a4f2-42a0-897a-fd6225f3523b None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:38.677322 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc5d250-a4f2-42a0-897a-fd6225f3523b None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:38.678150 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc5d250-a4f2-42a0-897a-fd6225f3523b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:38.714962 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-9bc5d250-a4f2-42a0-897a-fd6225f3523b None None] MFA Rules not processed for user `d0a3f4f086ab45b3abd5c42c6013a9dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:38.716776 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-9bc5d250-a4f2-42a0-897a-fd6225f3523b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:38.760200 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 946/1885] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:30:38 2022] POST /identity/v3/users => generated 297 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:30:38.764402 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aaa5c8-34f1-4cb8-9db9-66f3947de148 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:38.778743 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aaa5c8-34f1-4cb8-9db9-66f3947de148 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:38.823000 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 940/1886] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:30:38 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:30:38.832358 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc5d250-a4f2-42a0-897a-fd6225f3523b None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:38.880988 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3105053-bbc7-430f-b989-143195ee083b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:38.881795 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3105053-bbc7-430f-b989-143195ee083b admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:38.882324 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3105053-bbc7-430f-b989-143195ee083b admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:38.882614 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3105053-bbc7-430f-b989-143195ee083b admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:38.883383 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3105053-bbc7-430f-b989-143195ee083b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:38.885383 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3105053-bbc7-430f-b989-143195ee083b admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:38.898016 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 947/1887] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:30:38 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:30:38.903056 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3105053-bbc7-430f-b989-143195ee083b admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:38.920503 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3105053-bbc7-430f-b989-143195ee083b admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:38.929054 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a3d65-801a-4b8e-9ac3-0e6eea236c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:38.929809 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a3d65-801a-4b8e-9ac3-0e6eea236c7d admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:38.930095 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a3d65-801a-4b8e-9ac3-0e6eea236c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:38.930415 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a3d65-801a-4b8e-9ac3-0e6eea236c7d admin admin] PATH_INFO: `/v3/projects/2029edaa368f42198a33401294085916/users/50b3b64e0a0e4a268aa6baf8e4c40fb5/roles/e04fe3eb1f714d74901ac83e33ea8a16` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:38.939862 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc5d250-a4f2-42a0-897a-fd6225f3523b None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:38.945414 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a1fbec-cdf0-4959-bcdc-43c882400e37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8693a1e72f14fdfb383f11e96330726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:38.946257 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1fbec-cdf0-4959-bcdc-43c882400e37 service cinder] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:38.946564 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1fbec-cdf0-4959-bcdc-43c882400e37 service cinder] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:38.946843 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1fbec-cdf0-4959-bcdc-43c882400e37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:38.953781 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936a3d65-801a-4b8e-9ac3-0e6eea236c7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2029edaa368f42198a33401294085916, user_id=50b3b64e0a0e4a268aa6baf8e4c40fb5, role_id=e04fe3eb1f714d74901ac83e33ea8a16)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:38.957338 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936a3d65-801a-4b8e-9ac3-0e6eea236c7d admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:38.975685 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a1fbec-cdf0-4959-bcdc-43c882400e37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:38.977211 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a1fbec-cdf0-4959-bcdc-43c882400e37 service cinder] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:38.987444 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 941/1888] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:30:38 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 16:30:39.109838 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 948/1889] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:30:38 2022] PUT /identity/v3/projects/2029edaa368f42198a33401294085916/users/50b3b64e0a0e4a268aa6baf8e4c40fb5/roles/e04fe3eb1f714d74901ac83e33ea8a16 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:30:39.114441 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a1fbec-cdf0-4959-bcdc-43c882400e37 service cinder] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:39.144322 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a1fbec-cdf0-4959-bcdc-43c882400e37 service cinder] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:39.235560 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd35136-3436-46a1-a7a4-94bad950228e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:39.236399 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd35136-3436-46a1-a7a4-94bad950228e admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:39.237021 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd35136-3436-46a1-a7a4-94bad950228e admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:39.237309 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd35136-3436-46a1-a7a4-94bad950228e admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:39.239022 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd35136-3436-46a1-a7a4-94bad950228e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:39.240801 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd35136-3436-46a1-a7a4-94bad950228e admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:39.258064 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:30:39.260374 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 942/1890] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:30:39 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:30:39.266221 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a3d65-801a-4b8e-9ac3-0e6eea236c7d admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:39.282541 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a3d65-801a-4b8e-9ac3-0e6eea236c7d admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:39.311570 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddba5376-5e49-45e1-b708-a696e6113156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:39.312910 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba5376-5e49-45e1-b708-a696e6113156 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:39.314660 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba5376-5e49-45e1-b708-a696e6113156 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:39.316638 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba5376-5e49-45e1-b708-a696e6113156 admin admin] PATH_INFO: `/v3/projects/2029edaa368f42198a33401294085916/users/50b3b64e0a0e4a268aa6baf8e4c40fb5/roles/e04fe3eb1f714d74901ac83e33ea8a16` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:39.328435 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddba5376-5e49-45e1-b708-a696e6113156 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2029edaa368f42198a33401294085916, user_id=50b3b64e0a0e4a268aa6baf8e4c40fb5, role_id=e04fe3eb1f714d74901ac83e33ea8a16)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:39.328435 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddba5376-5e49-45e1-b708-a696e6113156 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:39.342480 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd35136-3436-46a1-a7a4-94bad950228e admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:39.358306 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 949/1891] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:30:39 2022] PUT /identity/v3/projects/2029edaa368f42198a33401294085916/users/50b3b64e0a0e4a268aa6baf8e4c40fb5/roles/e04fe3eb1f714d74901ac83e33ea8a16 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:30:39.365579 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ca6f1-ec03-4eed-89b6-063f9765e779 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:39.365875 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ca6f1-ec03-4eed-89b6-063f9765e779 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:39.366160 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ca6f1-ec03-4eed-89b6-063f9765e779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:39.408331 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-d26ca6f1-ec03-4eed-89b6-063f9765e779 None None] MFA Rules not processed for user `50b3b64e0a0e4a268aa6baf8e4c40fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:39.410828 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-d26ca6f1-ec03-4eed-89b6-063f9765e779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:39.473517 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd35136-3436-46a1-a7a4-94bad950228e admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:39.567183 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 950/1892] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:30:39 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:30:39.578431 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1576c03d-9012-41df-bd52-7b2645ea71fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8693a1e72f14fdfb383f11e96330726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:39.579262 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1576c03d-9012-41df-bd52-7b2645ea71fa service cinder] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:39.579795 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1576c03d-9012-41df-bd52-7b2645ea71fa service cinder] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:39.580082 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1576c03d-9012-41df-bd52-7b2645ea71fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:39.646876 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1576c03d-9012-41df-bd52-7b2645ea71fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:39.648645 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1576c03d-9012-41df-bd52-7b2645ea71fa service cinder] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:39.664825 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 943/1893] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:30:39 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:30:40.009817 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:30:40.378768 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ca6f1-ec03-4eed-89b6-063f9765e779 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:40.390124 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ca6f1-ec03-4eed-89b6-063f9765e779 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:40.395305 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3066a8-bb42-4f46-92dd-cda4d9512105 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8693a1e72f14fdfb383f11e96330726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:40.396186 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3066a8-bb42-4f46-92dd-cda4d9512105 service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:40.396839 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3066a8-bb42-4f46-92dd-cda4d9512105 service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:40.397463 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3066a8-bb42-4f46-92dd-cda4d9512105 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:40.407419 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3066a8-bb42-4f46-92dd-cda4d9512105 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:40.408864 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3066a8-bb42-4f46-92dd-cda4d9512105 service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:40.419109 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 951/1894] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:30:40 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:30:40.467933 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:30:43.044375 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1576c03d-9012-41df-bd52-7b2645ea71fa service cinder] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:43.045836 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-1576c03d-9012-41df-bd52-7b2645ea71fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:43.132725 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1576c03d-9012-41df-bd52-7b2645ea71fa service cinder] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:43.146014 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910a6d88-520d-445b-b8a3-c1016f7a04ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:43.147568 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a6d88-520d-445b-b8a3-c1016f7a04ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:43.147568 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a6d88-520d-445b-b8a3-c1016f7a04ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:43.147568 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a6d88-520d-445b-b8a3-c1016f7a04ea admin admin] PATH_INFO: `/v3/users/43c11bf65ad94a7b8333677c008f5844` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:43.157693 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910a6d88-520d-445b-b8a3-c1016f7a04ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=43c11bf65ad94a7b8333677c008f5844)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:43.157693 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910a6d88-520d-445b-b8a3-c1016f7a04ea admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:43.508844 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-910a6d88-520d-445b-b8a3-c1016f7a04ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43c11bf65ad94a7b8333677c008f5844'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:43.529774 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-910a6d88-520d-445b-b8a3-c1016f7a04ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43c11bf65ad94a7b8333677c008f5844'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:43.530529 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-910a6d88-520d-445b-b8a3-c1016f7a04ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43c11bf65ad94a7b8333677c008f5844'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:43.531150 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-910a6d88-520d-445b-b8a3-c1016f7a04ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43c11bf65ad94a7b8333677c008f5844'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:43.730016 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-910a6d88-520d-445b-b8a3-c1016f7a04ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43c11bf65ad94a7b8333677c008f5844'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:43.748835 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 944/1895] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:30:43 2022] DELETE /identity/v3/users/43c11bf65ad94a7b8333677c008f5844 => generated 0 bytes in 704 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:30:43.752942 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aebaca-f97b-4164-837a-8057a112adf0 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:43.757345 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aebaca-f97b-4164-837a-8057a112adf0 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:43.757345 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aebaca-f97b-4164-837a-8057a112adf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:43.773551 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-c0aebaca-f97b-4164-837a-8057a112adf0 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:43.775017 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-c0aebaca-f97b-4164-837a-8057a112adf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:43.854543 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910a6d88-520d-445b-b8a3-c1016f7a04ea admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:43.856064 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-910a6d88-520d-445b-b8a3-c1016f7a04ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:43.887517 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 952/1896] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:30:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:30:43.913693 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aebaca-f97b-4164-837a-8057a112adf0 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:43.917726 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-c0aebaca-f97b-4164-837a-8057a112adf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:44.034015 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910a6d88-520d-445b-b8a3-c1016f7a04ea admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:44.041092 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b574e2c0-22c7-46ec-90f1-450ea0ad56ca tempest-VolumeQuotaClassesTest-1163174671 tempest-VolumeQuotaClassesTest-1163174671-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b3b64e0a0e4a268aa6baf8e4c40fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2029edaa368f42198a33401294085916', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:44.041914 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574e2c0-22c7-46ec-90f1-450ea0ad56ca tempest-VolumeQuotaClassesTest-1163174671 tempest-VolumeQuotaClassesTest-1163174671-project-admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:44.042438 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574e2c0-22c7-46ec-90f1-450ea0ad56ca tempest-VolumeQuotaClassesTest-1163174671 tempest-VolumeQuotaClassesTest-1163174671-project-admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:44.042952 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574e2c0-22c7-46ec-90f1-450ea0ad56ca tempest-VolumeQuotaClassesTest-1163174671 tempest-VolumeQuotaClassesTest-1163174671-project-admin] PATH_INFO: `/v3/domains` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:44.043850 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b574e2c0-22c7-46ec-90f1-450ea0ad56ca tempest-VolumeQuotaClassesTest-1163174671 tempest-VolumeQuotaClassesTest-1163174671-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:30:44.044415 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b574e2c0-22c7-46ec-90f1-450ea0ad56ca tempest-VolumeQuotaClassesTest-1163174671 tempest-VolumeQuotaClassesTest-1163174671-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:44.046186 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b574e2c0-22c7-46ec-90f1-450ea0ad56ca tempest-VolumeQuotaClassesTest-1163174671 tempest-VolumeQuotaClassesTest-1163174671-project-admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:44.058174 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aebaca-f97b-4164-837a-8057a112adf0 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:44.059492 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 945/1897] 10.222.0.62 () {58 vars in 1152 bytes} [Fri May 27 16:30:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:30:44.063251 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675369ff-7a06-4046-8dbb-9817d33c581e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:44.063681 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b574e2c0-22c7-46ec-90f1-450ea0ad56ca tempest-VolumeQuotaClassesTest-1163174671 tempest-VolumeQuotaClassesTest-1163174671-project-admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:44.063944 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675369ff-7a06-4046-8dbb-9817d33c581e service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:44.064291 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675369ff-7a06-4046-8dbb-9817d33c581e service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:44.064499 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675369ff-7a06-4046-8dbb-9817d33c581e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:44.074282 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675369ff-7a06-4046-8dbb-9817d33c581e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:44.075403 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b574e2c0-22c7-46ec-90f1-450ea0ad56ca tempest-VolumeQuotaClassesTest-1163174671 tempest-VolumeQuotaClassesTest-1163174671-project-admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:44.075902 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675369ff-7a06-4046-8dbb-9817d33c581e service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:44.080616 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562a835f-6a53-4b43-8252-6b93432ebb8c tempest-VolumeQuotaClassesTest-1163174671 tempest-VolumeQuotaClassesTest-1163174671-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b3b64e0a0e4a268aa6baf8e4c40fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2029edaa368f42198a33401294085916', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:44.082115 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a835f-6a53-4b43-8252-6b93432ebb8c tempest-VolumeQuotaClassesTest-1163174671 tempest-VolumeQuotaClassesTest-1163174671-project-admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:44.082403 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a835f-6a53-4b43-8252-6b93432ebb8c tempest-VolumeQuotaClassesTest-1163174671 tempest-VolumeQuotaClassesTest-1163174671-project-admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:44.082795 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a835f-6a53-4b43-8252-6b93432ebb8c tempest-VolumeQuotaClassesTest-1163174671 tempest-VolumeQuotaClassesTest-1163174671-project-admin] PATH_INFO: `/v3/projects` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:44.083701 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562a835f-6a53-4b43-8252-6b93432ebb8c tempest-VolumeQuotaClassesTest-1163174671 tempest-VolumeQuotaClassesTest-1163174671-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:44.085901 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562a835f-6a53-4b43-8252-6b93432ebb8c tempest-VolumeQuotaClassesTest-1163174671 tempest-VolumeQuotaClassesTest-1163174671-project-admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:44.087210 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 953/1898] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:30:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:30:44.262373 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 946/1899] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:30:44 2022] POST /identity/v3/projects => generated 355 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:30:44.266863 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675369ff-7a06-4046-8dbb-9817d33c581e service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:44.278502 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675369ff-7a06-4046-8dbb-9817d33c581e service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:44.401931 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbc92d4-eb3e-45da-ab46-102ccc5d5965 tempest-VolumeQuotaClassesTest-1163174671 tempest-VolumeQuotaClassesTest-1163174671-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b3b64e0a0e4a268aa6baf8e4c40fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2029edaa368f42198a33401294085916', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:44.404150 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc92d4-eb3e-45da-ab46-102ccc5d5965 tempest-VolumeQuotaClassesTest-1163174671 tempest-VolumeQuotaClassesTest-1163174671-project-admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:44.404443 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc92d4-eb3e-45da-ab46-102ccc5d5965 tempest-VolumeQuotaClassesTest-1163174671 tempest-VolumeQuotaClassesTest-1163174671-project-admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:44.404722 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc92d4-eb3e-45da-ab46-102ccc5d5965 tempest-VolumeQuotaClassesTest-1163174671 tempest-VolumeQuotaClassesTest-1163174671-project-admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:44.408340 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbc92d4-eb3e-45da-ab46-102ccc5d5965 tempest-VolumeQuotaClassesTest-1163174671 tempest-VolumeQuotaClassesTest-1163174671-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:30:44.408340 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbc92d4-eb3e-45da-ab46-102ccc5d5965 tempest-VolumeQuotaClassesTest-1163174671 tempest-VolumeQuotaClassesTest-1163174671-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:44.410808 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbc92d4-eb3e-45da-ab46-102ccc5d5965 tempest-VolumeQuotaClassesTest-1163174671 tempest-VolumeQuotaClassesTest-1163174671-project-admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:44.439785 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 954/1900] 10.222.0.62 () {58 vars in 1152 bytes} [Fri May 27 16:30:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:30:44.481405 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562a835f-6a53-4b43-8252-6b93432ebb8c tempest-VolumeQuotaClassesTest-1163174671 tempest-VolumeQuotaClassesTest-1163174671-project-admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:44.496103 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562a835f-6a53-4b43-8252-6b93432ebb8c tempest-VolumeQuotaClassesTest-1163174671 tempest-VolumeQuotaClassesTest-1163174671-project-admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:44.511417 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a98db-a6fc-45a1-b714-fa95f4693f9d tempest-VolumeQuotaClassesTest-1163174671 tempest-VolumeQuotaClassesTest-1163174671-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b3b64e0a0e4a268aa6baf8e4c40fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2029edaa368f42198a33401294085916', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:44.512735 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a98db-a6fc-45a1-b714-fa95f4693f9d tempest-VolumeQuotaClassesTest-1163174671 tempest-VolumeQuotaClassesTest-1163174671-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:44.513036 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a98db-a6fc-45a1-b714-fa95f4693f9d tempest-VolumeQuotaClassesTest-1163174671 tempest-VolumeQuotaClassesTest-1163174671-project-admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:44.513444 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a98db-a6fc-45a1-b714-fa95f4693f9d tempest-VolumeQuotaClassesTest-1163174671 tempest-VolumeQuotaClassesTest-1163174671-project-admin] PATH_INFO: `/v3/projects/5a62a1cbfe5649ebbbeab8cbead75d01` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:44.516101 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889a98db-a6fc-45a1-b714-fa95f4693f9d tempest-VolumeQuotaClassesTest-1163174671 tempest-VolumeQuotaClassesTest-1163174671-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5a62a1cbfe5649ebbbeab8cbead75d01)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:44.520671 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889a98db-a6fc-45a1-b714-fa95f4693f9d tempest-VolumeQuotaClassesTest-1163174671 tempest-VolumeQuotaClassesTest-1163174671-project-admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:44.649126 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbc92d4-eb3e-45da-ab46-102ccc5d5965 tempest-VolumeQuotaClassesTest-1163174671 tempest-VolumeQuotaClassesTest-1163174671-project-admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:44.653992 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-ebbc92d4-eb3e-45da-ab46-102ccc5d5965 tempest-VolumeQuotaClassesTest-1163174671 tempest-VolumeQuotaClassesTest-1163174671-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:44.683415 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-889a98db-a6fc-45a1-b714-fa95f4693f9d tempest-VolumeQuotaClassesTest-1163174671 tempest-VolumeQuotaClassesTest-1163174671-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a62a1cbfe5649ebbbeab8cbead75d01', 'request_id': 'req-889a98db-a6fc-45a1-b714-fa95f4693f9d'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:44.688057 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-889a98db-a6fc-45a1-b714-fa95f4693f9d tempest-VolumeQuotaClassesTest-1163174671 tempest-VolumeQuotaClassesTest-1163174671-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a62a1cbfe5649ebbbeab8cbead75d01', 'request_id': 'req-889a98db-a6fc-45a1-b714-fa95f4693f9d'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:44.693816 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-889a98db-a6fc-45a1-b714-fa95f4693f9d tempest-VolumeQuotaClassesTest-1163174671 tempest-VolumeQuotaClassesTest-1163174671-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a62a1cbfe5649ebbbeab8cbead75d01', 'request_id': 'req-889a98db-a6fc-45a1-b714-fa95f4693f9d'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:44.733812 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbc92d4-eb3e-45da-ab46-102ccc5d5965 tempest-VolumeQuotaClassesTest-1163174671 tempest-VolumeQuotaClassesTest-1163174671-project-admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:44.792158 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e98b585-9412-4397-ba4f-3da13466841c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:44.792997 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e98b585-9412-4397-ba4f-3da13466841c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:44.793356 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e98b585-9412-4397-ba4f-3da13466841c admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:44.793645 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e98b585-9412-4397-ba4f-3da13466841c admin admin] PATH_INFO: `/v3/projects/72f59f8b7aed4474a3018c42baa26d96` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:44.795025 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e98b585-9412-4397-ba4f-3da13466841c admin admin] RBAC: Authorizing `identity:delete_project(project_id=72f59f8b7aed4474a3018c42baa26d96)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:44.799023 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e98b585-9412-4397-ba4f-3da13466841c admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:44.803540 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-889a98db-a6fc-45a1-b714-fa95f4693f9d tempest-VolumeQuotaClassesTest-1163174671 tempest-VolumeQuotaClassesTest-1163174671-project-admin] The token cache is being invalidate because project 5a62a1cbfe5649ebbbeab8cbead75d01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80288) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:30:44.803839 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-889a98db-a6fc-45a1-b714-fa95f4693f9d tempest-VolumeQuotaClassesTest-1163174671 tempest-VolumeQuotaClassesTest-1163174671-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:44.804612 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-889a98db-a6fc-45a1-b714-fa95f4693f9d tempest-VolumeQuotaClassesTest-1163174671 tempest-VolumeQuotaClassesTest-1163174671-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:44.806472 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 947/1901] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:30:44 2022] DELETE /identity/v3/projects/5a62a1cbfe5649ebbbeab8cbead75d01 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:30:45.025109 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-7e98b585-9412-4397-ba4f-3da13466841c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72f59f8b7aed4474a3018c42baa26d96', 'request_id': 'req-7e98b585-9412-4397-ba4f-3da13466841c'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:45.032259 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-7e98b585-9412-4397-ba4f-3da13466841c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72f59f8b7aed4474a3018c42baa26d96', 'request_id': 'req-7e98b585-9412-4397-ba4f-3da13466841c'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:45.187290 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-7e98b585-9412-4397-ba4f-3da13466841c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72f59f8b7aed4474a3018c42baa26d96', 'request_id': 'req-7e98b585-9412-4397-ba4f-3da13466841c'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:45.212938 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-7e98b585-9412-4397-ba4f-3da13466841c admin admin] The token cache is being invalidate because project 72f59f8b7aed4474a3018c42baa26d96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:30:45.213638 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-7e98b585-9412-4397-ba4f-3da13466841c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:45.214441 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-7e98b585-9412-4397-ba4f-3da13466841c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:45.216352 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 955/1902] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:30:44 2022] DELETE /identity/v3/projects/72f59f8b7aed4474a3018c42baa26d96 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:30:45.220244 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a98db-a6fc-45a1-b714-fa95f4693f9d tempest-VolumeQuotaClassesTest-1163174671 tempest-VolumeQuotaClassesTest-1163174671-project-admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:45.223095 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-889a98db-a6fc-45a1-b714-fa95f4693f9d tempest-VolumeQuotaClassesTest-1163174671 tempest-VolumeQuotaClassesTest-1163174671-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:45.238976 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a98db-a6fc-45a1-b714-fa95f4693f9d tempest-VolumeQuotaClassesTest-1163174671 tempest-VolumeQuotaClassesTest-1163174671-project-admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:45.310059 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368cc643-78ba-4436-bfc3-8d2e43cb0ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:45.316029 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368cc643-78ba-4436-bfc3-8d2e43cb0ed8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:45.316643 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368cc643-78ba-4436-bfc3-8d2e43cb0ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:45.316946 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368cc643-78ba-4436-bfc3-8d2e43cb0ed8 admin admin] PATH_INFO: `/v3/users/ed10b9051e324993aef833640f983c38` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:45.319507 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368cc643-78ba-4436-bfc3-8d2e43cb0ed8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed10b9051e324993aef833640f983c38)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:45.322338 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368cc643-78ba-4436-bfc3-8d2e43cb0ed8 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:45.573948 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-368cc643-78ba-4436-bfc3-8d2e43cb0ed8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed10b9051e324993aef833640f983c38'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:45.586816 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-368cc643-78ba-4436-bfc3-8d2e43cb0ed8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed10b9051e324993aef833640f983c38'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:45.593728 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-368cc643-78ba-4436-bfc3-8d2e43cb0ed8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed10b9051e324993aef833640f983c38'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:45.594571 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-368cc643-78ba-4436-bfc3-8d2e43cb0ed8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed10b9051e324993aef833640f983c38'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:45.768408 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-368cc643-78ba-4436-bfc3-8d2e43cb0ed8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed10b9051e324993aef833640f983c38'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:45.792177 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 948/1903] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:30:45 2022] DELETE /identity/v3/users/ed10b9051e324993aef833640f983c38 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:30:45.928736 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:30:46.356715 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e98b585-9412-4397-ba4f-3da13466841c admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:46.358485 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-7e98b585-9412-4397-ba4f-3da13466841c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:46.374449 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e98b585-9412-4397-ba4f-3da13466841c admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:46.446487 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368cc643-78ba-4436-bfc3-8d2e43cb0ed8 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:46.451459 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52825013-b210-48d4-9632-3eb0158a7c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:46.451926 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-368cc643-78ba-4436-bfc3-8d2e43cb0ed8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:46.452404 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52825013-b210-48d4-9632-3eb0158a7c96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:46.452697 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52825013-b210-48d4-9632-3eb0158a7c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:46.452981 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52825013-b210-48d4-9632-3eb0158a7c96 admin admin] PATH_INFO: `/v3/users/4f32f75cf1444173b47613fa080245cd` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:46.454497 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52825013-b210-48d4-9632-3eb0158a7c96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f32f75cf1444173b47613fa080245cd)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:46.457194 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52825013-b210-48d4-9632-3eb0158a7c96 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:46.476063 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368cc643-78ba-4436-bfc3-8d2e43cb0ed8 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:46.481896 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c74e93-186e-4fca-a8a8-8719f712d197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:46.483254 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c74e93-186e-4fca-a8a8-8719f712d197 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:46.483539 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c74e93-186e-4fca-a8a8-8719f712d197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:46.487567 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c74e93-186e-4fca-a8a8-8719f712d197 admin admin] PATH_INFO: `/v3/users/adaeba97e82e4533a9cd1e7f698aac91` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:46.487567 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c74e93-186e-4fca-a8a8-8719f712d197 admin admin] RBAC: Authorizing `identity:delete_user(user_id=adaeba97e82e4533a9cd1e7f698aac91)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:46.487567 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c74e93-186e-4fca-a8a8-8719f712d197 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:46.595562 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:30:46.760892 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-f6c74e93-186e-4fca-a8a8-8719f712d197 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adaeba97e82e4533a9cd1e7f698aac91'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:46.761461 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-52825013-b210-48d4-9632-3eb0158a7c96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f32f75cf1444173b47613fa080245cd'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:46.770136 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-52825013-b210-48d4-9632-3eb0158a7c96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f32f75cf1444173b47613fa080245cd'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:46.770753 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-52825013-b210-48d4-9632-3eb0158a7c96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f32f75cf1444173b47613fa080245cd'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:46.771797 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-52825013-b210-48d4-9632-3eb0158a7c96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f32f75cf1444173b47613fa080245cd'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:46.777539 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-f6c74e93-186e-4fca-a8a8-8719f712d197 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adaeba97e82e4533a9cd1e7f698aac91'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:46.779803 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-f6c74e93-186e-4fca-a8a8-8719f712d197 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adaeba97e82e4533a9cd1e7f698aac91'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:46.779803 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-f6c74e93-186e-4fca-a8a8-8719f712d197 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adaeba97e82e4533a9cd1e7f698aac91'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:46.970673 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-52825013-b210-48d4-9632-3eb0158a7c96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f32f75cf1444173b47613fa080245cd'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:46.993457 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 956/1904] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:30:46 2022] DELETE /identity/v3/users/4f32f75cf1444173b47613fa080245cd => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:30:46.994661 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52825013-b210-48d4-9632-3eb0158a7c96 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:46.996062 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-52825013-b210-48d4-9632-3eb0158a7c96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:47.075129 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52825013-b210-48d4-9632-3eb0158a7c96 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:47.080261 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268ad111-51fb-478e-bb09-e3cecdabb67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:47.081132 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268ad111-51fb-478e-bb09-e3cecdabb67e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:47.081967 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268ad111-51fb-478e-bb09-e3cecdabb67e admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:47.082275 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268ad111-51fb-478e-bb09-e3cecdabb67e admin admin] PATH_INFO: `/v3/projects/4f2ede4310034fbb87427d730b98ddc0` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:47.083518 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268ad111-51fb-478e-bb09-e3cecdabb67e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f2ede4310034fbb87427d730b98ddc0)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:47.087739 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268ad111-51fb-478e-bb09-e3cecdabb67e admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:47.151278 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-f6c74e93-186e-4fca-a8a8-8719f712d197 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adaeba97e82e4533a9cd1e7f698aac91'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:47.165379 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 949/1905] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:30:46 2022] DELETE /identity/v3/users/adaeba97e82e4533a9cd1e7f698aac91 => generated 0 bytes in 722 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:30:47.166723 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8888a864-3e39-4fcf-a4bc-781c99c901e4 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:47.167025 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8888a864-3e39-4fcf-a4bc-781c99c901e4 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:47.167478 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8888a864-3e39-4fcf-a4bc-781c99c901e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:47.185185 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-8888a864-3e39-4fcf-a4bc-781c99c901e4 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:47.186519 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-8888a864-3e39-4fcf-a4bc-781c99c901e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:47.244544 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 950/1906] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:30:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:30:47.245752 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe84999-181e-4c20-b0ec-5cf167773921 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:47.246046 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe84999-181e-4c20-b0ec-5cf167773921 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:47.246430 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe84999-181e-4c20-b0ec-5cf167773921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:47.264199 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-1fe84999-181e-4c20-b0ec-5cf167773921 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:47.265395 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-1fe84999-181e-4c20-b0ec-5cf167773921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:47.273107 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 951/1907] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:30:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:30:47.273884 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe84999-181e-4c20-b0ec-5cf167773921 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:47.317148 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-1fe84999-181e-4c20-b0ec-5cf167773921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:47.317292 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-268ad111-51fb-478e-bb09-e3cecdabb67e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f2ede4310034fbb87427d730b98ddc0', 'request_id': 'req-268ad111-51fb-478e-bb09-e3cecdabb67e'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:47.317292 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-268ad111-51fb-478e-bb09-e3cecdabb67e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f2ede4310034fbb87427d730b98ddc0', 'request_id': 'req-268ad111-51fb-478e-bb09-e3cecdabb67e'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:47.333670 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe84999-181e-4c20-b0ec-5cf167773921 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:47.383194 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b89854-6227-4141-9a79-c7e2d0df7226 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:47.383855 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b89854-6227-4141-9a79-c7e2d0df7226 service neutron] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:47.384144 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b89854-6227-4141-9a79-c7e2d0df7226 service neutron] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:47.384426 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b89854-6227-4141-9a79-c7e2d0df7226 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:47.421307 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-268ad111-51fb-478e-bb09-e3cecdabb67e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f2ede4310034fbb87427d730b98ddc0', 'request_id': 'req-268ad111-51fb-478e-bb09-e3cecdabb67e'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:47.433552 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-268ad111-51fb-478e-bb09-e3cecdabb67e admin admin] The token cache is being invalidate because project 4f2ede4310034fbb87427d730b98ddc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:30:47.434300 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-268ad111-51fb-478e-bb09-e3cecdabb67e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:47.435078 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-268ad111-51fb-478e-bb09-e3cecdabb67e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:47.437681 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 957/1908] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:30:46 2022] DELETE /identity/v3/projects/4f2ede4310034fbb87427d730b98ddc0 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:30:47.440925 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268ad111-51fb-478e-bb09-e3cecdabb67e admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:47.442468 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-268ad111-51fb-478e-bb09-e3cecdabb67e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:47.455371 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268ad111-51fb-478e-bb09-e3cecdabb67e admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:47.459878 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387aff9b-9753-4665-90e0-3486a855e235 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:47.460207 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b89854-6227-4141-9a79-c7e2d0df7226 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:47.460648 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387aff9b-9753-4665-90e0-3486a855e235 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:47.461101 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387aff9b-9753-4665-90e0-3486a855e235 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:47.461481 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387aff9b-9753-4665-90e0-3486a855e235 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:47.462095 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b89854-6227-4141-9a79-c7e2d0df7226 service neutron] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:47.463924 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-387aff9b-9753-4665-90e0-3486a855e235 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:47.478998 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 952/1909] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:30:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:30:47.478998 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca861fa3-8cdf-42d8-816a-d2769385516b None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:47.478998 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca861fa3-8cdf-42d8-816a-d2769385516b None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:47.479540 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca861fa3-8cdf-42d8-816a-d2769385516b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:47.483962 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387aff9b-9753-4665-90e0-3486a855e235 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:47.485424 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387aff9b-9753-4665-90e0-3486a855e235 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:47.500240 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-ca861fa3-8cdf-42d8-816a-d2769385516b None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:47.501365 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-ca861fa3-8cdf-42d8-816a-d2769385516b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:47.513527 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 958/1910] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:30:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:30:47.518801 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 953/1911] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:30:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:30:47.526827 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c879c1-b218-4409-bfe1-a1b0928c76cd None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:47.527217 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c879c1-b218-4409-bfe1-a1b0928c76cd None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:47.530396 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c879c1-b218-4409-bfe1-a1b0928c76cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:47.552629 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-50c879c1-b218-4409-bfe1-a1b0928c76cd None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:47.554347 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-50c879c1-b218-4409-bfe1-a1b0928c76cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:47.564209 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 959/1912] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:30:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:30:47.568782 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca861fa3-8cdf-42d8-816a-d2769385516b None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:47.579891 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca861fa3-8cdf-42d8-816a-d2769385516b None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:47.586734 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1800fc8-b018-4f0f-93a3-f6f673ab35b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:47.587816 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1800fc8-b018-4f0f-93a3-f6f673ab35b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:47.587939 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1800fc8-b018-4f0f-93a3-f6f673ab35b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:47.588590 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1800fc8-b018-4f0f-93a3-f6f673ab35b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:47.589295 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1800fc8-b018-4f0f-93a3-f6f673ab35b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:30:47.589629 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1800fc8-b018-4f0f-93a3-f6f673ab35b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:47.591598 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1800fc8-b018-4f0f-93a3-f6f673ab35b3 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:47.608213 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 954/1913] 10.222.0.62 () {58 vars in 1152 bytes} [Fri May 27 16:30:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:30:47.612083 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c879c1-b218-4409-bfe1-a1b0928c76cd None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:47.622570 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c879c1-b218-4409-bfe1-a1b0928c76cd None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:47.627609 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305dd70f-b624-4783-a28b-5dd9e1d31801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:47.628348 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305dd70f-b624-4783-a28b-5dd9e1d31801 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:47.628649 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305dd70f-b624-4783-a28b-5dd9e1d31801 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:47.630855 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305dd70f-b624-4783-a28b-5dd9e1d31801 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:47.630855 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305dd70f-b624-4783-a28b-5dd9e1d31801 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:47.631967 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305dd70f-b624-4783-a28b-5dd9e1d31801 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:47.856514 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 960/1914] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:30:47 2022] POST /identity/v3/projects => generated 389 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:30:47.857906 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1800fc8-b018-4f0f-93a3-f6f673ab35b3 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:47.869014 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1800fc8-b018-4f0f-93a3-f6f673ab35b3 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:47.936123 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b9b716-3ccc-4123-b8a1-6f0082c14cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:47.936893 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b9b716-3ccc-4123-b8a1-6f0082c14cd4 admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:47.937177 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b9b716-3ccc-4123-b8a1-6f0082c14cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:47.937453 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b9b716-3ccc-4123-b8a1-6f0082c14cd4 admin admin] PATH_INFO: `/v3/users` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:47.938142 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b9b716-3ccc-4123-b8a1-6f0082c14cd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:47.940086 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b9b716-3ccc-4123-b8a1-6f0082c14cd4 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:48.087287 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305dd70f-b624-4783-a28b-5dd9e1d31801 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:48.090020 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 955/1915] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:30:47 2022] POST /identity/v3/users => generated 295 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:30:48.091398 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b9b716-3ccc-4123-b8a1-6f0082c14cd4 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:48.093260 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-d1b9b716-3ccc-4123-b8a1-6f0082c14cd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:48.095723 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-305dd70f-b624-4783-a28b-5dd9e1d31801 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:48.114020 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b9b716-3ccc-4123-b8a1-6f0082c14cd4 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:48.117775 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305dd70f-b624-4783-a28b-5dd9e1d31801 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:48.139802 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d87bf-d377-46aa-82de-6c932445fc3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:48.140699 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d87bf-d377-46aa-82de-6c932445fc3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:48.140991 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d87bf-d377-46aa-82de-6c932445fc3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:48.141271 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d87bf-d377-46aa-82de-6c932445fc3b admin admin] PATH_INFO: `/v3/projects/08294b15465e4e2f95287968ca768cd4` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:48.144624 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623cc9ba-0e02-4239-9c71-b934d04a7309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:48.144752 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480d87bf-d377-46aa-82de-6c932445fc3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=08294b15465e4e2f95287968ca768cd4)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:48.145944 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623cc9ba-0e02-4239-9c71-b934d04a7309 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:48.146442 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623cc9ba-0e02-4239-9c71-b934d04a7309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:48.146684 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480d87bf-d377-46aa-82de-6c932445fc3b admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:48.147085 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623cc9ba-0e02-4239-9c71-b934d04a7309 admin admin] PATH_INFO: `/v3/projects/76e57f1b024a4e57a73d1ed07cbcc999` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:48.148541 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623cc9ba-0e02-4239-9c71-b934d04a7309 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76e57f1b024a4e57a73d1ed07cbcc999)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:48.152166 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623cc9ba-0e02-4239-9c71-b934d04a7309 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:48.272543 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-480d87bf-d377-46aa-82de-6c932445fc3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08294b15465e4e2f95287968ca768cd4', 'request_id': 'req-480d87bf-d377-46aa-82de-6c932445fc3b'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:48.279299 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-480d87bf-d377-46aa-82de-6c932445fc3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08294b15465e4e2f95287968ca768cd4', 'request_id': 'req-480d87bf-d377-46aa-82de-6c932445fc3b'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:48.285675 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-480d87bf-d377-46aa-82de-6c932445fc3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08294b15465e4e2f95287968ca768cd4', 'request_id': 'req-480d87bf-d377-46aa-82de-6c932445fc3b'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:48.313555 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-623cc9ba-0e02-4239-9c71-b934d04a7309 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76e57f1b024a4e57a73d1ed07cbcc999', 'request_id': 'req-623cc9ba-0e02-4239-9c71-b934d04a7309'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:48.320342 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-623cc9ba-0e02-4239-9c71-b934d04a7309 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76e57f1b024a4e57a73d1ed07cbcc999', 'request_id': 'req-623cc9ba-0e02-4239-9c71-b934d04a7309'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:48.410072 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-480d87bf-d377-46aa-82de-6c932445fc3b admin admin] The token cache is being invalidate because project 08294b15465e4e2f95287968ca768cd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80288) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:30:48.410398 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-480d87bf-d377-46aa-82de-6c932445fc3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:48.411044 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-480d87bf-d377-46aa-82de-6c932445fc3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:48.412683 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 956/1916] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:30:48 2022] DELETE /identity/v3/projects/08294b15465e4e2f95287968ca768cd4 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:30:48.413462 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d87bf-d377-46aa-82de-6c932445fc3b admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:48.414804 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-480d87bf-d377-46aa-82de-6c932445fc3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:48.477293 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d87bf-d377-46aa-82de-6c932445fc3b admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:48.538723 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd08e1da-58a5-43bb-8ea1-bacfd608330a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:48.539429 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08e1da-58a5-43bb-8ea1-bacfd608330a admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:48.539762 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08e1da-58a5-43bb-8ea1-bacfd608330a admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:48.540044 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08e1da-58a5-43bb-8ea1-bacfd608330a admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:48.540777 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd08e1da-58a5-43bb-8ea1-bacfd608330a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:48.542545 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd08e1da-58a5-43bb-8ea1-bacfd608330a admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:48.552696 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-623cc9ba-0e02-4239-9c71-b934d04a7309 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76e57f1b024a4e57a73d1ed07cbcc999', 'request_id': 'req-623cc9ba-0e02-4239-9c71-b934d04a7309'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:48.681314 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 957/1917] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:30:48 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:30:48.681314 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd08e1da-58a5-43bb-8ea1-bacfd608330a admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:48.681314 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-bd08e1da-58a5-43bb-8ea1-bacfd608330a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:48.681681 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-623cc9ba-0e02-4239-9c71-b934d04a7309 admin admin] The token cache is being invalidate because project 76e57f1b024a4e57a73d1ed07cbcc999 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:30:48.681681 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-623cc9ba-0e02-4239-9c71-b934d04a7309 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:48.681681 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-623cc9ba-0e02-4239-9c71-b934d04a7309 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:48.681681 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 961/1918] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:30:48 2022] DELETE /identity/v3/projects/76e57f1b024a4e57a73d1ed07cbcc999 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:30:48.682092 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd08e1da-58a5-43bb-8ea1-bacfd608330a admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:48.682092 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29623b6-a2d2-4f8d-a3d6-02f2594b9873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:48.682092 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29623b6-a2d2-4f8d-a3d6-02f2594b9873 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:48.682092 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29623b6-a2d2-4f8d-a3d6-02f2594b9873 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:48.682748 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29623b6-a2d2-4f8d-a3d6-02f2594b9873 admin admin] PATH_INFO: `/v3/users/50b3b64e0a0e4a268aa6baf8e4c40fb5` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:48.682748 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29623b6-a2d2-4f8d-a3d6-02f2594b9873 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50b3b64e0a0e4a268aa6baf8e4c40fb5)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:48.682748 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29623b6-a2d2-4f8d-a3d6-02f2594b9873 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:48.683018 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623cc9ba-0e02-4239-9c71-b934d04a7309 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:48.683018 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-623cc9ba-0e02-4239-9c71-b934d04a7309 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:48.683018 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623cc9ba-0e02-4239-9c71-b934d04a7309 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:48.692934 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3777d0-a4e1-4cc7-8ff0-e33468cd1cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:48.693678 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3777d0-a4e1-4cc7-8ff0-e33468cd1cd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:48.694428 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3777d0-a4e1-4cc7-8ff0-e33468cd1cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:48.694428 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3777d0-a4e1-4cc7-8ff0-e33468cd1cd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:48.695074 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3777d0-a4e1-4cc7-8ff0-e33468cd1cd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:48.696788 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3777d0-a4e1-4cc7-8ff0-e33468cd1cd1 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:48.727594 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 962/1919] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:30:48 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:30:48.727594 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3777d0-a4e1-4cc7-8ff0-e33468cd1cd1 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:48.727594 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-2a3777d0-a4e1-4cc7-8ff0-e33468cd1cd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:48.727594 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3777d0-a4e1-4cc7-8ff0-e33468cd1cd1 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:48.733196 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880800c4-a53e-4ebf-95f1-db234b9446b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:48.734218 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880800c4-a53e-4ebf-95f1-db234b9446b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:48.734576 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880800c4-a53e-4ebf-95f1-db234b9446b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:48.734855 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880800c4-a53e-4ebf-95f1-db234b9446b6 admin admin] PATH_INFO: `/v3/users/d0a3f4f086ab45b3abd5c42c6013a9dd` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:48.739577 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880800c4-a53e-4ebf-95f1-db234b9446b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0a3f4f086ab45b3abd5c42c6013a9dd)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:48.741850 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880800c4-a53e-4ebf-95f1-db234b9446b6 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:49.958520 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-a29623b6-a2d2-4f8d-a3d6-02f2594b9873 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50b3b64e0a0e4a268aa6baf8e4c40fb5'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:49.970589 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-a29623b6-a2d2-4f8d-a3d6-02f2594b9873 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50b3b64e0a0e4a268aa6baf8e4c40fb5'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:49.971286 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-a29623b6-a2d2-4f8d-a3d6-02f2594b9873 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50b3b64e0a0e4a268aa6baf8e4c40fb5'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:49.972389 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-a29623b6-a2d2-4f8d-a3d6-02f2594b9873 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50b3b64e0a0e4a268aa6baf8e4c40fb5'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:50.095452 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-a29623b6-a2d2-4f8d-a3d6-02f2594b9873 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50b3b64e0a0e4a268aa6baf8e4c40fb5'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:50.119543 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 958/1920] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:30:48 2022] DELETE /identity/v3/users/50b3b64e0a0e4a268aa6baf8e4c40fb5 => generated 0 bytes in 1562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:30:50.129834 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29623b6-a2d2-4f8d-a3d6-02f2594b9873 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:50.129834 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-a29623b6-a2d2-4f8d-a3d6-02f2594b9873 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:50.142887 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-880800c4-a53e-4ebf-95f1-db234b9446b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0a3f4f086ab45b3abd5c42c6013a9dd'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:50.163505 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-880800c4-a53e-4ebf-95f1-db234b9446b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0a3f4f086ab45b3abd5c42c6013a9dd'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:50.164469 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-880800c4-a53e-4ebf-95f1-db234b9446b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0a3f4f086ab45b3abd5c42c6013a9dd'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:50.165425 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-880800c4-a53e-4ebf-95f1-db234b9446b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0a3f4f086ab45b3abd5c42c6013a9dd'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:50.236838 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29623b6-a2d2-4f8d-a3d6-02f2594b9873 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:50.236838 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeb562a-afa6-42b1-a0ea-92ccbeca00d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:50.237215 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb562a-afa6-42b1-a0ea-92ccbeca00d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:50.237502 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb562a-afa6-42b1-a0ea-92ccbeca00d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:50.237784 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb562a-afa6-42b1-a0ea-92ccbeca00d2 admin admin] PATH_INFO: `/v3/projects/b7e78b7ec1f9474dbb0676bd38be52c9/users/5793221a3ea94f67a8c9dae7bd48f616/roles/c8ce6d197f654598ac45f6016ecccabd` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:50.252074 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeb562a-afa6-42b1-a0ea-92ccbeca00d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7e78b7ec1f9474dbb0676bd38be52c9, user_id=5793221a3ea94f67a8c9dae7bd48f616, role_id=c8ce6d197f654598ac45f6016ecccabd)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:50.254781 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeb562a-afa6-42b1-a0ea-92ccbeca00d2 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:50.346409 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-880800c4-a53e-4ebf-95f1-db234b9446b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0a3f4f086ab45b3abd5c42c6013a9dd'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:50.376446 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 963/1921] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:30:48 2022] DELETE /identity/v3/users/d0a3f4f086ab45b3abd5c42c6013a9dd => generated 0 bytes in 1664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:30:50.407208 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 959/1922] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:30:50 2022] PUT /identity/v3/projects/b7e78b7ec1f9474dbb0676bd38be52c9/users/5793221a3ea94f67a8c9dae7bd48f616/roles/c8ce6d197f654598ac45f6016ecccabd => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:30:50.434547 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69656a8-59a5-4048-9e35-1c1f96366350 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:50.434962 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69656a8-59a5-4048-9e35-1c1f96366350 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:50.435318 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69656a8-59a5-4048-9e35-1c1f96366350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:50.464102 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-b69656a8-59a5-4048-9e35-1c1f96366350 None None] MFA Rules not processed for user `5793221a3ea94f67a8c9dae7bd48f616`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:50.465508 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-b69656a8-59a5-4048-9e35-1c1f96366350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:50.553348 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 964/1923] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:30:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:30:50.558003 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeb562a-afa6-42b1-a0ea-92ccbeca00d2 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:50.560253 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-2aeb562a-afa6-42b1-a0ea-92ccbeca00d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:50.662758 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeb562a-afa6-42b1-a0ea-92ccbeca00d2 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:50.682577 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e33ad2a-d909-4c56-bf70-dff55776d250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:50.682577 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33ad2a-d909-4c56-bf70-dff55776d250 admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:50.682577 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33ad2a-d909-4c56-bf70-dff55776d250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:50.682577 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33ad2a-d909-4c56-bf70-dff55776d250 admin admin] PATH_INFO: `/v3/projects` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:50.683138 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e33ad2a-d909-4c56-bf70-dff55776d250 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:50.683138 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e33ad2a-d909-4c56-bf70-dff55776d250 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:50.784359 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 960/1924] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:30:50 2022] POST /identity/v3/projects => generated 387 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:30:50.787827 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69656a8-59a5-4048-9e35-1c1f96366350 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:50.798643 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69656a8-59a5-4048-9e35-1c1f96366350 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:50.864951 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e33ad2a-d909-4c56-bf70-dff55776d250 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:50.873409 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-5e33ad2a-d909-4c56-bf70-dff55776d250 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:50.887018 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574cecb9-e325-480a-a290-b2d87565df3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:50.887728 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574cecb9-e325-480a-a290-b2d87565df3d admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:50.888023 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574cecb9-e325-480a-a290-b2d87565df3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:50.888348 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574cecb9-e325-480a-a290-b2d87565df3d admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:50.889194 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574cecb9-e325-480a-a290-b2d87565df3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:50.891124 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574cecb9-e325-480a-a290-b2d87565df3d admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:50.956102 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e33ad2a-d909-4c56-bf70-dff55776d250 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:50.963763 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a40195-320b-4f88-a548-d847f648b346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:50.963763 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a40195-320b-4f88-a548-d847f648b346 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:50.963763 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a40195-320b-4f88-a548-d847f648b346 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:50.963763 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a40195-320b-4f88-a548-d847f648b346 admin admin] PATH_INFO: `/v3/projects/2029edaa368f42198a33401294085916` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:50.964631 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a40195-320b-4f88-a548-d847f648b346 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2029edaa368f42198a33401294085916)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:50.966532 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a40195-320b-4f88-a548-d847f648b346 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:50.993554 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 965/1925] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:30:50 2022] POST /identity/v3/users => generated 300 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:30:51.002400 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574cecb9-e325-480a-a290-b2d87565df3d admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:51.008913 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574cecb9-e325-480a-a290-b2d87565df3d admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:51.016092 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7307a0-9a61-4fd2-bc6e-82007949f420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:51.016764 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7307a0-9a61-4fd2-bc6e-82007949f420 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:51.017052 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7307a0-9a61-4fd2-bc6e-82007949f420 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:51.017372 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7307a0-9a61-4fd2-bc6e-82007949f420 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:51.018122 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7307a0-9a61-4fd2-bc6e-82007949f420 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:51.019802 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7307a0-9a61-4fd2-bc6e-82007949f420 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:51.030336 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 966/1926] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:30:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:30:51.037292 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7307a0-9a61-4fd2-bc6e-82007949f420 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:51.047798 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7307a0-9a61-4fd2-bc6e-82007949f420 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:51.053125 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7be9dd3-890f-4269-9869-e81b0f9742c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:51.054030 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7be9dd3-890f-4269-9869-e81b0f9742c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:51.054344 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7be9dd3-890f-4269-9869-e81b0f9742c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:51.054627 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7be9dd3-890f-4269-9869-e81b0f9742c5 admin admin] PATH_INFO: `/v3/projects/27f1f385dcd045b3a8c99c7a268637b3/users/fd0545704be84cc1840d0a13f7c4a4b4/roles/e04fe3eb1f714d74901ac83e33ea8a16` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:51.071208 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7be9dd3-890f-4269-9869-e81b0f9742c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27f1f385dcd045b3a8c99c7a268637b3, user_id=fd0545704be84cc1840d0a13f7c4a4b4, role_id=e04fe3eb1f714d74901ac83e33ea8a16)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:51.073854 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7be9dd3-890f-4269-9869-e81b0f9742c5 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:51.247922 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 967/1927] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:30:51 2022] PUT /identity/v3/projects/27f1f385dcd045b3a8c99c7a268637b3/users/fd0545704be84cc1840d0a13f7c4a4b4/roles/e04fe3eb1f714d74901ac83e33ea8a16 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:30:51.247922 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7be9dd3-890f-4269-9869-e81b0f9742c5 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:51.255045 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-d7be9dd3-890f-4269-9869-e81b0f9742c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:51.262987 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-d3a40195-320b-4f88-a548-d847f648b346 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2029edaa368f42198a33401294085916', 'request_id': 'req-d3a40195-320b-4f88-a548-d847f648b346'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:51.270471 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-d3a40195-320b-4f88-a548-d847f648b346 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2029edaa368f42198a33401294085916', 'request_id': 'req-d3a40195-320b-4f88-a548-d847f648b346'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:51.276836 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-d3a40195-320b-4f88-a548-d847f648b346 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2029edaa368f42198a33401294085916', 'request_id': 'req-d3a40195-320b-4f88-a548-d847f648b346'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:51.326490 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7be9dd3-890f-4269-9869-e81b0f9742c5 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:51.381029 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f7998f-bbe2-4d36-a6ee-160b6a6221f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:51.381886 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f7998f-bbe2-4d36-a6ee-160b6a6221f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:51.382166 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f7998f-bbe2-4d36-a6ee-160b6a6221f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:51.382472 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f7998f-bbe2-4d36-a6ee-160b6a6221f8 admin admin] PATH_INFO: `/v3/projects/12ff33c7452e4d7db365a718059ee46b` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:51.383790 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f7998f-bbe2-4d36-a6ee-160b6a6221f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12ff33c7452e4d7db365a718059ee46b)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:51.385744 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f7998f-bbe2-4d36-a6ee-160b6a6221f8 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:51.391641 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-d3a40195-320b-4f88-a548-d847f648b346 admin admin] The token cache is being invalidate because project 2029edaa368f42198a33401294085916 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80288) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:30:51.391992 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-d3a40195-320b-4f88-a548-d847f648b346 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:51.392620 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-d3a40195-320b-4f88-a548-d847f648b346 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:51.397752 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 961/1928] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:30:50 2022] DELETE /identity/v3/projects/2029edaa368f42198a33401294085916 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:30:51.397752 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a40195-320b-4f88-a548-d847f648b346 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:51.397752 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-d3a40195-320b-4f88-a548-d847f648b346 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:51.414692 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a40195-320b-4f88-a548-d847f648b346 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:51.421091 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94927ec-facc-49cb-b346-d347194e0ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:51.421850 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94927ec-facc-49cb-b346-d347194e0ba7 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:51.422212 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94927ec-facc-49cb-b346-d347194e0ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:51.422591 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94927ec-facc-49cb-b346-d347194e0ba7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:51.423466 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94927ec-facc-49cb-b346-d347194e0ba7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:51.425889 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94927ec-facc-49cb-b346-d347194e0ba7 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:51.429193 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:30:51.439064 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 962/1929] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:30:51 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:30:51.440603 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b65563-7f5b-4dcf-be45-35f661e5942f None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:51.441657 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b65563-7f5b-4dcf-be45-35f661e5942f None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:51.441657 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b65563-7f5b-4dcf-be45-35f661e5942f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:51.459363 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-72b65563-7f5b-4dcf-be45-35f661e5942f None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:51.460626 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-72b65563-7f5b-4dcf-be45-35f661e5942f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:51.468515 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 963/1930] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:30:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:30:51.469387 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b65563-7f5b-4dcf-be45-35f661e5942f None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:51.479343 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b65563-7f5b-4dcf-be45-35f661e5942f None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:51.483991 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d04eb30-fdd1-4406-b640-ebab13dfb18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:51.484842 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04eb30-fdd1-4406-b640-ebab13dfb18a admin admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:51.485123 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04eb30-fdd1-4406-b640-ebab13dfb18a admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:51.485439 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04eb30-fdd1-4406-b640-ebab13dfb18a admin admin] PATH_INFO: `/v3/projects/27f1f385dcd045b3a8c99c7a268637b3/users/fd0545704be84cc1840d0a13f7c4a4b4/roles/e04fe3eb1f714d74901ac83e33ea8a16` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:51.487481 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d04eb30-fdd1-4406-b640-ebab13dfb18a admin admin] RBAC: Authorizing `identity:create_grant(project_id=27f1f385dcd045b3a8c99c7a268637b3, user_id=fd0545704be84cc1840d0a13f7c4a4b4, role_id=e04fe3eb1f714d74901ac83e33ea8a16)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:51.490600 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d04eb30-fdd1-4406-b640-ebab13dfb18a admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:51.500753 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 964/1931] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:30:51 2022] PUT /identity/v3/projects/27f1f385dcd045b3a8c99c7a268637b3/users/fd0545704be84cc1840d0a13f7c4a4b4/roles/e04fe3eb1f714d74901ac83e33ea8a16 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:30:51.501980 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a153ba3-17fa-450c-94e4-76cd286bae9a None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:51.502290 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a153ba3-17fa-450c-94e4-76cd286bae9a None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:51.502569 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a153ba3-17fa-450c-94e4-76cd286bae9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:51.521060 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-7a153ba3-17fa-450c-94e4-76cd286bae9a None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:51.522240 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-7a153ba3-17fa-450c-94e4-76cd286bae9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:51.547559 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-21f7998f-bbe2-4d36-a6ee-160b6a6221f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12ff33c7452e4d7db365a718059ee46b', 'request_id': 'req-21f7998f-bbe2-4d36-a6ee-160b6a6221f8'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:51.553746 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-21f7998f-bbe2-4d36-a6ee-160b6a6221f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12ff33c7452e4d7db365a718059ee46b', 'request_id': 'req-21f7998f-bbe2-4d36-a6ee-160b6a6221f8'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:51.587355 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 965/1932] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:30:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:30:51.588315 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9059b4d7-02f7-4f0d-8da0-3401b70d6cd1 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:51.588607 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9059b4d7-02f7-4f0d-8da0-3401b70d6cd1 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:51.588884 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9059b4d7-02f7-4f0d-8da0-3401b70d6cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:51.617153 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-9059b4d7-02f7-4f0d-8da0-3401b70d6cd1 None None] MFA Rules not processed for user `fd0545704be84cc1840d0a13f7c4a4b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:51.621620 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-9059b4d7-02f7-4f0d-8da0-3401b70d6cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:51.632343 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-21f7998f-bbe2-4d36-a6ee-160b6a6221f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12ff33c7452e4d7db365a718059ee46b', 'request_id': 'req-21f7998f-bbe2-4d36-a6ee-160b6a6221f8'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:51.645396 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-21f7998f-bbe2-4d36-a6ee-160b6a6221f8 admin admin] The token cache is being invalidate because project 12ff33c7452e4d7db365a718059ee46b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:30:51.645908 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-21f7998f-bbe2-4d36-a6ee-160b6a6221f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:51.646763 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-21f7998f-bbe2-4d36-a6ee-160b6a6221f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:51.648835 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 968/1933] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:30:51 2022] DELETE /identity/v3/projects/12ff33c7452e4d7db365a718059ee46b => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:30:51.649858 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f7998f-bbe2-4d36-a6ee-160b6a6221f8 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:51.651341 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-21f7998f-bbe2-4d36-a6ee-160b6a6221f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:51.707581 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 966/1934] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:30:51 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:30:51.709142 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4167253c-d322-473e-9bab-1dd0931d9498 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:51.709585 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4167253c-d322-473e-9bab-1dd0931d9498 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:51.709934 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4167253c-d322-473e-9bab-1dd0931d9498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:51.733807 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f7998f-bbe2-4d36-a6ee-160b6a6221f8 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:51.737616 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-4167253c-d322-473e-9bab-1dd0931d9498 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:51.738872 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-4167253c-d322-473e-9bab-1dd0931d9498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:51.739081 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d673e03e-073a-4a35-965a-7180b73c85ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:51.739815 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d673e03e-073a-4a35-965a-7180b73c85ac admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:51.740198 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d673e03e-073a-4a35-965a-7180b73c85ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:51.740540 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d673e03e-073a-4a35-965a-7180b73c85ac admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:51.741346 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d673e03e-073a-4a35-965a-7180b73c85ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:30:51.741724 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d673e03e-073a-4a35-965a-7180b73c85ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:51.743417 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d673e03e-073a-4a35-965a-7180b73c85ac admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:51.754157 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 967/1935] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:30:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:30:51.754157 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4167253c-d322-473e-9bab-1dd0931d9498 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:51.757093 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-4167253c-d322-473e-9bab-1dd0931d9498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:51.761216 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 969/1936] 10.222.0.62 () {58 vars in 1152 bytes} [Fri May 27 16:30:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:30:51.762721 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092a4ad1-de96-4a03-a4c4-1bee6e056a0a None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:51.763092 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092a4ad1-de96-4a03-a4c4-1bee6e056a0a None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:51.763826 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092a4ad1-de96-4a03-a4c4-1bee6e056a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:51.795654 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-092a4ad1-de96-4a03-a4c4-1bee6e056a0a None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:51.797692 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-092a4ad1-de96-4a03-a4c4-1bee6e056a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:51.808272 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 970/1937] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:30:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:30:51.809233 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092a4ad1-de96-4a03-a4c4-1bee6e056a0a None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:51.820301 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092a4ad1-de96-4a03-a4c4-1bee6e056a0a None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:51.824139 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4167253c-d322-473e-9bab-1dd0931d9498 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:51.827453 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea96060-262c-4c08-85a4-01c855da1ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:51.828377 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea96060-262c-4c08-85a4-01c855da1ae5 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:51.828912 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea96060-262c-4c08-85a4-01c855da1ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:51.829273 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea96060-262c-4c08-85a4-01c855da1ae5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:51.829854 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96adbe75-a155-4314-9c07-01ced4564b17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8693a1e72f14fdfb383f11e96330726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:51.830099 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea96060-262c-4c08-85a4-01c855da1ae5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:51.831120 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96adbe75-a155-4314-9c07-01ced4564b17 service cinder] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:51.832215 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96adbe75-a155-4314-9c07-01ced4564b17 service cinder] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:51.832560 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96adbe75-a155-4314-9c07-01ced4564b17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:51.833067 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea96060-262c-4c08-85a4-01c855da1ae5 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:51.857089 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96adbe75-a155-4314-9c07-01ced4564b17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:51.868143 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96adbe75-a155-4314-9c07-01ced4564b17 service cinder] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:51.875427 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 968/1938] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:30:51 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:30:51.876333 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96adbe75-a155-4314-9c07-01ced4564b17 service cinder] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:51.887792 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96adbe75-a155-4314-9c07-01ced4564b17 service cinder] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:51.892481 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9159a00-4475-421a-811f-a434c88bdf78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:51.893155 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9159a00-4475-421a-811f-a434c88bdf78 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:51.893444 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9159a00-4475-421a-811f-a434c88bdf78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:51.893768 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9159a00-4475-421a-811f-a434c88bdf78 admin admin] PATH_INFO: `/v3/domains` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:51.894541 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9159a00-4475-421a-811f-a434c88bdf78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:30:51.894857 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9159a00-4475-421a-811f-a434c88bdf78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:51.896671 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9159a00-4475-421a-811f-a434c88bdf78 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:51.913780 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 969/1939] 10.222.0.62 () {58 vars in 1152 bytes} [Fri May 27 16:30:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:30:51.920876 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9159a00-4475-421a-811f-a434c88bdf78 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:51.932033 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9159a00-4475-421a-811f-a434c88bdf78 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:51.937165 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e97af3a-4a67-4d1a-89d0-394a5642be3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:51.946799 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97af3a-4a67-4d1a-89d0-394a5642be3e admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:51.946799 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97af3a-4a67-4d1a-89d0-394a5642be3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:51.946799 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97af3a-4a67-4d1a-89d0-394a5642be3e admin admin] PATH_INFO: `/v3/projects` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:51.946799 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e97af3a-4a67-4d1a-89d0-394a5642be3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:51.946799 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e97af3a-4a67-4d1a-89d0-394a5642be3e admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:52.034205 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:30:52.041285 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 971/1940] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:30:51 2022] POST /identity/v3/projects => generated 383 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:30:52.042085 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea96060-262c-4c08-85a4-01c855da1ae5 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:52.045062 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-eea96060-262c-4c08-85a4-01c855da1ae5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:52.106561 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea96060-262c-4c08-85a4-01c855da1ae5 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:52.111604 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f0f021-3f65-41b1-ad14-9070b555cf63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:52.112536 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0f021-3f65-41b1-ad14-9070b555cf63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:52.112828 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0f021-3f65-41b1-ad14-9070b555cf63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:52.113115 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0f021-3f65-41b1-ad14-9070b555cf63 admin admin] PATH_INFO: `/v3/users/5793221a3ea94f67a8c9dae7bd48f616` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:52.117374 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 970/1941] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:30:51 2022] POST /identity/v3/projects => generated 369 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:30:52.117871 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f0f021-3f65-41b1-ad14-9070b555cf63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5793221a3ea94f67a8c9dae7bd48f616)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:52.117983 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e97af3a-4a67-4d1a-89d0-394a5642be3e admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:52.118076 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f0f021-3f65-41b1-ad14-9070b555cf63 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:52.181578 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e97af3a-4a67-4d1a-89d0-394a5642be3e admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:52.186107 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6959bb55-7b3d-4a08-834a-a8a61d6efc49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:52.186800 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6959bb55-7b3d-4a08-834a-a8a61d6efc49 admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:52.187089 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6959bb55-7b3d-4a08-834a-a8a61d6efc49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:52.187367 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6959bb55-7b3d-4a08-834a-a8a61d6efc49 admin admin] PATH_INFO: `/v3/users` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:52.188052 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6959bb55-7b3d-4a08-834a-a8a61d6efc49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:52.189984 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6959bb55-7b3d-4a08-834a-a8a61d6efc49 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:52.348519 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 971/1942] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:30:52 2022] POST /identity/v3/users => generated 292 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:30:52.349349 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6959bb55-7b3d-4a08-834a-a8a61d6efc49 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:52.362696 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6959bb55-7b3d-4a08-834a-a8a61d6efc49 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:52.363503 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d3fc3-1ff3-4d7e-b126-c1b59616ce87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:52.364168 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d3fc3-1ff3-4d7e-b126-c1b59616ce87 admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:52.364452 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d3fc3-1ff3-4d7e-b126-c1b59616ce87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:52.364729 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d3fc3-1ff3-4d7e-b126-c1b59616ce87 admin admin] PATH_INFO: `/v3/users` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:52.365413 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548d3fc3-1ff3-4d7e-b126-c1b59616ce87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:52.367356 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548d3fc3-1ff3-4d7e-b126-c1b59616ce87 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:52.486120 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 972/1943] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:30:52 2022] POST /identity/v3/users => generated 285 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:30:52.491857 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d3fc3-1ff3-4d7e-b126-c1b59616ce87 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:52.497854 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d3fc3-1ff3-4d7e-b126-c1b59616ce87 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:52.499590 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-93f0f021-3f65-41b1-ad14-9070b555cf63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5793221a3ea94f67a8c9dae7bd48f616'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:52.504041 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5356d65a-8d04-4aa4-a121-4a0fb2a34740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:52.504719 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5356d65a-8d04-4aa4-a121-4a0fb2a34740 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:52.505005 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5356d65a-8d04-4aa4-a121-4a0fb2a34740 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:52.505284 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5356d65a-8d04-4aa4-a121-4a0fb2a34740 admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:52.506305 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5356d65a-8d04-4aa4-a121-4a0fb2a34740 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:52.508461 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5356d65a-8d04-4aa4-a121-4a0fb2a34740 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:52.509493 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-93f0f021-3f65-41b1-ad14-9070b555cf63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5793221a3ea94f67a8c9dae7bd48f616'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:52.510300 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-93f0f021-3f65-41b1-ad14-9070b555cf63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5793221a3ea94f67a8c9dae7bd48f616'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:52.510908 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-93f0f021-3f65-41b1-ad14-9070b555cf63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5793221a3ea94f67a8c9dae7bd48f616'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:52.520828 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 973/1944] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:30:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:30:52.524555 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5356d65a-8d04-4aa4-a121-4a0fb2a34740 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:52.526273 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-5356d65a-8d04-4aa4-a121-4a0fb2a34740 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:52.538450 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5356d65a-8d04-4aa4-a121-4a0fb2a34740 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:52.543081 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d70d91-eb81-4bbe-ae3a-09db3c22e50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:52.543737 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d70d91-eb81-4bbe-ae3a-09db3c22e50b admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:52.544022 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d70d91-eb81-4bbe-ae3a-09db3c22e50b admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:52.544296 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d70d91-eb81-4bbe-ae3a-09db3c22e50b admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:52.545019 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d70d91-eb81-4bbe-ae3a-09db3c22e50b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:52.546640 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d70d91-eb81-4bbe-ae3a-09db3c22e50b admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:52.556957 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 974/1945] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:30:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:30:52.557736 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d70d91-eb81-4bbe-ae3a-09db3c22e50b admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:52.559421 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-55d70d91-eb81-4bbe-ae3a-09db3c22e50b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:52.571681 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d70d91-eb81-4bbe-ae3a-09db3c22e50b admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:52.576496 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dced4396-a074-4b02-be22-35b7a5ee8d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:52.577146 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced4396-a074-4b02-be22-35b7a5ee8d7d admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:52.577431 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced4396-a074-4b02-be22-35b7a5ee8d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:52.577757 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced4396-a074-4b02-be22-35b7a5ee8d7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:52.578509 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dced4396-a074-4b02-be22-35b7a5ee8d7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:52.580077 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dced4396-a074-4b02-be22-35b7a5ee8d7d admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:52.590974 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 975/1946] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:30:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:30:52.591902 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dced4396-a074-4b02-be22-35b7a5ee8d7d admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:52.602396 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dced4396-a074-4b02-be22-35b7a5ee8d7d admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:52.607219 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3630a1f-2990-4ba8-90af-49bd1606db51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:52.607884 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3630a1f-2990-4ba8-90af-49bd1606db51 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:52.608156 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3630a1f-2990-4ba8-90af-49bd1606db51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:52.608467 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3630a1f-2990-4ba8-90af-49bd1606db51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:52.609209 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3630a1f-2990-4ba8-90af-49bd1606db51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:52.610860 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3630a1f-2990-4ba8-90af-49bd1606db51 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:52.626285 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 976/1947] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:30:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:30:52.626285 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3630a1f-2990-4ba8-90af-49bd1606db51 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:52.632529 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-93f0f021-3f65-41b1-ad14-9070b555cf63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5793221a3ea94f67a8c9dae7bd48f616'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:52.638478 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3630a1f-2990-4ba8-90af-49bd1606db51 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:52.643510 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b2bd93-239a-4afb-a081-1d0555a03988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:52.644443 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b2bd93-239a-4afb-a081-1d0555a03988 admin admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:52.644969 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b2bd93-239a-4afb-a081-1d0555a03988 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:52.645277 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b2bd93-239a-4afb-a081-1d0555a03988 admin admin] PATH_INFO: `/v3/projects/fcb3ce5c629048d796defc2741697284/users/45323d2bc7b645ef8de08a263ebd303e/roles/c8ce6d197f654598ac45f6016ecccabd` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:52.662803 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 972/1948] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:30:52 2022] DELETE /identity/v3/users/5793221a3ea94f67a8c9dae7bd48f616 => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:30:52.662803 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f0f021-3f65-41b1-ad14-9070b555cf63 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:52.668592 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b2bd93-239a-4afb-a081-1d0555a03988 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcb3ce5c629048d796defc2741697284, user_id=45323d2bc7b645ef8de08a263ebd303e, role_id=c8ce6d197f654598ac45f6016ecccabd)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:52.671797 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b2bd93-239a-4afb-a081-1d0555a03988 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:52.724885 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f0f021-3f65-41b1-ad14-9070b555cf63 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:52.729832 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b720684a-60aa-4ca6-8675-b0d4ad203aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:52.730787 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b720684a-60aa-4ca6-8675-b0d4ad203aa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:52.731228 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b720684a-60aa-4ca6-8675-b0d4ad203aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:52.731422 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b720684a-60aa-4ca6-8675-b0d4ad203aa4 admin admin] PATH_INFO: `/v3/projects/810dbebd34194bd08305a24f61d9e683/users/b885a352f255484d936327874ad5cce5/roles/c8ce6d197f654598ac45f6016ecccabd` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:52.750276 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b720684a-60aa-4ca6-8675-b0d4ad203aa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=810dbebd34194bd08305a24f61d9e683, user_id=b885a352f255484d936327874ad5cce5, role_id=c8ce6d197f654598ac45f6016ecccabd)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:52.753758 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b720684a-60aa-4ca6-8675-b0d4ad203aa4 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:52.776239 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 977/1949] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:30:52 2022] PUT /identity/v3/projects/fcb3ce5c629048d796defc2741697284/users/45323d2bc7b645ef8de08a263ebd303e/roles/c8ce6d197f654598ac45f6016ecccabd => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:30:52.777337 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b2bd93-239a-4afb-a081-1d0555a03988 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:52.779407 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-64b2bd93-239a-4afb-a081-1d0555a03988 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:52.854050 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b2bd93-239a-4afb-a081-1d0555a03988 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:52.860021 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013d372c-4211-49a7-972d-3b77a531123e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:52.861062 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d372c-4211-49a7-972d-3b77a531123e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:52.861425 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d372c-4211-49a7-972d-3b77a531123e admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:52.861706 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d372c-4211-49a7-972d-3b77a531123e admin admin] PATH_INFO: `/v3/users/99df66a233b0457c83eb07f59916c3f1` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:52.863415 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013d372c-4211-49a7-972d-3b77a531123e admin admin] RBAC: Authorizing `identity:delete_user(user_id=99df66a233b0457c83eb07f59916c3f1)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:52.865393 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013d372c-4211-49a7-972d-3b77a531123e admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:52.880357 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 973/1950] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:30:52 2022] PUT /identity/v3/projects/810dbebd34194bd08305a24f61d9e683/users/b885a352f255484d936327874ad5cce5/roles/c8ce6d197f654598ac45f6016ecccabd => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:30:52.893013 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b819daf4-3006-43e6-a6f6-372c0694001a None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:52.893013 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b819daf4-3006-43e6-a6f6-372c0694001a None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:52.893013 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b819daf4-3006-43e6-a6f6-372c0694001a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:52.912513 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-b819daf4-3006-43e6-a6f6-372c0694001a None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:52.913756 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-b819daf4-3006-43e6-a6f6-372c0694001a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:52.994107 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 974/1951] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:30:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:30:52.995789 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e033921-2c7b-4ef7-b51d-f6479dbbe279 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:52.996131 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e033921-2c7b-4ef7-b51d-f6479dbbe279 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:52.996406 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e033921-2c7b-4ef7-b51d-f6479dbbe279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:53.031320 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-4e033921-2c7b-4ef7-b51d-f6479dbbe279 None None] MFA Rules not processed for user `45323d2bc7b645ef8de08a263ebd303e`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:53.032584 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-4e033921-2c7b-4ef7-b51d-f6479dbbe279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:53.103587 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-013d372c-4211-49a7-972d-3b77a531123e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99df66a233b0457c83eb07f59916c3f1'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:53.124232 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 975/1952] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:30:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:30:53.124232 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc098e5a-7081-44a3-8002-56f707d90355 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:53.124232 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc098e5a-7081-44a3-8002-56f707d90355 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:53.124232 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc098e5a-7081-44a3-8002-56f707d90355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:53.159000 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-013d372c-4211-49a7-972d-3b77a531123e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99df66a233b0457c83eb07f59916c3f1'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:53.160313 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-013d372c-4211-49a7-972d-3b77a531123e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99df66a233b0457c83eb07f59916c3f1'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:53.160585 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-013d372c-4211-49a7-972d-3b77a531123e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99df66a233b0457c83eb07f59916c3f1'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:53.162857 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-dc098e5a-7081-44a3-8002-56f707d90355 None None] MFA Rules not processed for user `b885a352f255484d936327874ad5cce5`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:53.164152 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-dc098e5a-7081-44a3-8002-56f707d90355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:53.260903 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 976/1953] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:30:53 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:30:53.263306 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc098e5a-7081-44a3-8002-56f707d90355 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:53.264025 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-dc098e5a-7081-44a3-8002-56f707d90355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:53.283908 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-013d372c-4211-49a7-972d-3b77a531123e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99df66a233b0457c83eb07f59916c3f1'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:53.301466 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 978/1954] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:30:52 2022] DELETE /identity/v3/users/99df66a233b0457c83eb07f59916c3f1 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:30:53.303970 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013d372c-4211-49a7-972d-3b77a531123e admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:53.307405 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-013d372c-4211-49a7-972d-3b77a531123e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:53.351329 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc098e5a-7081-44a3-8002-56f707d90355 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:53.374365 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013d372c-4211-49a7-972d-3b77a531123e admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:53.378049 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c682c663-95e3-4035-9733-1693856ba642 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8693a1e72f14fdfb383f11e96330726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:53.378813 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c682c663-95e3-4035-9733-1693856ba642 service cinder] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:53.379169 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c682c663-95e3-4035-9733-1693856ba642 service cinder] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:53.379462 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c682c663-95e3-4035-9733-1693856ba642 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:53.381688 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-c682c663-95e3-4035-9733-1693856ba642 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:53.440371 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3330d6aa-adb7-4b4a-88c7-85cb8c00ca5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:53.441280 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3330d6aa-adb7-4b4a-88c7-85cb8c00ca5f service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:53.441652 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3330d6aa-adb7-4b4a-88c7-85cb8c00ca5f service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:53.442330 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3330d6aa-adb7-4b4a-88c7-85cb8c00ca5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:53.445352 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-3330d6aa-adb7-4b4a-88c7-85cb8c00ca5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:53.479743 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c682c663-95e3-4035-9733-1693856ba642 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:53.481831 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c682c663-95e3-4035-9733-1693856ba642 service cinder] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:53.494023 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 979/1955] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:30:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:30:53.495211 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c682c663-95e3-4035-9733-1693856ba642 service cinder] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:53.497276 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-c682c663-95e3-4035-9733-1693856ba642 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:53.584632 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3330d6aa-adb7-4b4a-88c7-85cb8c00ca5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:53.586395 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3330d6aa-adb7-4b4a-88c7-85cb8c00ca5f service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:53.587273 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c682c663-95e3-4035-9733-1693856ba642 service cinder] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:53.593299 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79792af1-21ca-42a1-b2cb-d50dee1dcca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:53.593778 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79792af1-21ca-42a1-b2cb-d50dee1dcca4 admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:53.594133 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79792af1-21ca-42a1-b2cb-d50dee1dcca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:53.594516 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79792af1-21ca-42a1-b2cb-d50dee1dcca4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:53.595305 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79792af1-21ca-42a1-b2cb-d50dee1dcca4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:53.598050 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79792af1-21ca-42a1-b2cb-d50dee1dcca4 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:53.609530 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 977/1956] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:30:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:30:53.611987 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac7c8ab-34c5-4bd3-98b1-fdd9e3b3e53c None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:53.612394 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac7c8ab-34c5-4bd3-98b1-fdd9e3b3e53c None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:53.613421 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac7c8ab-34c5-4bd3-98b1-fdd9e3b3e53c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:53.637619 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-5ac7c8ab-34c5-4bd3-98b1-fdd9e3b3e53c None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:53.638915 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-5ac7c8ab-34c5-4bd3-98b1-fdd9e3b3e53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:53.650845 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 978/1957] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:30:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:30:53.650845 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac7c8ab-34c5-4bd3-98b1-fdd9e3b3e53c None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:53.660432 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-5ac7c8ab-34c5-4bd3-98b1-fdd9e3b3e53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:53.676847 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac7c8ab-34c5-4bd3-98b1-fdd9e3b3e53c None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:53.683490 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a5a88d-a567-483b-ba69-f6386cdc2556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:53.686443 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a5a88d-a567-483b-ba69-f6386cdc2556 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:53.686621 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a5a88d-a567-483b-ba69-f6386cdc2556 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:53.687100 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a5a88d-a567-483b-ba69-f6386cdc2556 admin admin] PATH_INFO: `/v3/users/45323d2bc7b645ef8de08a263ebd303e` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:53.688948 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a5a88d-a567-483b-ba69-f6386cdc2556 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45323d2bc7b645ef8de08a263ebd303e)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:53.691760 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a5a88d-a567-483b-ba69-f6386cdc2556 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:53.726110 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 980/1958] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:30:53 2022] POST /identity/v3/projects => generated 367 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:30:53.727116 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79792af1-21ca-42a1-b2cb-d50dee1dcca4 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:53.793936 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79792af1-21ca-42a1-b2cb-d50dee1dcca4 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:53.797679 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff55c05-5dfa-40b8-a44c-2a8058d50fe7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:53.798357 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff55c05-5dfa-40b8-a44c-2a8058d50fe7 service neutron] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:53.798651 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff55c05-5dfa-40b8-a44c-2a8058d50fe7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:53.798932 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff55c05-5dfa-40b8-a44c-2a8058d50fe7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:53.860335 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff55c05-5dfa-40b8-a44c-2a8058d50fe7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:53.861894 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff55c05-5dfa-40b8-a44c-2a8058d50fe7 service neutron] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:53.877541 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 981/1959] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:30:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:30:53.879280 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff55c05-5dfa-40b8-a44c-2a8058d50fe7 service neutron] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:53.890066 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff55c05-5dfa-40b8-a44c-2a8058d50fe7 service neutron] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:53.895349 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88af952e-3725-4c21-9454-40947bc292de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:53.896079 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af952e-3725-4c21-9454-40947bc292de admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:53.896375 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af952e-3725-4c21-9454-40947bc292de admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:53.896671 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af952e-3725-4c21-9454-40947bc292de admin admin] PATH_INFO: `/v3/users` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:53.897405 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88af952e-3725-4c21-9454-40947bc292de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:53.899580 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88af952e-3725-4c21-9454-40947bc292de admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:54.031603 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-d7a5a88d-a567-483b-ba69-f6386cdc2556 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45323d2bc7b645ef8de08a263ebd303e'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:54.040334 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-d7a5a88d-a567-483b-ba69-f6386cdc2556 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45323d2bc7b645ef8de08a263ebd303e'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:54.041048 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-d7a5a88d-a567-483b-ba69-f6386cdc2556 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45323d2bc7b645ef8de08a263ebd303e'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:54.041729 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-d7a5a88d-a567-483b-ba69-f6386cdc2556 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45323d2bc7b645ef8de08a263ebd303e'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:54.057849 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 982/1960] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:30:53 2022] POST /identity/v3/users => generated 290 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:30:54.059488 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88af952e-3725-4c21-9454-40947bc292de admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:54.061148 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-88af952e-3725-4c21-9454-40947bc292de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:54.073544 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88af952e-3725-4c21-9454-40947bc292de admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:54.078369 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4c0f65-3b01-4824-92eb-49b54b3c2d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:54.079042 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c0f65-3b01-4824-92eb-49b54b3c2d6e admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:54.079326 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c0f65-3b01-4824-92eb-49b54b3c2d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:54.079602 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c0f65-3b01-4824-92eb-49b54b3c2d6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:54.080333 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4c0f65-3b01-4824-92eb-49b54b3c2d6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:54.081954 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4c0f65-3b01-4824-92eb-49b54b3c2d6e admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:54.092044 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 983/1961] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:30:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 16:30:54.099548 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4c0f65-3b01-4824-92eb-49b54b3c2d6e admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:54.106094 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4c0f65-3b01-4824-92eb-49b54b3c2d6e admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:54.111220 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433390e6-8d71-4b9e-8c47-48bdbec49da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:54.112229 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433390e6-8d71-4b9e-8c47-48bdbec49da9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:54.113018 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433390e6-8d71-4b9e-8c47-48bdbec49da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:54.113302 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433390e6-8d71-4b9e-8c47-48bdbec49da9 admin admin] PATH_INFO: `/v3/projects/1ad328f5dd5744c6a668254edcff3889/users/e52bb6f4a00149dc98fcf7dd0b450da4/roles/e04fe3eb1f714d74901ac83e33ea8a16` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:54.130018 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433390e6-8d71-4b9e-8c47-48bdbec49da9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ad328f5dd5744c6a668254edcff3889, user_id=e52bb6f4a00149dc98fcf7dd0b450da4, role_id=e04fe3eb1f714d74901ac83e33ea8a16)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:54.133129 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433390e6-8d71-4b9e-8c47-48bdbec49da9 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:54.177707 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-d7a5a88d-a567-483b-ba69-f6386cdc2556 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45323d2bc7b645ef8de08a263ebd303e'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:54.218305 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 979/1962] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:30:53 2022] DELETE /identity/v3/users/45323d2bc7b645ef8de08a263ebd303e => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:30:54.223722 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7869443-e0f5-4899-8f22-b6980ce5fb51 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:54.224021 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7869443-e0f5-4899-8f22-b6980ce5fb51 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:54.224304 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7869443-e0f5-4899-8f22-b6980ce5fb51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:54.243627 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-a7869443-e0f5-4899-8f22-b6980ce5fb51 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:54.244848 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-a7869443-e0f5-4899-8f22-b6980ce5fb51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:54.297228 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 984/1963] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:30:54 2022] PUT /identity/v3/projects/1ad328f5dd5744c6a668254edcff3889/users/e52bb6f4a00149dc98fcf7dd0b450da4/roles/e04fe3eb1f714d74901ac83e33ea8a16 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:30:54.300175 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433390e6-8d71-4b9e-8c47-48bdbec49da9 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:54.306182 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-433390e6-8d71-4b9e-8c47-48bdbec49da9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:54.334122 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 980/1964] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:30:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:30:54.335254 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7869443-e0f5-4899-8f22-b6980ce5fb51 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:54.348133 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:30:54.356828 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7869443-e0f5-4899-8f22-b6980ce5fb51 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:54.411373 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433390e6-8d71-4b9e-8c47-48bdbec49da9 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:54.425099 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f58bc5-91a6-476f-9512-9cb2babcc928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:54.428844 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f58bc5-91a6-476f-9512-9cb2babcc928 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:54.432589 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f58bc5-91a6-476f-9512-9cb2babcc928 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:54.432589 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f58bc5-91a6-476f-9512-9cb2babcc928 admin admin] PATH_INFO: `/v3/projects/b7e78b7ec1f9474dbb0676bd38be52c9` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:54.436083 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f58bc5-91a6-476f-9512-9cb2babcc928 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7e78b7ec1f9474dbb0676bd38be52c9)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:54.438146 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f58bc5-91a6-476f-9512-9cb2babcc928 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:54.445520 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8da5e8-2fd3-484f-9516-94fed2ac9098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:54.446664 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8da5e8-2fd3-484f-9516-94fed2ac9098 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:54.447113 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8da5e8-2fd3-484f-9516-94fed2ac9098 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:54.447402 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8da5e8-2fd3-484f-9516-94fed2ac9098 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:54.448230 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8da5e8-2fd3-484f-9516-94fed2ac9098 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:54.449965 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8da5e8-2fd3-484f-9516-94fed2ac9098 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:54.464803 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 981/1965] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:30:54 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:30:54.466850 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8da5e8-2fd3-484f-9516-94fed2ac9098 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:54.469933 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-aa8da5e8-2fd3-484f-9516-94fed2ac9098 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:54.531851 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8da5e8-2fd3-484f-9516-94fed2ac9098 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:54.536886 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e614df32-c33c-43a9-acfd-783562048750 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:54.537592 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e614df32-c33c-43a9-acfd-783562048750 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:54.537892 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e614df32-c33c-43a9-acfd-783562048750 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:54.538238 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e614df32-c33c-43a9-acfd-783562048750 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:54.547436 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e614df32-c33c-43a9-acfd-783562048750 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:54.548867 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e614df32-c33c-43a9-acfd-783562048750 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:54.558400 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 982/1966] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:30:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:30:54.559164 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e614df32-c33c-43a9-acfd-783562048750 service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:54.568225 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e614df32-c33c-43a9-acfd-783562048750 service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:54.573222 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cf9657-cf6c-4ad8-8413-f2615b4339d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:54.574312 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf9657-cf6c-4ad8-8413-f2615b4339d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:54.574602 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf9657-cf6c-4ad8-8413-f2615b4339d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:54.574881 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf9657-cf6c-4ad8-8413-f2615b4339d7 admin admin] PATH_INFO: `/v3/projects/1ad328f5dd5744c6a668254edcff3889/users/e52bb6f4a00149dc98fcf7dd0b450da4/roles/e04fe3eb1f714d74901ac83e33ea8a16` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:54.576874 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cf9657-cf6c-4ad8-8413-f2615b4339d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ad328f5dd5744c6a668254edcff3889, user_id=e52bb6f4a00149dc98fcf7dd0b450da4, role_id=e04fe3eb1f714d74901ac83e33ea8a16)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:54.579705 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cf9657-cf6c-4ad8-8413-f2615b4339d7 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:54.591061 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 983/1967] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:30:54 2022] PUT /identity/v3/projects/1ad328f5dd5744c6a668254edcff3889/users/e52bb6f4a00149dc98fcf7dd0b450da4/roles/e04fe3eb1f714d74901ac83e33ea8a16 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:30:54.600307 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cf9657-cf6c-4ad8-8413-f2615b4339d7 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:54.602732 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-d0cf9657-cf6c-4ad8-8413-f2615b4339d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:54.628850 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-59f58bc5-91a6-476f-9512-9cb2babcc928 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7e78b7ec1f9474dbb0676bd38be52c9', 'request_id': 'req-59f58bc5-91a6-476f-9512-9cb2babcc928'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:54.637688 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-59f58bc5-91a6-476f-9512-9cb2babcc928 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7e78b7ec1f9474dbb0676bd38be52c9', 'request_id': 'req-59f58bc5-91a6-476f-9512-9cb2babcc928'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:54.644362 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-59f58bc5-91a6-476f-9512-9cb2babcc928 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7e78b7ec1f9474dbb0676bd38be52c9', 'request_id': 'req-59f58bc5-91a6-476f-9512-9cb2babcc928'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:54.690071 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cf9657-cf6c-4ad8-8413-f2615b4339d7 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:54.746268 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f54758-02e4-43ff-8677-2148ad3299d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:54.747214 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f54758-02e4-43ff-8677-2148ad3299d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:54.747504 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f54758-02e4-43ff-8677-2148ad3299d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:54.747829 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f54758-02e4-43ff-8677-2148ad3299d8 admin admin] PATH_INFO: `/v3/projects/23c7dd7906bd4068b2d704e014522bdd` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:54.749067 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f54758-02e4-43ff-8677-2148ad3299d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23c7dd7906bd4068b2d704e014522bdd)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:54.751031 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f54758-02e4-43ff-8677-2148ad3299d8 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:54.762238 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:30:54.821310 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-59f58bc5-91a6-476f-9512-9cb2babcc928 admin admin] The token cache is being invalidate because project b7e78b7ec1f9474dbb0676bd38be52c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80288) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:30:54.821802 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-59f58bc5-91a6-476f-9512-9cb2babcc928 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:54.822529 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-59f58bc5-91a6-476f-9512-9cb2babcc928 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:54.824572 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 985/1968] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:30:54 2022] DELETE /identity/v3/projects/b7e78b7ec1f9474dbb0676bd38be52c9 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:30:54.825604 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a766db99-686d-4dff-87a5-98f22eaebe68 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:54.825907 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a766db99-686d-4dff-87a5-98f22eaebe68 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:54.826182 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a766db99-686d-4dff-87a5-98f22eaebe68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:54.856394 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-a766db99-686d-4dff-87a5-98f22eaebe68 None None] MFA Rules not processed for user `e52bb6f4a00149dc98fcf7dd0b450da4`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:54.857728 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-a766db99-686d-4dff-87a5-98f22eaebe68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:54.933657 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-f8f54758-02e4-43ff-8677-2148ad3299d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23c7dd7906bd4068b2d704e014522bdd', 'request_id': 'req-f8f54758-02e4-43ff-8677-2148ad3299d8'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:54.957322 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-f8f54758-02e4-43ff-8677-2148ad3299d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23c7dd7906bd4068b2d704e014522bdd', 'request_id': 'req-f8f54758-02e4-43ff-8677-2148ad3299d8'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:54.964428 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 986/1969] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:30:54 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:30:54.965293 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a766db99-686d-4dff-87a5-98f22eaebe68 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:54.968418 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-a766db99-686d-4dff-87a5-98f22eaebe68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:54.984216 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a766db99-686d-4dff-87a5-98f22eaebe68 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:55.045693 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d34cfd-eed7-48e0-ae12-22a2102932c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:55.046523 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d34cfd-eed7-48e0-ae12-22a2102932c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:55.046813 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d34cfd-eed7-48e0-ae12-22a2102932c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:55.047092 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d34cfd-eed7-48e0-ae12-22a2102932c7 admin admin] PATH_INFO: `/v3/users/fd0545704be84cc1840d0a13f7c4a4b4` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:55.048557 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d34cfd-eed7-48e0-ae12-22a2102932c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd0545704be84cc1840d0a13f7c4a4b4)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:55.051095 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d34cfd-eed7-48e0-ae12-22a2102932c7 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:55.073443 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-f8f54758-02e4-43ff-8677-2148ad3299d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23c7dd7906bd4068b2d704e014522bdd', 'request_id': 'req-f8f54758-02e4-43ff-8677-2148ad3299d8'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:55.088281 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-f8f54758-02e4-43ff-8677-2148ad3299d8 admin admin] The token cache is being invalidate because project 23c7dd7906bd4068b2d704e014522bdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:30:55.088572 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-f8f54758-02e4-43ff-8677-2148ad3299d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:55.089280 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-f8f54758-02e4-43ff-8677-2148ad3299d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:55.090972 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 984/1970] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:30:54 2022] DELETE /identity/v3/projects/23c7dd7906bd4068b2d704e014522bdd => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:30:55.091749 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f54758-02e4-43ff-8677-2148ad3299d8 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:55.093144 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-f8f54758-02e4-43ff-8677-2148ad3299d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:55.162400 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f54758-02e4-43ff-8677-2148ad3299d8 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:55.166137 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b365fd4c-7da7-44e3-901f-90dfda1fce05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8693a1e72f14fdfb383f11e96330726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:55.166833 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365fd4c-7da7-44e3-901f-90dfda1fce05 service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:55.167123 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365fd4c-7da7-44e3-901f-90dfda1fce05 service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:55.167402 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365fd4c-7da7-44e3-901f-90dfda1fce05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:55.172831 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-b365fd4c-7da7-44e3-901f-90dfda1fce05 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:55.239849 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b365fd4c-7da7-44e3-901f-90dfda1fce05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:55.241364 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b365fd4c-7da7-44e3-901f-90dfda1fce05 service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:55.251471 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 985/1971] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:30:55 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:30:55.252271 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b365fd4c-7da7-44e3-901f-90dfda1fce05 service cinder] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:55.253614 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-b365fd4c-7da7-44e3-901f-90dfda1fce05 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:55.267321 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b365fd4c-7da7-44e3-901f-90dfda1fce05 service cinder] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:55.272672 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615cb799-2af1-47b3-ad67-a86edee9c377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:55.273511 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615cb799-2af1-47b3-ad67-a86edee9c377 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:55.273789 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615cb799-2af1-47b3-ad67-a86edee9c377 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:55.277393 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615cb799-2af1-47b3-ad67-a86edee9c377 admin admin] PATH_INFO: `/v3/users/1ba3de53a92e4051a92318a5348b98c3` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:55.277393 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615cb799-2af1-47b3-ad67-a86edee9c377 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ba3de53a92e4051a92318a5348b98c3)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:55.277393 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615cb799-2af1-47b3-ad67-a86edee9c377 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:55.375006 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-77d34cfd-eed7-48e0-ae12-22a2102932c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd0545704be84cc1840d0a13f7c4a4b4'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:55.409346 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-77d34cfd-eed7-48e0-ae12-22a2102932c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd0545704be84cc1840d0a13f7c4a4b4'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:55.413312 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-77d34cfd-eed7-48e0-ae12-22a2102932c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd0545704be84cc1840d0a13f7c4a4b4'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:55.414855 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-77d34cfd-eed7-48e0-ae12-22a2102932c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd0545704be84cc1840d0a13f7c4a4b4'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:55.565629 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-77d34cfd-eed7-48e0-ae12-22a2102932c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd0545704be84cc1840d0a13f7c4a4b4'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:55.588830 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 987/1972] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:30:54 2022] DELETE /identity/v3/users/fd0545704be84cc1840d0a13f7c4a4b4 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:30:55.589660 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d34cfd-eed7-48e0-ae12-22a2102932c7 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:55.591609 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-615cb799-2af1-47b3-ad67-a86edee9c377 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ba3de53a92e4051a92318a5348b98c3'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:55.592996 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-77d34cfd-eed7-48e0-ae12-22a2102932c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:55.600938 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-615cb799-2af1-47b3-ad67-a86edee9c377 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ba3de53a92e4051a92318a5348b98c3'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:55.601775 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-615cb799-2af1-47b3-ad67-a86edee9c377 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ba3de53a92e4051a92318a5348b98c3'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:55.603344 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-615cb799-2af1-47b3-ad67-a86edee9c377 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ba3de53a92e4051a92318a5348b98c3'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:55.681563 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d34cfd-eed7-48e0-ae12-22a2102932c7 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:55.688177 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c278ca-7179-46ab-bf60-80cb5b1bd721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:55.689137 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c278ca-7179-46ab-bf60-80cb5b1bd721 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:55.689423 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c278ca-7179-46ab-bf60-80cb5b1bd721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:55.689704 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c278ca-7179-46ab-bf60-80cb5b1bd721 admin admin] PATH_INFO: `/v3/projects/fcb3ce5c629048d796defc2741697284` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:55.691476 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c278ca-7179-46ab-bf60-80cb5b1bd721 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcb3ce5c629048d796defc2741697284)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:55.693598 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c278ca-7179-46ab-bf60-80cb5b1bd721 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:55.741243 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-615cb799-2af1-47b3-ad67-a86edee9c377 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ba3de53a92e4051a92318a5348b98c3'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:55.766871 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 986/1973] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:30:55 2022] DELETE /identity/v3/users/1ba3de53a92e4051a92318a5348b98c3 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:30:55.838770 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-50c278ca-7179-46ab-bf60-80cb5b1bd721 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcb3ce5c629048d796defc2741697284', 'request_id': 'req-50c278ca-7179-46ab-bf60-80cb5b1bd721'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:55.853846 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-50c278ca-7179-46ab-bf60-80cb5b1bd721 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcb3ce5c629048d796defc2741697284', 'request_id': 'req-50c278ca-7179-46ab-bf60-80cb5b1bd721'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:55.859672 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-50c278ca-7179-46ab-bf60-80cb5b1bd721 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcb3ce5c629048d796defc2741697284', 'request_id': 'req-50c278ca-7179-46ab-bf60-80cb5b1bd721'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:56.039502 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-50c278ca-7179-46ab-bf60-80cb5b1bd721 admin admin] The token cache is being invalidate because project fcb3ce5c629048d796defc2741697284 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80288) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:30:56.039802 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-50c278ca-7179-46ab-bf60-80cb5b1bd721 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:56.041898 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-50c278ca-7179-46ab-bf60-80cb5b1bd721 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:56.042078 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 988/1974] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:30:55 2022] DELETE /identity/v3/projects/fcb3ce5c629048d796defc2741697284 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:30:56.046863 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167338e-2e9d-46ce-bb60-80093b37979d None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:56.047345 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167338e-2e9d-46ce-bb60-80093b37979d None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:56.047810 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167338e-2e9d-46ce-bb60-80093b37979d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:56.068479 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-9167338e-2e9d-46ce-bb60-80093b37979d None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:56.069687 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-9167338e-2e9d-46ce-bb60-80093b37979d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:56.134079 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 987/1975] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:30:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:30:56.141760 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd56be-d99b-47ea-a336-99dbcae117b9 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:56.142054 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd56be-d99b-47ea-a336-99dbcae117b9 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:56.142374 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd56be-d99b-47ea-a336-99dbcae117b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:56.161511 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-bddd56be-d99b-47ea-a336-99dbcae117b9 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:56.162763 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-bddd56be-d99b-47ea-a336-99dbcae117b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:56.171656 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 989/1976] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:30:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:30:56.176386 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9167338e-2e9d-46ce-bb60-80093b37979d None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:56.191762 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9167338e-2e9d-46ce-bb60-80093b37979d None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:56.216400 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9609f307-6bf6-4f63-b412-33e3dd1b092a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:56.216400 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9609f307-6bf6-4f63-b412-33e3dd1b092a admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:56.216400 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9609f307-6bf6-4f63-b412-33e3dd1b092a admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:56.216400 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9609f307-6bf6-4f63-b412-33e3dd1b092a admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:56.216911 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9609f307-6bf6-4f63-b412-33e3dd1b092a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:30:56.216911 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9609f307-6bf6-4f63-b412-33e3dd1b092a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:56.216911 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9609f307-6bf6-4f63-b412-33e3dd1b092a admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:56.216911 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 988/1977] 10.222.0.62 () {58 vars in 1152 bytes} [Fri May 27 16:30:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:30:56.218450 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddd56be-d99b-47ea-a336-99dbcae117b9 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:56.228658 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddd56be-d99b-47ea-a336-99dbcae117b9 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:56.233450 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978bd46c-1675-4031-9d0f-17dfcd6f2bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:56.234147 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978bd46c-1675-4031-9d0f-17dfcd6f2bb5 admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:56.234477 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978bd46c-1675-4031-9d0f-17dfcd6f2bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:56.234762 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978bd46c-1675-4031-9d0f-17dfcd6f2bb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:56.235470 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978bd46c-1675-4031-9d0f-17dfcd6f2bb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:56.237985 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978bd46c-1675-4031-9d0f-17dfcd6f2bb5 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:56.542952 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9609f307-6bf6-4f63-b412-33e3dd1b092a admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:56.545699 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-9609f307-6bf6-4f63-b412-33e3dd1b092a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:56.567307 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9609f307-6bf6-4f63-b412-33e3dd1b092a admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:56.580743 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 990/1978] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:30:56 2022] POST /identity/v3/projects => generated 385 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:30:56.583482 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978bd46c-1675-4031-9d0f-17dfcd6f2bb5 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:56.587120 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-978bd46c-1675-4031-9d0f-17dfcd6f2bb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:56.591149 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2875d43c-8bbf-4fd2-a4b3-a21be12f3621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:56.592038 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2875d43c-8bbf-4fd2-a4b3-a21be12f3621 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:56.592612 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2875d43c-8bbf-4fd2-a4b3-a21be12f3621 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:56.592612 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2875d43c-8bbf-4fd2-a4b3-a21be12f3621 admin admin] PATH_INFO: `/v3/projects/27f1f385dcd045b3a8c99c7a268637b3` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:56.596057 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2875d43c-8bbf-4fd2-a4b3-a21be12f3621 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27f1f385dcd045b3a8c99c7a268637b3)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:56.598826 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2875d43c-8bbf-4fd2-a4b3-a21be12f3621 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:56.616283 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:30:56.685599 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978bd46c-1675-4031-9d0f-17dfcd6f2bb5 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:56.690382 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8e2491-a40d-4452-aba9-4fcde20d5d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:56.690382 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8e2491-a40d-4452-aba9-4fcde20d5d6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:56.690382 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8e2491-a40d-4452-aba9-4fcde20d5d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:56.690382 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8e2491-a40d-4452-aba9-4fcde20d5d6c admin admin] PATH_INFO: `/v3/projects/0d8c8982a9db4fd393c21cd21fbdffea` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:56.691911 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8e2491-a40d-4452-aba9-4fcde20d5d6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d8c8982a9db4fd393c21cd21fbdffea)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:56.693063 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8e2491-a40d-4452-aba9-4fcde20d5d6c admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:56.946918 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-2875d43c-8bbf-4fd2-a4b3-a21be12f3621 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27f1f385dcd045b3a8c99c7a268637b3', 'request_id': 'req-2875d43c-8bbf-4fd2-a4b3-a21be12f3621'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:56.950700 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-3d8e2491-a40d-4452-aba9-4fcde20d5d6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d8c8982a9db4fd393c21cd21fbdffea', 'request_id': 'req-3d8e2491-a40d-4452-aba9-4fcde20d5d6c'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:56.953838 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-2875d43c-8bbf-4fd2-a4b3-a21be12f3621 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27f1f385dcd045b3a8c99c7a268637b3', 'request_id': 'req-2875d43c-8bbf-4fd2-a4b3-a21be12f3621'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:56.957859 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-3d8e2491-a40d-4452-aba9-4fcde20d5d6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d8c8982a9db4fd393c21cd21fbdffea', 'request_id': 'req-3d8e2491-a40d-4452-aba9-4fcde20d5d6c'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:56.965835 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-3d8e2491-a40d-4452-aba9-4fcde20d5d6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d8c8982a9db4fd393c21cd21fbdffea', 'request_id': 'req-3d8e2491-a40d-4452-aba9-4fcde20d5d6c'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:57.038372 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-2875d43c-8bbf-4fd2-a4b3-a21be12f3621 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27f1f385dcd045b3a8c99c7a268637b3', 'request_id': 'req-2875d43c-8bbf-4fd2-a4b3-a21be12f3621'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:57.052153 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-2875d43c-8bbf-4fd2-a4b3-a21be12f3621 admin admin] The token cache is being invalidate because project 27f1f385dcd045b3a8c99c7a268637b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:30:57.052450 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-2875d43c-8bbf-4fd2-a4b3-a21be12f3621 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:57.053099 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-2875d43c-8bbf-4fd2-a4b3-a21be12f3621 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:57.054738 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 989/1979] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:30:56 2022] DELETE /identity/v3/projects/27f1f385dcd045b3a8c99c7a268637b3 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:30:57.058732 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2875d43c-8bbf-4fd2-a4b3-a21be12f3621 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:57.058732 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-2875d43c-8bbf-4fd2-a4b3-a21be12f3621 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:57.121769 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2875d43c-8bbf-4fd2-a4b3-a21be12f3621 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:57.181133 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5023503a-ce09-4c6e-b981-661c7c54beba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:57.181814 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023503a-ce09-4c6e-b981-661c7c54beba admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:57.192758 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023503a-ce09-4c6e-b981-661c7c54beba admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:57.192758 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023503a-ce09-4c6e-b981-661c7c54beba admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:57.192962 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-3d8e2491-a40d-4452-aba9-4fcde20d5d6c admin admin] The token cache is being invalidate because project 0d8c8982a9db4fd393c21cd21fbdffea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80288) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:30:57.192962 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-3d8e2491-a40d-4452-aba9-4fcde20d5d6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:57.193125 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5023503a-ce09-4c6e-b981-661c7c54beba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:57.193232 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-3d8e2491-a40d-4452-aba9-4fcde20d5d6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:57.193320 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5023503a-ce09-4c6e-b981-661c7c54beba admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:57.193430 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 991/1980] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:30:56 2022] DELETE /identity/v3/projects/0d8c8982a9db4fd393c21cd21fbdffea => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:30:57.193430 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4928e523-b460-4de2-bfe9-367e418b170f None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:57.193430 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4928e523-b460-4de2-bfe9-367e418b170f None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:57.193430 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4928e523-b460-4de2-bfe9-367e418b170f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:57.209902 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-4928e523-b460-4de2-bfe9-367e418b170f None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:57.211150 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-4928e523-b460-4de2-bfe9-367e418b170f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:57.219280 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 992/1981] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:30:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:30:57.220506 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc62f1-7cbd-45ec-9c30-0c8922e06c93 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:57.220800 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc62f1-7cbd-45ec-9c30-0c8922e06c93 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:57.221084 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc62f1-7cbd-45ec-9c30-0c8922e06c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:57.240252 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-39dc62f1-7cbd-45ec-9c30-0c8922e06c93 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:57.241384 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-39dc62f1-7cbd-45ec-9c30-0c8922e06c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:57.249287 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 993/1982] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:30:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:30:57.250507 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e4e9ef-2063-434e-b51a-7416c02d02ca None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:57.250800 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e4e9ef-2063-434e-b51a-7416c02d02ca None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:57.251082 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e4e9ef-2063-434e-b51a-7416c02d02ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:57.270119 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-a8e4e9ef-2063-434e-b51a-7416c02d02ca None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:57.271422 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-a8e4e9ef-2063-434e-b51a-7416c02d02ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:57.279493 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 994/1983] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:30:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:30:57.280770 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb74d62-ce3a-4bad-a364-3b8b8658ea6a None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:57.281057 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb74d62-ce3a-4bad-a364-3b8b8658ea6a None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:57.281335 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb74d62-ce3a-4bad-a364-3b8b8658ea6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:57.297983 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:30:57.302971 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-bfb74d62-ce3a-4bad-a364-3b8b8658ea6a None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:57.304311 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-bfb74d62-ce3a-4bad-a364-3b8b8658ea6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:57.306579 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 990/1984] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:30:57 2022] POST /identity/v3/users => generated 293 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:30:57.315004 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5023503a-ce09-4c6e-b981-661c7c54beba admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:57.315146 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 995/1985] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:30:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:30:57.318224 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb74d62-ce3a-4bad-a364-3b8b8658ea6a None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:57.319584 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-bfb74d62-ce3a-4bad-a364-3b8b8658ea6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:57.322455 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5023503a-ce09-4c6e-b981-661c7c54beba admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:57.329353 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adde13d-3808-4802-a918-d4713854c06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:57.330834 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adde13d-3808-4802-a918-d4713854c06f admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:57.331262 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adde13d-3808-4802-a918-d4713854c06f admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:57.332129 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adde13d-3808-4802-a918-d4713854c06f admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:57.332232 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb74d62-ce3a-4bad-a364-3b8b8658ea6a None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:57.333208 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adde13d-3808-4802-a918-d4713854c06f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:30:57.333960 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adde13d-3808-4802-a918-d4713854c06f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:57.335615 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adde13d-3808-4802-a918-d4713854c06f admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:57.337634 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8b1d31-3f99-49ab-9a20-ddfdf67cb9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:57.338387 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8b1d31-3f99-49ab-9a20-ddfdf67cb9d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:57.338642 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8b1d31-3f99-49ab-9a20-ddfdf67cb9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:57.338924 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8b1d31-3f99-49ab-9a20-ddfdf67cb9d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:57.339804 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8b1d31-3f99-49ab-9a20-ddfdf67cb9d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:57.341434 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8b1d31-3f99-49ab-9a20-ddfdf67cb9d0 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:57.353195 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 991/1987] 10.222.0.62 () {58 vars in 1152 bytes} [Fri May 27 16:30:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:30:57.353338 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 996/1987] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:30:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:30:57.354073 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8b1d31-3f99-49ab-9a20-ddfdf67cb9d0 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:57.357471 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adde13d-3808-4802-a918-d4713854c06f admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:57.364830 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8b1d31-3f99-49ab-9a20-ddfdf67cb9d0 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:57.367914 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adde13d-3808-4802-a918-d4713854c06f admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:57.370103 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6374ea6-2d9d-4053-8089-04c3d27d375c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:57.371026 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6374ea6-2d9d-4053-8089-04c3d27d375c admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:57.371321 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6374ea6-2d9d-4053-8089-04c3d27d375c admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:57.371699 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6374ea6-2d9d-4053-8089-04c3d27d375c admin admin] PATH_INFO: `/v3/domains` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:57.372382 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6374ea6-2d9d-4053-8089-04c3d27d375c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:30:57.372685 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6374ea6-2d9d-4053-8089-04c3d27d375c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:57.372845 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e91ebc-4e74-4581-8374-f57048cf6f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:57.373502 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e91ebc-4e74-4581-8374-f57048cf6f78 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:57.373783 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e91ebc-4e74-4581-8374-f57048cf6f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:57.374060 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e91ebc-4e74-4581-8374-f57048cf6f78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:57.374448 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6374ea6-2d9d-4053-8089-04c3d27d375c admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:57.375015 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e91ebc-4e74-4581-8374-f57048cf6f78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:57.376594 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e91ebc-4e74-4581-8374-f57048cf6f78 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:57.387246 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 997/1989] 10.222.0.62 () {58 vars in 1152 bytes} [Fri May 27 16:30:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:30:57.387403 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 992/1989] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:30:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 16:30:57.388192 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e91ebc-4e74-4581-8374-f57048cf6f78 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:57.391694 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6374ea6-2d9d-4053-8089-04c3d27d375c admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:57.400341 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e91ebc-4e74-4581-8374-f57048cf6f78 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:57.402823 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6374ea6-2d9d-4053-8089-04c3d27d375c admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:57.405096 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2c74d3-fe76-47e3-809f-daa679157397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:57.405760 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c74d3-fe76-47e3-809f-daa679157397 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:57.406042 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c74d3-fe76-47e3-809f-daa679157397 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:57.406347 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c74d3-fe76-47e3-809f-daa679157397 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:57.407033 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2c74d3-fe76-47e3-809f-daa679157397 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:57.407538 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b373061-9960-4f2c-89c5-64a5150196b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:57.408193 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b373061-9960-4f2c-89c5-64a5150196b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:57.408485 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b373061-9960-4f2c-89c5-64a5150196b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:57.408764 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b373061-9960-4f2c-89c5-64a5150196b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:57.408922 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2c74d3-fe76-47e3-809f-daa679157397 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:57.409988 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b373061-9960-4f2c-89c5-64a5150196b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:57.411956 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b373061-9960-4f2c-89c5-64a5150196b0 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:57.580106 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 993/1990] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:30:57 2022] POST /identity/v3/projects => generated 409 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:30:57.580301 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 998/1991] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:30:57 2022] POST /identity/v3/projects => generated 371 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:30:57.580417 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2c74d3-fe76-47e3-809f-daa679157397 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:57.581181 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b373061-9960-4f2c-89c5-64a5150196b0 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:57.641621 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2c74d3-fe76-47e3-809f-daa679157397 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:57.645698 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b373061-9960-4f2c-89c5-64a5150196b0 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:57.646810 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e782fc3c-0e5c-4077-8998-a19b921b0d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:57.647870 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782fc3c-0e5c-4077-8998-a19b921b0d86 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:57.648157 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782fc3c-0e5c-4077-8998-a19b921b0d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:57.648435 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782fc3c-0e5c-4077-8998-a19b921b0d86 admin admin] PATH_INFO: `/v3/projects/72e16628fe62477abe892411987d77e6/users/beb5c8a530b44ce3abf89b04ae4d798c/roles/c8ce6d197f654598ac45f6016ecccabd` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:57.650584 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba6aca8-76c9-40b4-b58c-a1a792941fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:57.651255 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba6aca8-76c9-40b4-b58c-a1a792941fd4 admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:57.654426 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba6aca8-76c9-40b4-b58c-a1a792941fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:57.654426 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba6aca8-76c9-40b4-b58c-a1a792941fd4 admin admin] PATH_INFO: `/v3/users` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:57.654426 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba6aca8-76c9-40b4-b58c-a1a792941fd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:57.654426 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba6aca8-76c9-40b4-b58c-a1a792941fd4 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:57.663215 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e782fc3c-0e5c-4077-8998-a19b921b0d86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72e16628fe62477abe892411987d77e6, user_id=beb5c8a530b44ce3abf89b04ae4d798c, role_id=c8ce6d197f654598ac45f6016ecccabd)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:57.665889 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e782fc3c-0e5c-4077-8998-a19b921b0d86 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:57.815293 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 999/1993] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:30:57 2022] POST /identity/v3/users => generated 286 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:30:57.815549 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 994/1993] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:30:57 2022] PUT /identity/v3/projects/72e16628fe62477abe892411987d77e6/users/beb5c8a530b44ce3abf89b04ae4d798c/roles/c8ce6d197f654598ac45f6016ecccabd => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:30:57.816344 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e782fc3c-0e5c-4077-8998-a19b921b0d86 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:57.819322 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba6aca8-76c9-40b4-b58c-a1a792941fd4 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:57.830357 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba6aca8-76c9-40b4-b58c-a1a792941fd4 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:57.902866 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e782fc3c-0e5c-4077-8998-a19b921b0d86 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:57.907958 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990b478e-b563-4dba-b5ac-0e1c90c66026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:57.908531 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b478e-b563-4dba-b5ac-0e1c90c66026 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:57.908825 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b478e-b563-4dba-b5ac-0e1c90c66026 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:57.909148 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b478e-b563-4dba-b5ac-0e1c90c66026 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:57.909846 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990b478e-b563-4dba-b5ac-0e1c90c66026 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:57.911882 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990b478e-b563-4dba-b5ac-0e1c90c66026 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:57.915078 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0166600-be20-4eaa-9d6e-e96f93df61b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:57.915773 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0166600-be20-4eaa-9d6e-e96f93df61b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:57.916062 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0166600-be20-4eaa-9d6e-e96f93df61b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:57.916341 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0166600-be20-4eaa-9d6e-e96f93df61b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:57.917099 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0166600-be20-4eaa-9d6e-e96f93df61b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:57.918986 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0166600-be20-4eaa-9d6e-e96f93df61b5 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:57.933805 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1000/1994] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:30:57 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:30:57.933805 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd846225-def3-4891-92ab-37b25d665e6c None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:57.933805 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd846225-def3-4891-92ab-37b25d665e6c None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:57.933805 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd846225-def3-4891-92ab-37b25d665e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:57.961060 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-bd846225-def3-4891-92ab-37b25d665e6c None None] MFA Rules not processed for user `beb5c8a530b44ce3abf89b04ae4d798c`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:57.962334 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-bd846225-def3-4891-92ab-37b25d665e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:58.027841 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1001/1995] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:30:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:30:58.028559 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd846225-def3-4891-92ab-37b25d665e6c None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:58.039439 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd846225-def3-4891-92ab-37b25d665e6c None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:58.046003 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b979f9dc-661c-43a9-9122-77d45dbb6c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:58.049393 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979f9dc-661c-43a9-9122-77d45dbb6c00 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:58.049393 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979f9dc-661c-43a9-9122-77d45dbb6c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:58.049393 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979f9dc-661c-43a9-9122-77d45dbb6c00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:58.049393 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b979f9dc-661c-43a9-9122-77d45dbb6c00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:58.050033 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b979f9dc-661c-43a9-9122-77d45dbb6c00 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:58.064545 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1002/1996] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:30:58 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:30:58.066011 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b979f9dc-661c-43a9-9122-77d45dbb6c00 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:58.077131 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b979f9dc-661c-43a9-9122-77d45dbb6c00 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:58.080053 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 995/1997] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:30:57 2022] POST /identity/v3/users => generated 305 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:30:58.092598 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990b478e-b563-4dba-b5ac-0e1c90c66026 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:58.092744 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf8c825-c34f-402f-9f82-29abfb7049dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:58.092744 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf8c825-c34f-402f-9f82-29abfb7049dd admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:58.092744 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf8c825-c34f-402f-9f82-29abfb7049dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:58.092744 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf8c825-c34f-402f-9f82-29abfb7049dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:58.093092 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf8c825-c34f-402f-9f82-29abfb7049dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:58.093092 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf8c825-c34f-402f-9f82-29abfb7049dd admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:58.093263 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990b478e-b563-4dba-b5ac-0e1c90c66026 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:58.098750 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f600a7-5243-44fc-8575-275b85ba69df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:58.099706 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f600a7-5243-44fc-8575-275b85ba69df admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:58.100054 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f600a7-5243-44fc-8575-275b85ba69df admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:58.100338 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f600a7-5243-44fc-8575-275b85ba69df admin admin] PATH_INFO: `/v3/projects/3ee2cd9ac00d4f099c8c67b02e914a96/users/670e135cf2fc4ca39b8076cc010fe30c/roles/c8ce6d197f654598ac45f6016ecccabd` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:58.122586 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f600a7-5243-44fc-8575-275b85ba69df admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ee2cd9ac00d4f099c8c67b02e914a96, user_id=670e135cf2fc4ca39b8076cc010fe30c, role_id=c8ce6d197f654598ac45f6016ecccabd)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:58.125600 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f600a7-5243-44fc-8575-275b85ba69df admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:58.297317 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1003/1998] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:30:58 2022] POST /identity/v3/projects => generated 383 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:30:58.298400 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf8c825-c34f-402f-9f82-29abfb7049dd admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:58.316669 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 996/1999] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:30:58 2022] PUT /identity/v3/projects/3ee2cd9ac00d4f099c8c67b02e914a96/users/670e135cf2fc4ca39b8076cc010fe30c/roles/c8ce6d197f654598ac45f6016ecccabd => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:30:58.317899 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f600a7-5243-44fc-8575-275b85ba69df admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:58.378487 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf8c825-c34f-402f-9f82-29abfb7049dd admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:58.383600 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f63931-8625-46f5-bc10-05eba1279995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:58.384281 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f63931-8625-46f5-bc10-05eba1279995 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:58.384570 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f63931-8625-46f5-bc10-05eba1279995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:58.384854 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f63931-8625-46f5-bc10-05eba1279995 admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:58.385591 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f63931-8625-46f5-bc10-05eba1279995 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:58.387521 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f63931-8625-46f5-bc10-05eba1279995 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:58.394965 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f600a7-5243-44fc-8575-275b85ba69df admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:58.399811 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1004/2000] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:30:58 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:30:58.400550 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ebc5b3-07f1-498a-987b-a13a9c2e0a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:58.401396 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ebc5b3-07f1-498a-987b-a13a9c2e0a95 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:58.401831 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ebc5b3-07f1-498a-987b-a13a9c2e0a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:58.402311 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ebc5b3-07f1-498a-987b-a13a9c2e0a95 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:58.403297 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ebc5b3-07f1-498a-987b-a13a9c2e0a95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:58.404169 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0780245a-5e5b-485d-96ec-5a547b81f07c None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:58.404471 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0780245a-5e5b-485d-96ec-5a547b81f07c None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:58.404759 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0780245a-5e5b-485d-96ec-5a547b81f07c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:58.405234 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ebc5b3-07f1-498a-987b-a13a9c2e0a95 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:58.433254 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-0780245a-5e5b-485d-96ec-5a547b81f07c None None] MFA Rules not processed for user `670e135cf2fc4ca39b8076cc010fe30c`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:58.434502 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-0780245a-5e5b-485d-96ec-5a547b81f07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:58.510520 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1005/2001] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:30:58 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:30:58.519858 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0780245a-5e5b-485d-96ec-5a547b81f07c None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:58.526764 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0780245a-5e5b-485d-96ec-5a547b81f07c None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:58.532065 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b01b84-eae9-4a97-82b4-cead12f758ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:58.532743 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b01b84-eae9-4a97-82b4-cead12f758ce admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:58.533031 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b01b84-eae9-4a97-82b4-cead12f758ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:58.533309 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b01b84-eae9-4a97-82b4-cead12f758ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:58.534039 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b01b84-eae9-4a97-82b4-cead12f758ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:58.535718 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b01b84-eae9-4a97-82b4-cead12f758ce admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:58.552095 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1006/2002] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:30:58 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:30:58.552095 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b01b84-eae9-4a97-82b4-cead12f758ce admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:58.573557 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 997/2003] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:30:58 2022] POST /identity/v3/users => generated 292 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:30:58.575028 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ebc5b3-07f1-498a-987b-a13a9c2e0a95 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:58.577099 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-a9ebc5b3-07f1-498a-987b-a13a9c2e0a95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:58.577645 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b01b84-eae9-4a97-82b4-cead12f758ce admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:58.587819 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dced38-fd15-40ab-bbfc-401e357d1b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:58.587819 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dced38-fd15-40ab-bbfc-401e357d1b86 admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:58.587819 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dced38-fd15-40ab-bbfc-401e357d1b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:58.587819 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dced38-fd15-40ab-bbfc-401e357d1b86 admin admin] PATH_INFO: `/v3/projects` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:58.588650 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dced38-fd15-40ab-bbfc-401e357d1b86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:58.589939 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dced38-fd15-40ab-bbfc-401e357d1b86 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:58.608733 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ebc5b3-07f1-498a-987b-a13a9c2e0a95 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:58.614344 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12943a3-395e-49bb-9542-d2c4300a646d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:58.615345 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12943a3-395e-49bb-9542-d2c4300a646d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:58.615734 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12943a3-395e-49bb-9542-d2c4300a646d admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:58.616135 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12943a3-395e-49bb-9542-d2c4300a646d admin admin] PATH_INFO: `/v3/users/f5d5435c39d64dcebac4afb2e7242b85` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:58.617453 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12943a3-395e-49bb-9542-d2c4300a646d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5d5435c39d64dcebac4afb2e7242b85)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:58.619668 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12943a3-395e-49bb-9542-d2c4300a646d admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:58.731875 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1007/2004] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:30:58 2022] POST /identity/v3/projects => generated 373 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:30:58.733066 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dced38-fd15-40ab-bbfc-401e357d1b86 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:58.775038 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:30:58.803734 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dced38-fd15-40ab-bbfc-401e357d1b86 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:58.809146 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f30a021-c524-44aa-a570-a2532964145a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:58.810098 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30a021-c524-44aa-a570-a2532964145a admin admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:58.810430 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30a021-c524-44aa-a570-a2532964145a admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:58.810911 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30a021-c524-44aa-a570-a2532964145a admin admin] PATH_INFO: `/v3/projects/7413bc6221e74c9aaeb392b307fabcb8/users/5ebfccd5c7474777bfe1395aeb6345da/roles/c8ce6d197f654598ac45f6016ecccabd` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:58.829500 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f30a021-c524-44aa-a570-a2532964145a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7413bc6221e74c9aaeb392b307fabcb8, user_id=5ebfccd5c7474777bfe1395aeb6345da, role_id=c8ce6d197f654598ac45f6016ecccabd)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:58.832194 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f30a021-c524-44aa-a570-a2532964145a admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:58.934658 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-e12943a3-395e-49bb-9542-d2c4300a646d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5d5435c39d64dcebac4afb2e7242b85'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:58.942646 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-e12943a3-395e-49bb-9542-d2c4300a646d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5d5435c39d64dcebac4afb2e7242b85'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:58.943340 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-e12943a3-395e-49bb-9542-d2c4300a646d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5d5435c39d64dcebac4afb2e7242b85'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:58.943974 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-e12943a3-395e-49bb-9542-d2c4300a646d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5d5435c39d64dcebac4afb2e7242b85'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:58.961433 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1008/2005] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:30:58 2022] PUT /identity/v3/projects/7413bc6221e74c9aaeb392b307fabcb8/users/5ebfccd5c7474777bfe1395aeb6345da/roles/c8ce6d197f654598ac45f6016ecccabd => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:30:58.975294 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f30a021-c524-44aa-a570-a2532964145a admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:58.977626 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-6f30a021-c524-44aa-a570-a2532964145a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:59.052640 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f30a021-c524-44aa-a570-a2532964145a admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:59.057339 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f6d595-fc09-4d4c-8716-e1c24cba6309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:59.057986 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f6d595-fc09-4d4c-8716-e1c24cba6309 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:59.058291 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f6d595-fc09-4d4c-8716-e1c24cba6309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:59.058572 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f6d595-fc09-4d4c-8716-e1c24cba6309 admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:59.059297 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f6d595-fc09-4d4c-8716-e1c24cba6309 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:59.060916 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f6d595-fc09-4d4c-8716-e1c24cba6309 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:59.070011 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-e12943a3-395e-49bb-9542-d2c4300a646d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5d5435c39d64dcebac4afb2e7242b85'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:59.072197 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1009/2006] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:30:58 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:30:59.072909 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f6d595-fc09-4d4c-8716-e1c24cba6309 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:59.075281 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-f7f6d595-fc09-4d4c-8716-e1c24cba6309 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:59.086757 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 998/2007] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:30:58 2022] DELETE /identity/v3/users/f5d5435c39d64dcebac4afb2e7242b85 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:30:59.087674 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12943a3-395e-49bb-9542-d2c4300a646d admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:59.089710 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-e12943a3-395e-49bb-9542-d2c4300a646d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:59.094995 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f6d595-fc09-4d4c-8716-e1c24cba6309 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:59.170116 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12943a3-395e-49bb-9542-d2c4300a646d admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:59.173823 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983bf482-a6f4-4ded-a901-bb852dbe0562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:59.174611 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983bf482-a6f4-4ded-a901-bb852dbe0562 admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:59.175025 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a57eb2-a2c0-48c2-838d-a64edb8e4b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:59.175230 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983bf482-a6f4-4ded-a901-bb852dbe0562 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:59.175645 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983bf482-a6f4-4ded-a901-bb852dbe0562 admin admin] PATH_INFO: `/v3/users` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:59.176025 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a57eb2-a2c0-48c2-838d-a64edb8e4b04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:59.176312 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a57eb2-a2c0-48c2-838d-a64edb8e4b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:59.176598 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a57eb2-a2c0-48c2-838d-a64edb8e4b04 admin admin] PATH_INFO: `/v3/users/6066cf53517044f69afcd4c2e8b13b55` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:59.177266 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983bf482-a6f4-4ded-a901-bb852dbe0562 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:59.177864 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a57eb2-a2c0-48c2-838d-a64edb8e4b04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6066cf53517044f69afcd4c2e8b13b55)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:59.179959 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a57eb2-a2c0-48c2-838d-a64edb8e4b04 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:59.180233 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983bf482-a6f4-4ded-a901-bb852dbe0562 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:59.298077 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:30:59.302045 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1010/2008] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:30:59 2022] POST /identity/v3/users => generated 293 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:30:59.303458 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b68bd9-0ff0-454c-9931-3855376a9770 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:59.303781 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b68bd9-0ff0-454c-9931-3855376a9770 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:59.304064 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b68bd9-0ff0-454c-9931-3855376a9770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:59.329717 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-31b68bd9-0ff0-454c-9931-3855376a9770 None None] MFA Rules not processed for user `5ebfccd5c7474777bfe1395aeb6345da`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:59.330971 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-31b68bd9-0ff0-454c-9931-3855376a9770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:59.393622 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1011/2009] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:30:59 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:30:59.395054 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b68bd9-0ff0-454c-9931-3855376a9770 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:59.404950 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b68bd9-0ff0-454c-9931-3855376a9770 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:59.409734 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d73c3fb-cf77-4133-89a6-44754e99894c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:59.410440 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d73c3fb-cf77-4133-89a6-44754e99894c admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:59.410733 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d73c3fb-cf77-4133-89a6-44754e99894c admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:59.411018 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d73c3fb-cf77-4133-89a6-44754e99894c admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:59.411868 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d73c3fb-cf77-4133-89a6-44754e99894c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:59.413560 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d73c3fb-cf77-4133-89a6-44754e99894c admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:59.423748 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1012/2010] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:30:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:30:59.425000 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e5d19-97e4-4965-9514-3a44010932d0 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:59.425569 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e5d19-97e4-4965-9514-3a44010932d0 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:59.425569 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e5d19-97e4-4965-9514-3a44010932d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:59.443309 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-cb7e5d19-97e4-4965-9514-3a44010932d0 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:59.444512 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-cb7e5d19-97e4-4965-9514-3a44010932d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:59.452134 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1013/2011] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:30:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:30:59.452891 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e5d19-97e4-4965-9514-3a44010932d0 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:59.465860 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e5d19-97e4-4965-9514-3a44010932d0 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:59.471534 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae95943-dec1-40f3-8b2d-42020517d460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:59.472334 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae95943-dec1-40f3-8b2d-42020517d460 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:59.472625 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae95943-dec1-40f3-8b2d-42020517d460 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:59.473153 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae95943-dec1-40f3-8b2d-42020517d460 admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:59.473899 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae95943-dec1-40f3-8b2d-42020517d460 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:59.475767 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae95943-dec1-40f3-8b2d-42020517d460 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:59.476026 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-97a57eb2-a2c0-48c2-838d-a64edb8e4b04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6066cf53517044f69afcd4c2e8b13b55'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:59.484083 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-97a57eb2-a2c0-48c2-838d-a64edb8e4b04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6066cf53517044f69afcd4c2e8b13b55'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:59.484797 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-97a57eb2-a2c0-48c2-838d-a64edb8e4b04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6066cf53517044f69afcd4c2e8b13b55'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:59.485438 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-97a57eb2-a2c0-48c2-838d-a64edb8e4b04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6066cf53517044f69afcd4c2e8b13b55'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:59.487575 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1014/2012] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:30:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:30:59.491120 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae95943-dec1-40f3-8b2d-42020517d460 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:59.492961 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-eae95943-dec1-40f3-8b2d-42020517d460 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:59.507210 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae95943-dec1-40f3-8b2d-42020517d460 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:59.512099 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b8605f-bbe3-42ea-b201-1225080650a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:59.513007 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b8605f-bbe3-42ea-b201-1225080650a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:59.513375 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b8605f-bbe3-42ea-b201-1225080650a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:59.513735 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b8605f-bbe3-42ea-b201-1225080650a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:59.514549 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b8605f-bbe3-42ea-b201-1225080650a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:59.516510 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b8605f-bbe3-42ea-b201-1225080650a5 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:59.592270 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-97a57eb2-a2c0-48c2-838d-a64edb8e4b04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6066cf53517044f69afcd4c2e8b13b55'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:59.609826 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 999/2013] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:30:59 2022] DELETE /identity/v3/users/6066cf53517044f69afcd4c2e8b13b55 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:30:59.610627 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a57eb2-a2c0-48c2-838d-a64edb8e4b04 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:59.611992 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-97a57eb2-a2c0-48c2-838d-a64edb8e4b04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:59.647197 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1015/2014] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:30:59 2022] POST /identity/v3/projects => generated 409 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:30:59.648195 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b8605f-bbe3-42ea-b201-1225080650a5 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:59.650039 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-81b8605f-bbe3-42ea-b201-1225080650a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:59.710296 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a57eb2-a2c0-48c2-838d-a64edb8e4b04 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:59.726495 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b8605f-bbe3-42ea-b201-1225080650a5 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:59.730569 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf3bc47-fa24-4e8c-b0fb-7da39647b2f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:59.731491 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf3bc47-fa24-4e8c-b0fb-7da39647b2f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:59.731836 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf3bc47-fa24-4e8c-b0fb-7da39647b2f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:59.732112 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf3bc47-fa24-4e8c-b0fb-7da39647b2f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:59.733960 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-bbf3bc47-fa24-4e8c-b0fb-7da39647b2f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:59.787348 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b97ada3-ee01-443e-8573-c7971d0d7ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:59.788261 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97ada3-ee01-443e-8573-c7971d0d7ebb admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:59.788546 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97ada3-ee01-443e-8573-c7971d0d7ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:59.788825 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97ada3-ee01-443e-8573-c7971d0d7ebb admin admin] PATH_INFO: `/v3/projects/c74e9355689e458da6dace1a1bb6c955/users/94662e93cf4f42f486c9b91ac683f38d/roles/c8ce6d197f654598ac45f6016ecccabd` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:59.804820 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b97ada3-ee01-443e-8573-c7971d0d7ebb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c74e9355689e458da6dace1a1bb6c955, user_id=94662e93cf4f42f486c9b91ac683f38d, role_id=c8ce6d197f654598ac45f6016ecccabd)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:59.806216 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf3bc47-fa24-4e8c-b0fb-7da39647b2f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:59.807748 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b97ada3-ee01-443e-8573-c7971d0d7ebb admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:59.807885 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf3bc47-fa24-4e8c-b0fb-7da39647b2f2 service neutron] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:59.818184 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1016/2015] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:30:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:30:59.819008 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf3bc47-fa24-4e8c-b0fb-7da39647b2f2 service neutron] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:59.820409 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-bbf3bc47-fa24-4e8c-b0fb-7da39647b2f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:59.837399 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf3bc47-fa24-4e8c-b0fb-7da39647b2f2 service neutron] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:59.844743 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a06af31-4c8c-43b9-8804-ed33df843f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:59.844743 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a06af31-4c8c-43b9-8804-ed33df843f8b admin admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:59.844743 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a06af31-4c8c-43b9-8804-ed33df843f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:59.844743 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a06af31-4c8c-43b9-8804-ed33df843f8b admin admin] PATH_INFO: `/v3/projects/a7a89b6b3cd94b958731721c60697afb/users/9849609af4c746f3a33cdad4861e09fd/roles/e04fe3eb1f714d74901ac83e33ea8a16` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:59.861591 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a06af31-4c8c-43b9-8804-ed33df843f8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7a89b6b3cd94b958731721c60697afb, user_id=9849609af4c746f3a33cdad4861e09fd, role_id=e04fe3eb1f714d74901ac83e33ea8a16)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:59.864866 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a06af31-4c8c-43b9-8804-ed33df843f8b admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:59.963283 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1000/2016] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:30:59 2022] PUT /identity/v3/projects/c74e9355689e458da6dace1a1bb6c955/users/94662e93cf4f42f486c9b91ac683f38d/roles/c8ce6d197f654598ac45f6016ecccabd => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:30:59.964101 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b97ada3-ee01-443e-8573-c7971d0d7ebb admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:00.006148 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1017/2017] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:30:59 2022] PUT /identity/v3/projects/a7a89b6b3cd94b958731721c60697afb/users/9849609af4c746f3a33cdad4861e09fd/roles/e04fe3eb1f714d74901ac83e33ea8a16 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:31:00.007022 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a06af31-4c8c-43b9-8804-ed33df843f8b admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:00.008609 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-0a06af31-4c8c-43b9-8804-ed33df843f8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:00.036735 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b97ada3-ee01-443e-8573-c7971d0d7ebb admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:00.079302 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a06af31-4c8c-43b9-8804-ed33df843f8b admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:00.083988 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6c3faa-b1ba-46a5-8f5c-337c029af727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:00.084863 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c3faa-b1ba-46a5-8f5c-337c029af727 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:00.085144 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c3faa-b1ba-46a5-8f5c-337c029af727 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:00.085418 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c3faa-b1ba-46a5-8f5c-337c029af727 admin admin] PATH_INFO: `/v3/users/b885a352f255484d936327874ad5cce5` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:00.086733 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6c3faa-b1ba-46a5-8f5c-337c029af727 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b885a352f255484d936327874ad5cce5)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:00.088655 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6c3faa-b1ba-46a5-8f5c-337c029af727 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:00.098961 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade1af45-edff-4d8f-92ae-22f7eaa3e551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:00.099572 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade1af45-edff-4d8f-92ae-22f7eaa3e551 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:00.099859 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade1af45-edff-4d8f-92ae-22f7eaa3e551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:00.100509 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade1af45-edff-4d8f-92ae-22f7eaa3e551 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:00.100845 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade1af45-edff-4d8f-92ae-22f7eaa3e551 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:00.102816 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade1af45-edff-4d8f-92ae-22f7eaa3e551 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:00.268834 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1001/2018] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:30:59 2022] POST /identity/v3/users => generated 311 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:31:00.270050 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade1af45-edff-4d8f-92ae-22f7eaa3e551 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:00.272149 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-ade1af45-edff-4d8f-92ae-22f7eaa3e551 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:00.285254 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade1af45-edff-4d8f-92ae-22f7eaa3e551 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:00.290162 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e877395-9d8a-4088-8190-beddbac3a64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:00.291045 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e877395-9d8a-4088-8190-beddbac3a64d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:00.291324 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e877395-9d8a-4088-8190-beddbac3a64d admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:00.291600 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e877395-9d8a-4088-8190-beddbac3a64d admin admin] PATH_INFO: `/v3/projects/7481daa23a9c4f7b91e59bb4795bd262` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:00.292777 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e877395-9d8a-4088-8190-beddbac3a64d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7481daa23a9c4f7b91e59bb4795bd262)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:00.294884 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e877395-9d8a-4088-8190-beddbac3a64d admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:00.407097 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-ad6c3faa-b1ba-46a5-8f5c-337c029af727 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b885a352f255484d936327874ad5cce5'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:00.420878 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-ad6c3faa-b1ba-46a5-8f5c-337c029af727 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b885a352f255484d936327874ad5cce5'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:00.421608 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-ad6c3faa-b1ba-46a5-8f5c-337c029af727 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b885a352f255484d936327874ad5cce5'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:00.422223 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-ad6c3faa-b1ba-46a5-8f5c-337c029af727 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b885a352f255484d936327874ad5cce5'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:00.445730 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-2e877395-9d8a-4088-8190-beddbac3a64d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7481daa23a9c4f7b91e59bb4795bd262', 'request_id': 'req-2e877395-9d8a-4088-8190-beddbac3a64d'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:00.455045 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-2e877395-9d8a-4088-8190-beddbac3a64d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7481daa23a9c4f7b91e59bb4795bd262', 'request_id': 'req-2e877395-9d8a-4088-8190-beddbac3a64d'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:00.550577 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-ad6c3faa-b1ba-46a5-8f5c-337c029af727 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b885a352f255484d936327874ad5cce5'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:00.563464 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1018/2019] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:31:00 2022] DELETE /identity/v3/users/b885a352f255484d936327874ad5cce5 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:31:00.565562 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35aa06a-6247-44e5-8240-cb92fa7e1c7b None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:00.565863 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35aa06a-6247-44e5-8240-cb92fa7e1c7b None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:00.566153 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35aa06a-6247-44e5-8240-cb92fa7e1c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:00.594399 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-f35aa06a-6247-44e5-8240-cb92fa7e1c7b None None] MFA Rules not processed for user `94662e93cf4f42f486c9b91ac683f38d`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:31:00.595605 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-f35aa06a-6247-44e5-8240-cb92fa7e1c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:00.659136 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1019/2020] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:31:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:31:00.659960 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35aa06a-6247-44e5-8240-cb92fa7e1c7b None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:00.661237 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-f35aa06a-6247-44e5-8240-cb92fa7e1c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:00.690439 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-2e877395-9d8a-4088-8190-beddbac3a64d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7481daa23a9c4f7b91e59bb4795bd262', 'request_id': 'req-2e877395-9d8a-4088-8190-beddbac3a64d'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:00.702747 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-2e877395-9d8a-4088-8190-beddbac3a64d admin admin] The token cache is being invalidate because project 7481daa23a9c4f7b91e59bb4795bd262 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:31:00.703044 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-2e877395-9d8a-4088-8190-beddbac3a64d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:00.703730 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-2e877395-9d8a-4088-8190-beddbac3a64d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:00.705319 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1002/2021] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:31:00 2022] DELETE /identity/v3/projects/7481daa23a9c4f7b91e59bb4795bd262 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:31:00.715808 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e877395-9d8a-4088-8190-beddbac3a64d admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:00.715808 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-2e877395-9d8a-4088-8190-beddbac3a64d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:00.728773 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35aa06a-6247-44e5-8240-cb92fa7e1c7b None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:00.733923 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86158e74-28c6-4f66-b417-f9b411fff8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:00.734698 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86158e74-28c6-4f66-b417-f9b411fff8f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:00.734989 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86158e74-28c6-4f66-b417-f9b411fff8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:00.735271 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86158e74-28c6-4f66-b417-f9b411fff8f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:00.736015 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86158e74-28c6-4f66-b417-f9b411fff8f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:00.738157 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86158e74-28c6-4f66-b417-f9b411fff8f0 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:00.748454 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1020/2022] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:31:00 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:31:00.751376 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86158e74-28c6-4f66-b417-f9b411fff8f0 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:00.751376 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-86158e74-28c6-4f66-b417-f9b411fff8f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:00.764987 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86158e74-28c6-4f66-b417-f9b411fff8f0 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:00.769621 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324ff549-096a-4caa-ab0b-1e2456ef0f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:00.770513 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ff549-096a-4caa-ab0b-1e2456ef0f82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:00.770803 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ff549-096a-4caa-ab0b-1e2456ef0f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:00.771086 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ff549-096a-4caa-ab0b-1e2456ef0f82 admin admin] PATH_INFO: `/v3/projects/a17442805f6f4f72b37352c7746941d3` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:00.772317 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324ff549-096a-4caa-ab0b-1e2456ef0f82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a17442805f6f4f72b37352c7746941d3)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:00.774220 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324ff549-096a-4caa-ab0b-1e2456ef0f82 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:00.774963 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e877395-9d8a-4088-8190-beddbac3a64d admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:00.779813 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da312a0-9a1f-40a0-9b88-7800da52e0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:00.780486 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da312a0-9a1f-40a0-9b88-7800da52e0f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:00.781103 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da312a0-9a1f-40a0-9b88-7800da52e0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:00.781103 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da312a0-9a1f-40a0-9b88-7800da52e0f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:00.781766 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da312a0-9a1f-40a0-9b88-7800da52e0f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:00.783402 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da312a0-9a1f-40a0-9b88-7800da52e0f0 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:00.793571 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1003/2023] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:31:00 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:31:00.794951 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed92801c-21b8-4b90-9c66-cc5c664c62f2 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:00.797314 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed92801c-21b8-4b90-9c66-cc5c664c62f2 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:00.797314 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed92801c-21b8-4b90-9c66-cc5c664c62f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:00.813790 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-ed92801c-21b8-4b90-9c66-cc5c664c62f2 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:31:00.816351 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-ed92801c-21b8-4b90-9c66-cc5c664c62f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:00.824495 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1004/2024] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:31:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:31:00.825302 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed92801c-21b8-4b90-9c66-cc5c664c62f2 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:00.826818 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-ed92801c-21b8-4b90-9c66-cc5c664c62f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:00.839391 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed92801c-21b8-4b90-9c66-cc5c664c62f2 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:00.846915 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c1cdaa-a9b1-4ef3-9764-02f7cd32e865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:00.847735 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c1cdaa-a9b1-4ef3-9764-02f7cd32e865 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:00.848102 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c1cdaa-a9b1-4ef3-9764-02f7cd32e865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:00.848410 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c1cdaa-a9b1-4ef3-9764-02f7cd32e865 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:00.849104 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c1cdaa-a9b1-4ef3-9764-02f7cd32e865 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:00.851035 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c1cdaa-a9b1-4ef3-9764-02f7cd32e865 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:00.935062 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-324ff549-096a-4caa-ab0b-1e2456ef0f82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a17442805f6f4f72b37352c7746941d3', 'request_id': 'req-324ff549-096a-4caa-ab0b-1e2456ef0f82'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:00.941672 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-324ff549-096a-4caa-ab0b-1e2456ef0f82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a17442805f6f4f72b37352c7746941d3', 'request_id': 'req-324ff549-096a-4caa-ab0b-1e2456ef0f82'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:00.947290 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-324ff549-096a-4caa-ab0b-1e2456ef0f82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a17442805f6f4f72b37352c7746941d3', 'request_id': 'req-324ff549-096a-4caa-ab0b-1e2456ef0f82'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:01.095136 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1005/2025] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:31:00 2022] POST /identity/v3/projects => generated 385 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:31:01.095136 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a7844-78f7-4654-96f3-cdac79c099c6 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:01.095136 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a7844-78f7-4654-96f3-cdac79c099c6 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:01.095136 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a7844-78f7-4654-96f3-cdac79c099c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:01.112014 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-fe0a7844-78f7-4654-96f3-cdac79c099c6 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:31:01.113197 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-fe0a7844-78f7-4654-96f3-cdac79c099c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:01.169427 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-324ff549-096a-4caa-ab0b-1e2456ef0f82 admin admin] The token cache is being invalidate because project a17442805f6f4f72b37352c7746941d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80288) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:31:01.172658 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-324ff549-096a-4caa-ab0b-1e2456ef0f82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:01.172658 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-324ff549-096a-4caa-ab0b-1e2456ef0f82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:01.172885 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1006/2026] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:31:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:31:01.172885 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0a7844-78f7-4654-96f3-cdac79c099c6 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:01.172885 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-fe0a7844-78f7-4654-96f3-cdac79c099c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:01.178526 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1021/2027] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:31:00 2022] DELETE /identity/v3/projects/a17442805f6f4f72b37352c7746941d3 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:31:01.179434 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324ff549-096a-4caa-ab0b-1e2456ef0f82 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:01.180754 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-324ff549-096a-4caa-ab0b-1e2456ef0f82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:01.184852 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0a7844-78f7-4654-96f3-cdac79c099c6 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:01.189589 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccde120-ae79-482a-9fc1-3871b3c852eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:01.190966 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccde120-ae79-482a-9fc1-3871b3c852eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:01.191255 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccde120-ae79-482a-9fc1-3871b3c852eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:01.191531 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccde120-ae79-482a-9fc1-3871b3c852eb admin admin] PATH_INFO: `/v3/projects/a7a89b6b3cd94b958731721c60697afb/users/9849609af4c746f3a33cdad4861e09fd/roles/e04fe3eb1f714d74901ac83e33ea8a16` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:01.193496 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccde120-ae79-482a-9fc1-3871b3c852eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7a89b6b3cd94b958731721c60697afb, user_id=9849609af4c746f3a33cdad4861e09fd, role_id=e04fe3eb1f714d74901ac83e33ea8a16)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:01.196168 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccde120-ae79-482a-9fc1-3871b3c852eb admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:01.207463 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1007/2028] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:31:01 2022] PUT /identity/v3/projects/a7a89b6b3cd94b958731721c60697afb/users/9849609af4c746f3a33cdad4861e09fd/roles/e04fe3eb1f714d74901ac83e33ea8a16 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:31:01.208226 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccde120-ae79-482a-9fc1-3871b3c852eb admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:01.209607 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-4ccde120-ae79-482a-9fc1-3871b3c852eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:01.247653 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324ff549-096a-4caa-ab0b-1e2456ef0f82 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:01.269753 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccde120-ae79-482a-9fc1-3871b3c852eb admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:01.273431 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7607c70b-5d45-4507-9a6e-a1d60f909e8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:01.274080 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7607c70b-5d45-4507-9a6e-a1d60f909e8b service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:01.274395 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7607c70b-5d45-4507-9a6e-a1d60f909e8b service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:01.274677 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7607c70b-5d45-4507-9a6e-a1d60f909e8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:01.276516 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-7607c70b-5d45-4507-9a6e-a1d60f909e8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:01.303984 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5ec50a-d20f-42c2-b31b-72413d3c8f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:01.304940 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5ec50a-d20f-42c2-b31b-72413d3c8f30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:01.305236 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5ec50a-d20f-42c2-b31b-72413d3c8f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:01.305515 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5ec50a-d20f-42c2-b31b-72413d3c8f30 admin admin] PATH_INFO: `/v3/projects/83709d70214048d49061d17ca4486edc/users/fb09b4b02b69435ea53cfb0e5e5fa82a/roles/e04fe3eb1f714d74901ac83e33ea8a16` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:01.320155 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5ec50a-d20f-42c2-b31b-72413d3c8f30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83709d70214048d49061d17ca4486edc, user_id=fb09b4b02b69435ea53cfb0e5e5fa82a, role_id=e04fe3eb1f714d74901ac83e33ea8a16)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:01.322853 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5ec50a-d20f-42c2-b31b-72413d3c8f30 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:01.340412 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7607c70b-5d45-4507-9a6e-a1d60f909e8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:01.341853 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7607c70b-5d45-4507-9a6e-a1d60f909e8b service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:01.352136 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1008/2029] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:31:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:31:01.352924 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7607c70b-5d45-4507-9a6e-a1d60f909e8b service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:01.354216 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-7607c70b-5d45-4507-9a6e-a1d60f909e8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:01.365783 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7607c70b-5d45-4507-9a6e-a1d60f909e8b service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:01.370511 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e1597-7011-495b-820b-797054460e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:01.371173 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e1597-7011-495b-820b-797054460e4c admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:01.371547 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e1597-7011-495b-820b-797054460e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:01.371828 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e1597-7011-495b-820b-797054460e4c admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:01.372562 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9e1597-7011-495b-820b-797054460e4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:01.374517 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9e1597-7011-495b-820b-797054460e4c admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:01.439287 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1022/2030] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:31:01 2022] PUT /identity/v3/projects/83709d70214048d49061d17ca4486edc/users/fb09b4b02b69435ea53cfb0e5e5fa82a/roles/e04fe3eb1f714d74901ac83e33ea8a16 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:31:01.442322 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225a87e-fb6d-40d9-b111-2354f6aaace0 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:01.442322 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225a87e-fb6d-40d9-b111-2354f6aaace0 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:01.442322 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225a87e-fb6d-40d9-b111-2354f6aaace0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:01.469230 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-7225a87e-fb6d-40d9-b111-2354f6aaace0 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:31:01.470566 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-7225a87e-fb6d-40d9-b111-2354f6aaace0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:01.532045 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1023/2031] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:31:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:31:01.533063 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7225a87e-fb6d-40d9-b111-2354f6aaace0 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:01.534936 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-7225a87e-fb6d-40d9-b111-2354f6aaace0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:01.547515 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7225a87e-fb6d-40d9-b111-2354f6aaace0 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:01.553240 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feea1f17-2587-412c-bcfc-d311d3ea9a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:01.554127 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea1f17-2587-412c-bcfc-d311d3ea9a38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:01.554453 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea1f17-2587-412c-bcfc-d311d3ea9a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:01.554742 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea1f17-2587-412c-bcfc-d311d3ea9a38 admin admin] PATH_INFO: `/v3/users/bd1478ceca7749d6b2dbab0eb05f59ae` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:01.556060 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feea1f17-2587-412c-bcfc-d311d3ea9a38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd1478ceca7749d6b2dbab0eb05f59ae)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:01.558008 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feea1f17-2587-412c-bcfc-d311d3ea9a38 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:01.560912 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1009/2032] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:31:01 2022] POST /identity/v3/users => generated 299 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:31:01.561397 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4887564-9b07-46d8-b0b7-6ce4ca03268b None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:01.561751 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4887564-9b07-46d8-b0b7-6ce4ca03268b None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:01.564954 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4887564-9b07-46d8-b0b7-6ce4ca03268b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:01.592995 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:31:01.594982 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-c4887564-9b07-46d8-b0b7-6ce4ca03268b None None] MFA Rules not processed for user `9849609af4c746f3a33cdad4861e09fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:31:01.596367 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-c4887564-9b07-46d8-b0b7-6ce4ca03268b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:01.671000 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1010/2033] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:31:01 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:31:01.671864 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4887564-9b07-46d8-b0b7-6ce4ca03268b None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:01.686412 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4887564-9b07-46d8-b0b7-6ce4ca03268b None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:01.691902 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce66efe-691b-4e53-af16-f954d4911eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:01.692639 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce66efe-691b-4e53-af16-f954d4911eec admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:01.692863 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce66efe-691b-4e53-af16-f954d4911eec admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:01.693146 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce66efe-691b-4e53-af16-f954d4911eec admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:01.693974 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce66efe-691b-4e53-af16-f954d4911eec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:01.695761 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce66efe-691b-4e53-af16-f954d4911eec admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:01.709392 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1011/2034] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:31:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:31:01.709392 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce66efe-691b-4e53-af16-f954d4911eec admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:01.718991 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce66efe-691b-4e53-af16-f954d4911eec admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:01.724346 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9943a07e-f556-439d-9052-daa1eca5f68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:01.725000 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943a07e-f556-439d-9052-daa1eca5f68f admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:01.725289 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943a07e-f556-439d-9052-daa1eca5f68f admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:01.725570 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943a07e-f556-439d-9052-daa1eca5f68f admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:01.726348 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9943a07e-f556-439d-9052-daa1eca5f68f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:31:01.726749 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9943a07e-f556-439d-9052-daa1eca5f68f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:01.728344 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9943a07e-f556-439d-9052-daa1eca5f68f admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:01.740957 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1012/2035] 10.222.0.62 () {58 vars in 1152 bytes} [Fri May 27 16:31:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:31:01.741800 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9943a07e-f556-439d-9052-daa1eca5f68f admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:01.754526 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9943a07e-f556-439d-9052-daa1eca5f68f admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:01.759612 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624c6c05-35a0-4e2b-8e0a-b1c2b727c8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:01.760329 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c6c05-35a0-4e2b-8e0a-b1c2b727c8e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:01.760696 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c6c05-35a0-4e2b-8e0a-b1c2b727c8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:01.760983 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c6c05-35a0-4e2b-8e0a-b1c2b727c8e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:01.761709 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624c6c05-35a0-4e2b-8e0a-b1c2b727c8e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:01.763369 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624c6c05-35a0-4e2b-8e0a-b1c2b727c8e4 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:01.773886 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1013/2036] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:31:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:31:01.774696 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624c6c05-35a0-4e2b-8e0a-b1c2b727c8e4 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:01.776289 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-624c6c05-35a0-4e2b-8e0a-b1c2b727c8e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:01.809872 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-feea1f17-2587-412c-bcfc-d311d3ea9a38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd1478ceca7749d6b2dbab0eb05f59ae'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:01.822055 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-feea1f17-2587-412c-bcfc-d311d3ea9a38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd1478ceca7749d6b2dbab0eb05f59ae'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:01.822878 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-feea1f17-2587-412c-bcfc-d311d3ea9a38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd1478ceca7749d6b2dbab0eb05f59ae'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:01.823525 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-feea1f17-2587-412c-bcfc-d311d3ea9a38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd1478ceca7749d6b2dbab0eb05f59ae'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:01.833425 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624c6c05-35a0-4e2b-8e0a-b1c2b727c8e4 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:01.837417 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258c2965-2834-4bae-aa24-790fd5de0357 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8693a1e72f14fdfb383f11e96330726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:01.838074 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c2965-2834-4bae-aa24-790fd5de0357 service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:01.838397 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c2965-2834-4bae-aa24-790fd5de0357 service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:01.838684 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c2965-2834-4bae-aa24-790fd5de0357 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:01.840488 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-258c2965-2834-4bae-aa24-790fd5de0357 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:01.853278 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258c2965-2834-4bae-aa24-790fd5de0357 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:01.854763 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258c2965-2834-4bae-aa24-790fd5de0357 service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:01.864705 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1014/2037] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:31:01 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:31:01.865486 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258c2965-2834-4bae-aa24-790fd5de0357 service cinder] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:01.866928 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-258c2965-2834-4bae-aa24-790fd5de0357 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:01.879773 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258c2965-2834-4bae-aa24-790fd5de0357 service cinder] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:01.884910 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6418f0-8441-4cb8-9dfa-98d61c134138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:01.885806 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6418f0-8441-4cb8-9dfa-98d61c134138 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:01.886093 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6418f0-8441-4cb8-9dfa-98d61c134138 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:01.886410 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6418f0-8441-4cb8-9dfa-98d61c134138 admin admin] PATH_INFO: `/v3/projects/83709d70214048d49061d17ca4486edc/users/fb09b4b02b69435ea53cfb0e5e5fa82a/roles/e04fe3eb1f714d74901ac83e33ea8a16` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:01.888440 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6418f0-8441-4cb8-9dfa-98d61c134138 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83709d70214048d49061d17ca4486edc, user_id=fb09b4b02b69435ea53cfb0e5e5fa82a, role_id=e04fe3eb1f714d74901ac83e33ea8a16)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:01.891205 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6418f0-8441-4cb8-9dfa-98d61c134138 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:01.901452 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1015/2038] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:31:01 2022] PUT /identity/v3/projects/83709d70214048d49061d17ca4486edc/users/fb09b4b02b69435ea53cfb0e5e5fa82a/roles/e04fe3eb1f714d74901ac83e33ea8a16 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:31:01.902953 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6418f0-8441-4cb8-9dfa-98d61c134138 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:01.904608 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-bd6418f0-8441-4cb8-9dfa-98d61c134138 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:01.959622 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-feea1f17-2587-412c-bcfc-d311d3ea9a38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd1478ceca7749d6b2dbab0eb05f59ae'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:01.974138 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1024/2039] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:31:01 2022] DELETE /identity/v3/users/bd1478ceca7749d6b2dbab0eb05f59ae => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:31:01.977083 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feea1f17-2587-412c-bcfc-d311d3ea9a38 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:01.977083 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-feea1f17-2587-412c-bcfc-d311d3ea9a38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:01.995431 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6418f0-8441-4cb8-9dfa-98d61c134138 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:02.053571 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feea1f17-2587-412c-bcfc-d311d3ea9a38 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:02.057214 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a1d2b-da5d-4e60-87b4-5281cb155df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:02.058020 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a1d2b-da5d-4e60-87b4-5281cb155df9 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:02.058456 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a1d2b-da5d-4e60-87b4-5281cb155df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:02.058839 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a1d2b-da5d-4e60-87b4-5281cb155df9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:02.059197 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8901d105-b2f3-45d1-8814-8b38ad5297a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:02.059756 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1a1d2b-da5d-4e60-87b4-5281cb155df9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:02.060241 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901d105-b2f3-45d1-8814-8b38ad5297a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:02.060544 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901d105-b2f3-45d1-8814-8b38ad5297a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:02.061492 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901d105-b2f3-45d1-8814-8b38ad5297a8 admin admin] PATH_INFO: `/v3/projects/17e9e51a0e4d411cbe243298646d9fb0/users/4e869e57bb0d45b299ec88df801880eb/roles/e04fe3eb1f714d74901ac83e33ea8a16` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:02.062028 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1a1d2b-da5d-4e60-87b4-5281cb155df9 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:02.067253 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:31:02.079314 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8901d105-b2f3-45d1-8814-8b38ad5297a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17e9e51a0e4d411cbe243298646d9fb0, user_id=4e869e57bb0d45b299ec88df801880eb, role_id=e04fe3eb1f714d74901ac83e33ea8a16)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:02.082669 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8901d105-b2f3-45d1-8814-8b38ad5297a8 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:02.441569 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1025/2040] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:31:01 2022] PUT /identity/v3/projects/17e9e51a0e4d411cbe243298646d9fb0/users/4e869e57bb0d45b299ec88df801880eb/roles/e04fe3eb1f714d74901ac83e33ea8a16 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:31:02.445232 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1016/2041] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:31:01 2022] POST /identity/v3/projects => generated 387 bytes in 540 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:31:02.445232 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a1d2b-da5d-4e60-87b4-5281cb155df9 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:02.445796 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4dc05-59eb-42fb-be66-32a4a6ab9844 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:02.445796 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4dc05-59eb-42fb-be66-32a4a6ab9844 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:02.445796 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4dc05-59eb-42fb-be66-32a4a6ab9844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:02.447738 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-ea1a1d2b-da5d-4e60-87b4-5281cb155df9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:02.473435 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-ccc4dc05-59eb-42fb-be66-32a4a6ab9844 None None] MFA Rules not processed for user `fb09b4b02b69435ea53cfb0e5e5fa82a`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:31:02.474780 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-ccc4dc05-59eb-42fb-be66-32a4a6ab9844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:02.539581 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a1d2b-da5d-4e60-87b4-5281cb155df9 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:02.544317 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a707b3-ef1e-4982-b97f-fb640bd03e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:02.545185 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a707b3-ef1e-4982-b97f-fb640bd03e59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:02.545592 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a707b3-ef1e-4982-b97f-fb640bd03e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:02.545902 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a707b3-ef1e-4982-b97f-fb640bd03e59 admin admin] PATH_INFO: `/v3/projects/810dbebd34194bd08305a24f61d9e683` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:02.547182 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a707b3-ef1e-4982-b97f-fb640bd03e59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=810dbebd34194bd08305a24f61d9e683)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:02.549101 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a707b3-ef1e-4982-b97f-fb640bd03e59 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:02.579763 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1026/2042] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:31:02 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:31:02.580505 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc4dc05-59eb-42fb-be66-32a4a6ab9844 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:02.594435 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc4dc05-59eb-42fb-be66-32a4a6ab9844 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:02.599317 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884b43cb-f4c3-4d7f-b8ea-9dc9381e5245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:02.599995 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b43cb-f4c3-4d7f-b8ea-9dc9381e5245 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:02.600283 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b43cb-f4c3-4d7f-b8ea-9dc9381e5245 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:02.600575 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b43cb-f4c3-4d7f-b8ea-9dc9381e5245 admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:02.613740 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884b43cb-f4c3-4d7f-b8ea-9dc9381e5245 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:02.613740 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884b43cb-f4c3-4d7f-b8ea-9dc9381e5245 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:02.614741 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1027/2043] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:31:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:31:02.614816 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884b43cb-f4c3-4d7f-b8ea-9dc9381e5245 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:02.625734 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884b43cb-f4c3-4d7f-b8ea-9dc9381e5245 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:02.631393 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c966eb5e-cc14-494f-b015-99310d536b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:02.632062 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966eb5e-cc14-494f-b015-99310d536b15 admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:02.632351 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966eb5e-cc14-494f-b015-99310d536b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:02.632664 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966eb5e-cc14-494f-b015-99310d536b15 admin admin] PATH_INFO: `/v3/users` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:02.633390 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c966eb5e-cc14-494f-b015-99310d536b15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:02.635365 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c966eb5e-cc14-494f-b015-99310d536b15 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:02.762000 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1028/2044] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:31:02 2022] POST /identity/v3/users => generated 294 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:31:02.762000 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c966eb5e-cc14-494f-b015-99310d536b15 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:02.763310 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-c966eb5e-cc14-494f-b015-99310d536b15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:02.776192 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-50a707b3-ef1e-4982-b97f-fb640bd03e59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '810dbebd34194bd08305a24f61d9e683', 'request_id': 'req-50a707b3-ef1e-4982-b97f-fb640bd03e59'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:02.782788 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-50a707b3-ef1e-4982-b97f-fb640bd03e59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '810dbebd34194bd08305a24f61d9e683', 'request_id': 'req-50a707b3-ef1e-4982-b97f-fb640bd03e59'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:02.838389 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c966eb5e-cc14-494f-b015-99310d536b15 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:02.888590 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff17b5-4a85-41c5-93c2-4485c1a9c0f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8693a1e72f14fdfb383f11e96330726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:02.889237 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff17b5-4a85-41c5-93c2-4485c1a9c0f1 service cinder] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:02.889520 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff17b5-4a85-41c5-93c2-4485c1a9c0f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:02.889796 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff17b5-4a85-41c5-93c2-4485c1a9c0f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:02.923633 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-50a707b3-ef1e-4982-b97f-fb640bd03e59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '810dbebd34194bd08305a24f61d9e683', 'request_id': 'req-50a707b3-ef1e-4982-b97f-fb640bd03e59'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:02.936515 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-50a707b3-ef1e-4982-b97f-fb640bd03e59 admin admin] The token cache is being invalidate because project 810dbebd34194bd08305a24f61d9e683 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:31:02.936811 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-50a707b3-ef1e-4982-b97f-fb640bd03e59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:02.938531 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-50a707b3-ef1e-4982-b97f-fb640bd03e59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:02.945727 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1017/2045] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:31:02 2022] DELETE /identity/v3/projects/810dbebd34194bd08305a24f61d9e683 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:31:02.945727 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a707b3-ef1e-4982-b97f-fb640bd03e59 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:02.945727 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-50a707b3-ef1e-4982-b97f-fb640bd03e59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:02.955658 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ff17b5-4a85-41c5-93c2-4485c1a9c0f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:02.957422 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ff17b5-4a85-41c5-93c2-4485c1a9c0f1 service cinder] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:02.967911 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1029/2046] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:31:02 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:31:02.968738 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff17b5-4a85-41c5-93c2-4485c1a9c0f1 service cinder] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:02.970119 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-15ff17b5-4a85-41c5-93c2-4485c1a9c0f1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:03.015435 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a707b3-ef1e-4982-b97f-fb640bd03e59 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:03.020358 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30db735d-c08e-4cd2-a4fe-0be65cc40863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:03.021302 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30db735d-c08e-4cd2-a4fe-0be65cc40863 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:03.025952 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30db735d-c08e-4cd2-a4fe-0be65cc40863 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:03.025952 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30db735d-c08e-4cd2-a4fe-0be65cc40863 admin admin] PATH_INFO: `/v3/projects/17e9e51a0e4d411cbe243298646d9fb0/users/4e869e57bb0d45b299ec88df801880eb/roles/e04fe3eb1f714d74901ac83e33ea8a16` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:03.025952 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30db735d-c08e-4cd2-a4fe-0be65cc40863 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17e9e51a0e4d411cbe243298646d9fb0, user_id=4e869e57bb0d45b299ec88df801880eb, role_id=e04fe3eb1f714d74901ac83e33ea8a16)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:03.026685 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30db735d-c08e-4cd2-a4fe-0be65cc40863 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:03.040889 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff17b5-4a85-41c5-93c2-4485c1a9c0f1 service cinder] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:03.042345 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1018/2047] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:31:02 2022] PUT /identity/v3/projects/17e9e51a0e4d411cbe243298646d9fb0/users/4e869e57bb0d45b299ec88df801880eb/roles/e04fe3eb1f714d74901ac83e33ea8a16 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:31:03.043603 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30db735d-c08e-4cd2-a4fe-0be65cc40863 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:03.051099 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-30db735d-c08e-4cd2-a4fe-0be65cc40863 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:03.110239 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91bdaa9-71c7-4cbe-9e8f-39792040c7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:03.111293 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91bdaa9-71c7-4cbe-9e8f-39792040c7bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:03.111586 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91bdaa9-71c7-4cbe-9e8f-39792040c7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:03.111914 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91bdaa9-71c7-4cbe-9e8f-39792040c7bf admin admin] PATH_INFO: `/v3/projects/58dab7f5a3b443259dac5fe54099d4ce` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:03.113682 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91bdaa9-71c7-4cbe-9e8f-39792040c7bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=58dab7f5a3b443259dac5fe54099d4ce)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:03.115683 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91bdaa9-71c7-4cbe-9e8f-39792040c7bf admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:03.130730 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30db735d-c08e-4cd2-a4fe-0be65cc40863 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:03.139143 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdb33b1-cf32-4277-bdb5-d5978dea74c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:03.139981 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb33b1-cf32-4277-bdb5-d5978dea74c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:03.140274 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb33b1-cf32-4277-bdb5-d5978dea74c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:03.140570 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb33b1-cf32-4277-bdb5-d5978dea74c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:03.141297 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdb33b1-cf32-4277-bdb5-d5978dea74c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:03.142953 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdb33b1-cf32-4277-bdb5-d5978dea74c5 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:03.153851 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1019/2048] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:31:03 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:31:03.154740 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdb33b1-cf32-4277-bdb5-d5978dea74c5 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:03.156489 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-bfdb33b1-cf32-4277-bdb5-d5978dea74c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:03.169657 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdb33b1-cf32-4277-bdb5-d5978dea74c5 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:03.174457 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9338e40-9432-460a-9439-bb0c5615127d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:03.175930 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9338e40-9432-460a-9439-bb0c5615127d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:03.176216 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9338e40-9432-460a-9439-bb0c5615127d admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:03.176494 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9338e40-9432-460a-9439-bb0c5615127d admin admin] PATH_INFO: `/v3/users/e52bb6f4a00149dc98fcf7dd0b450da4` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:03.177687 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9338e40-9432-460a-9439-bb0c5615127d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e52bb6f4a00149dc98fcf7dd0b450da4)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:03.179711 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9338e40-9432-460a-9439-bb0c5615127d admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:03.521649 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b9338e40-9432-460a-9439-bb0c5615127d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e52bb6f4a00149dc98fcf7dd0b450da4'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:03.522344 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-a91bdaa9-71c7-4cbe-9e8f-39792040c7bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58dab7f5a3b443259dac5fe54099d4ce', 'request_id': 'req-a91bdaa9-71c7-4cbe-9e8f-39792040c7bf'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:03.528144 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-a91bdaa9-71c7-4cbe-9e8f-39792040c7bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58dab7f5a3b443259dac5fe54099d4ce', 'request_id': 'req-a91bdaa9-71c7-4cbe-9e8f-39792040c7bf'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:03.528515 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b9338e40-9432-460a-9439-bb0c5615127d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e52bb6f4a00149dc98fcf7dd0b450da4'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:03.529187 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b9338e40-9432-460a-9439-bb0c5615127d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e52bb6f4a00149dc98fcf7dd0b450da4'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:03.529808 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b9338e40-9432-460a-9439-bb0c5615127d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e52bb6f4a00149dc98fcf7dd0b450da4'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:03.533794 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-a91bdaa9-71c7-4cbe-9e8f-39792040c7bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58dab7f5a3b443259dac5fe54099d4ce', 'request_id': 'req-a91bdaa9-71c7-4cbe-9e8f-39792040c7bf'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:03.689515 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b9338e40-9432-460a-9439-bb0c5615127d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e52bb6f4a00149dc98fcf7dd0b450da4'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:03.709102 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1020/2049] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:31:03 2022] DELETE /identity/v3/users/e52bb6f4a00149dc98fcf7dd0b450da4 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:31:03.710617 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3016ec46-cc2e-4e4c-8022-d12eb09c3497 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:03.710909 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3016ec46-cc2e-4e4c-8022-d12eb09c3497 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:03.711187 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3016ec46-cc2e-4e4c-8022-d12eb09c3497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:03.739136 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-3016ec46-cc2e-4e4c-8022-d12eb09c3497 None None] MFA Rules not processed for user `4e869e57bb0d45b299ec88df801880eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:31:03.740361 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-3016ec46-cc2e-4e4c-8022-d12eb09c3497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:03.763036 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-a91bdaa9-71c7-4cbe-9e8f-39792040c7bf admin admin] The token cache is being invalidate because project 58dab7f5a3b443259dac5fe54099d4ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80288) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:31:03.763337 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-a91bdaa9-71c7-4cbe-9e8f-39792040c7bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:03.764010 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-a91bdaa9-71c7-4cbe-9e8f-39792040c7bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:03.765597 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1030/2050] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:31:02 2022] DELETE /identity/v3/projects/58dab7f5a3b443259dac5fe54099d4ce => generated 0 bytes in 797 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:31:03.766401 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91bdaa9-71c7-4cbe-9e8f-39792040c7bf admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:03.767757 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-a91bdaa9-71c7-4cbe-9e8f-39792040c7bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:03.781304 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:31:03.817142 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1021/2051] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:31:03 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:31:03.821336 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3016ec46-cc2e-4e4c-8022-d12eb09c3497 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:03.821336 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-3016ec46-cc2e-4e4c-8022-d12eb09c3497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:03.852840 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91bdaa9-71c7-4cbe-9e8f-39792040c7bf admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:03.890691 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3016ec46-cc2e-4e4c-8022-d12eb09c3497 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:03.896622 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97652d59-bdcd-4850-80b4-4a05a6e96bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:03.897727 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97652d59-bdcd-4850-80b4-4a05a6e96bba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:03.898111 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97652d59-bdcd-4850-80b4-4a05a6e96bba admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:03.898534 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97652d59-bdcd-4850-80b4-4a05a6e96bba admin admin] PATH_INFO: `/v3/users/670e135cf2fc4ca39b8076cc010fe30c` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:03.899869 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97652d59-bdcd-4850-80b4-4a05a6e96bba admin admin] RBAC: Authorizing `identity:delete_user(user_id=670e135cf2fc4ca39b8076cc010fe30c)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:03.901943 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97652d59-bdcd-4850-80b4-4a05a6e96bba admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:03.919386 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9609b1-10d3-4525-a446-b1a72f2a3841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:03.920055 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9609b1-10d3-4525-a446-b1a72f2a3841 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:03.920349 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9609b1-10d3-4525-a446-b1a72f2a3841 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:03.921236 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9609b1-10d3-4525-a446-b1a72f2a3841 admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:03.922163 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9609b1-10d3-4525-a446-b1a72f2a3841 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:03.925055 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9609b1-10d3-4525-a446-b1a72f2a3841 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:03.935951 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1031/2052] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:31:03 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:31:03.936839 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9609b1-10d3-4525-a446-b1a72f2a3841 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:03.938606 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-7c9609b1-10d3-4525-a446-b1a72f2a3841 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:04.012582 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9609b1-10d3-4525-a446-b1a72f2a3841 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:04.021340 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6021f74-d8ae-4295-a459-0a3decc309ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8693a1e72f14fdfb383f11e96330726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:04.022058 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6021f74-d8ae-4295-a459-0a3decc309ee service cinder] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:04.022440 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6021f74-d8ae-4295-a459-0a3decc309ee service cinder] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:04.022815 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6021f74-d8ae-4295-a459-0a3decc309ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:04.024717 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-c6021f74-d8ae-4295-a459-0a3decc309ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:04.084204 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6021f74-d8ae-4295-a459-0a3decc309ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:04.085663 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6021f74-d8ae-4295-a459-0a3decc309ee service cinder] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:04.095013 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1032/2053] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:31:03 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:31:04.096137 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beab26df-2481-4359-9abc-2f79017cee06 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:04.096539 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beab26df-2481-4359-9abc-2f79017cee06 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:04.097363 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beab26df-2481-4359-9abc-2f79017cee06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:04.114846 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-beab26df-2481-4359-9abc-2f79017cee06 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:31:04.116176 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-beab26df-2481-4359-9abc-2f79017cee06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:04.124781 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1033/2054] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:31:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:31:04.125580 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beab26df-2481-4359-9abc-2f79017cee06 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:04.127343 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-beab26df-2481-4359-9abc-2f79017cee06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:04.134105 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-97652d59-bdcd-4850-80b4-4a05a6e96bba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '670e135cf2fc4ca39b8076cc010fe30c'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:04.140176 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beab26df-2481-4359-9abc-2f79017cee06 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:04.142676 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-97652d59-bdcd-4850-80b4-4a05a6e96bba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '670e135cf2fc4ca39b8076cc010fe30c'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:04.143611 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-97652d59-bdcd-4850-80b4-4a05a6e96bba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '670e135cf2fc4ca39b8076cc010fe30c'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:04.144533 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a861dedb-adf8-429c-aaf0-2e39a945bec3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8693a1e72f14fdfb383f11e96330726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:04.144891 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-97652d59-bdcd-4850-80b4-4a05a6e96bba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '670e135cf2fc4ca39b8076cc010fe30c'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:04.145175 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a861dedb-adf8-429c-aaf0-2e39a945bec3 service cinder] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:04.145463 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a861dedb-adf8-429c-aaf0-2e39a945bec3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:04.145755 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a861dedb-adf8-429c-aaf0-2e39a945bec3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:04.147588 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-a861dedb-adf8-429c-aaf0-2e39a945bec3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:04.206891 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a861dedb-adf8-429c-aaf0-2e39a945bec3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:04.208443 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a861dedb-adf8-429c-aaf0-2e39a945bec3 service cinder] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:04.218078 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1034/2055] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:31:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:31:04.218905 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a861dedb-adf8-429c-aaf0-2e39a945bec3 service cinder] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:04.224695 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-a861dedb-adf8-429c-aaf0-2e39a945bec3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:04.234867 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a861dedb-adf8-429c-aaf0-2e39a945bec3 service cinder] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:04.240718 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ea704-b96e-4eea-92f5-f04f69955ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:04.241646 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ea704-b96e-4eea-92f5-f04f69955ad6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:04.241930 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ea704-b96e-4eea-92f5-f04f69955ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:04.242212 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ea704-b96e-4eea-92f5-f04f69955ad6 admin admin] PATH_INFO: `/v3/projects/bd3b2626feb248e0849e7f9ca68a4f4d/users/9eb9fb33e55a4b80b04c6462403195c0/roles/c8ce6d197f654598ac45f6016ecccabd` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:04.259582 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04ea704-b96e-4eea-92f5-f04f69955ad6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd3b2626feb248e0849e7f9ca68a4f4d, user_id=9eb9fb33e55a4b80b04c6462403195c0, role_id=c8ce6d197f654598ac45f6016ecccabd)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:04.261315 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04ea704-b96e-4eea-92f5-f04f69955ad6 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:04.285573 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-97652d59-bdcd-4850-80b4-4a05a6e96bba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '670e135cf2fc4ca39b8076cc010fe30c'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:04.304950 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1022/2056] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:31:03 2022] DELETE /identity/v3/users/670e135cf2fc4ca39b8076cc010fe30c => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:31:04.306268 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fab6c1-08e2-4ab0-b433-176c14b1e2fc None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:04.306570 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fab6c1-08e2-4ab0-b433-176c14b1e2fc None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:04.306849 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fab6c1-08e2-4ab0-b433-176c14b1e2fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:04.326640 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-b3fab6c1-08e2-4ab0-b433-176c14b1e2fc None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:31:04.327846 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-b3fab6c1-08e2-4ab0-b433-176c14b1e2fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:04.391599 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1023/2057] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:31:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:31:04.392608 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fab6c1-08e2-4ab0-b433-176c14b1e2fc None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:04.394471 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-b3fab6c1-08e2-4ab0-b433-176c14b1e2fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:04.406575 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fab6c1-08e2-4ab0-b433-176c14b1e2fc None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:04.412072 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0466f5-ef46-4416-b7fe-6e4008c21558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:04.412948 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0466f5-ef46-4416-b7fe-6e4008c21558 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:04.413231 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0466f5-ef46-4416-b7fe-6e4008c21558 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:04.413535 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0466f5-ef46-4416-b7fe-6e4008c21558 admin admin] PATH_INFO: `/v3/projects/1ad328f5dd5744c6a668254edcff3889` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:04.415037 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0466f5-ef46-4416-b7fe-6e4008c21558 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ad328f5dd5744c6a668254edcff3889)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:04.416943 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0466f5-ef46-4416-b7fe-6e4008c21558 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:04.446085 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1035/2058] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:31:04 2022] PUT /identity/v3/projects/bd3b2626feb248e0849e7f9ca68a4f4d/users/9eb9fb33e55a4b80b04c6462403195c0/roles/c8ce6d197f654598ac45f6016ecccabd => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:31:04.447516 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e299a4-b8b0-4e5e-9599-f3a4eaeb62e0 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:04.447803 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e299a4-b8b0-4e5e-9599-f3a4eaeb62e0 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:04.449506 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e299a4-b8b0-4e5e-9599-f3a4eaeb62e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:04.465740 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-17e299a4-b8b0-4e5e-9599-f3a4eaeb62e0 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:31:04.466898 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-17e299a4-b8b0-4e5e-9599-f3a4eaeb62e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:04.527372 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1036/2059] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:31:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:31:04.528227 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e299a4-b8b0-4e5e-9599-f3a4eaeb62e0 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:04.537331 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e299a4-b8b0-4e5e-9599-f3a4eaeb62e0 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:04.542167 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ef65b5-139e-4f7e-a268-46a529428366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:04.542846 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef65b5-139e-4f7e-a268-46a529428366 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:04.543136 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef65b5-139e-4f7e-a268-46a529428366 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:04.543434 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef65b5-139e-4f7e-a268-46a529428366 admin admin] PATH_INFO: `/v3/domains` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:04.544151 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ef65b5-139e-4f7e-a268-46a529428366 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:31:04.544464 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ef65b5-139e-4f7e-a268-46a529428366 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:04.546077 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ef65b5-139e-4f7e-a268-46a529428366 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:04.558757 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1037/2060] 10.222.0.62 () {58 vars in 1152 bytes} [Fri May 27 16:31:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:31:04.559977 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994b60b-2035-43f5-b9d4-b1bc20772ffb None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:04.560267 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994b60b-2035-43f5-b9d4-b1bc20772ffb None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:04.560552 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994b60b-2035-43f5-b9d4-b1bc20772ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:04.579117 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-f994b60b-2035-43f5-b9d4-b1bc20772ffb None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:31:04.580445 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-f994b60b-2035-43f5-b9d4-b1bc20772ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:04.587888 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1038/2061] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:31:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:31:04.588638 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f994b60b-2035-43f5-b9d4-b1bc20772ffb None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:04.589811 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-f994b60b-2035-43f5-b9d4-b1bc20772ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:04.646212 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f994b60b-2035-43f5-b9d4-b1bc20772ffb None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:04.654122 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-0f0466f5-ef46-4416-b7fe-6e4008c21558 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ad328f5dd5744c6a668254edcff3889', 'request_id': 'req-0f0466f5-ef46-4416-b7fe-6e4008c21558'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:04.661059 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-0f0466f5-ef46-4416-b7fe-6e4008c21558 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ad328f5dd5744c6a668254edcff3889', 'request_id': 'req-0f0466f5-ef46-4416-b7fe-6e4008c21558'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:04.698701 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c297b930-cc6e-4e45-809d-9bf5f8bac250 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:04.699397 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c297b930-cc6e-4e45-809d-9bf5f8bac250 service neutron] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:04.699682 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c297b930-cc6e-4e45-809d-9bf5f8bac250 service neutron] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:04.699959 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c297b930-cc6e-4e45-809d-9bf5f8bac250 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:04.759460 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c297b930-cc6e-4e45-809d-9bf5f8bac250 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:04.760817 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c297b930-cc6e-4e45-809d-9bf5f8bac250 service neutron] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:04.771061 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1039/2062] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:31:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:31:04.772019 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c297b930-cc6e-4e45-809d-9bf5f8bac250 service neutron] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:04.780936 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-0f0466f5-ef46-4416-b7fe-6e4008c21558 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ad328f5dd5744c6a668254edcff3889', 'request_id': 'req-0f0466f5-ef46-4416-b7fe-6e4008c21558'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:04.781311 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c297b930-cc6e-4e45-809d-9bf5f8bac250 service neutron] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:04.786936 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7507d607-4a27-419f-9fc2-46d7b36a45f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:04.787597 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7507d607-4a27-419f-9fc2-46d7b36a45f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:04.787882 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7507d607-4a27-419f-9fc2-46d7b36a45f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:04.788184 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7507d607-4a27-419f-9fc2-46d7b36a45f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:04.788856 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7507d607-4a27-419f-9fc2-46d7b36a45f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:04.791214 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7507d607-4a27-419f-9fc2-46d7b36a45f4 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:04.800774 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-0f0466f5-ef46-4416-b7fe-6e4008c21558 admin admin] The token cache is being invalidate because project 1ad328f5dd5744c6a668254edcff3889 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:31:04.801321 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-0f0466f5-ef46-4416-b7fe-6e4008c21558 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:04.803021 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-0f0466f5-ef46-4416-b7fe-6e4008c21558 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:04.810532 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1024/2063] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:31:04 2022] DELETE /identity/v3/projects/1ad328f5dd5744c6a668254edcff3889 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:31:04.810532 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0466f5-ef46-4416-b7fe-6e4008c21558 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:04.810896 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-0f0466f5-ef46-4416-b7fe-6e4008c21558 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:04.824678 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0466f5-ef46-4416-b7fe-6e4008c21558 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:04.828567 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef2e384-9cad-463b-95ef-44a37079db90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:04.829213 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2e384-9cad-463b-95ef-44a37079db90 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:04.829631 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2e384-9cad-463b-95ef-44a37079db90 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:04.829846 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2e384-9cad-463b-95ef-44a37079db90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:04.832332 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-4ef2e384-9cad-463b-95ef-44a37079db90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:04.854345 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef2e384-9cad-463b-95ef-44a37079db90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:04.856047 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef2e384-9cad-463b-95ef-44a37079db90 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:04.866286 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1025/2064] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:31:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:31:04.867896 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4932fa-a575-43bd-85ac-be902790b1e0 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:04.868131 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4932fa-a575-43bd-85ac-be902790b1e0 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:04.868412 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4932fa-a575-43bd-85ac-be902790b1e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:04.887629 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-8d4932fa-a575-43bd-85ac-be902790b1e0 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:31:04.888843 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-8d4932fa-a575-43bd-85ac-be902790b1e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:04.897953 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1026/2065] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:31:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:31:04.905585 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374bc074-a220-43ee-b99a-8097fc0bf731 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:04.905900 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374bc074-a220-43ee-b99a-8097fc0bf731 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:04.906201 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374bc074-a220-43ee-b99a-8097fc0bf731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:04.923829 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-374bc074-a220-43ee-b99a-8097fc0bf731 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:31:04.926292 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1040/2066] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:31:04 2022] POST /identity/v3/projects => generated 387 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:31:04.926775 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-374bc074-a220-43ee-b99a-8097fc0bf731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:04.928960 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7507d607-4a27-419f-9fc2-46d7b36a45f4 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:04.930699 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-7507d607-4a27-419f-9fc2-46d7b36a45f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:04.988697 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1027/2067] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:31:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:31:05.003968 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374bc074-a220-43ee-b99a-8097fc0bf731 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:05.004861 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7507d607-4a27-419f-9fc2-46d7b36a45f4 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:05.012261 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf99050-f6fe-4a3b-aba4-254d7b766547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:05.012428 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374bc074-a220-43ee-b99a-8097fc0bf731 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:05.012870 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf99050-f6fe-4a3b-aba4-254d7b766547 admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:05.013158 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf99050-f6fe-4a3b-aba4-254d7b766547 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:05.013437 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf99050-f6fe-4a3b-aba4-254d7b766547 admin admin] PATH_INFO: `/v3/users` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:05.014264 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf99050-f6fe-4a3b-aba4-254d7b766547 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:05.016220 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf99050-f6fe-4a3b-aba4-254d7b766547 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:05.018992 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f982f54-f7d4-4fca-b312-519ee5634b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:05.019979 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f982f54-f7d4-4fca-b312-519ee5634b83 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:05.020471 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f982f54-f7d4-4fca-b312-519ee5634b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:05.021168 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f982f54-f7d4-4fca-b312-519ee5634b83 admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:05.022395 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f982f54-f7d4-4fca-b312-519ee5634b83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:31:05.022828 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f982f54-f7d4-4fca-b312-519ee5634b83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:05.025630 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f982f54-f7d4-4fca-b312-519ee5634b83 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:05.043602 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1028/2068] 10.222.0.62 () {58 vars in 1152 bytes} [Fri May 27 16:31:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:31:05.044665 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f982f54-f7d4-4fca-b312-519ee5634b83 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:05.056452 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f982f54-f7d4-4fca-b312-519ee5634b83 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:05.061980 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1913d6d-095d-4cbf-9157-c9c26f0468d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:05.062802 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1913d6d-095d-4cbf-9157-c9c26f0468d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:05.063210 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1913d6d-095d-4cbf-9157-c9c26f0468d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:05.063647 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1913d6d-095d-4cbf-9157-c9c26f0468d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:05.076029 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1913d6d-095d-4cbf-9157-c9c26f0468d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:05.078275 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1913d6d-095d-4cbf-9157-c9c26f0468d0 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:05.153964 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1041/2069] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:31:04 2022] POST /identity/v3/users => generated 294 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:31:05.157678 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf99050-f6fe-4a3b-aba4-254d7b766547 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:05.181329 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf99050-f6fe-4a3b-aba4-254d7b766547 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:05.186790 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753a7b11-5728-4e30-bfde-5fd3879a80fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:05.187681 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a7b11-5728-4e30-bfde-5fd3879a80fe admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:05.188100 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a7b11-5728-4e30-bfde-5fd3879a80fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:05.188507 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a7b11-5728-4e30-bfde-5fd3879a80fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:05.189608 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753a7b11-5728-4e30-bfde-5fd3879a80fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:05.192031 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753a7b11-5728-4e30-bfde-5fd3879a80fe admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:05.205469 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1042/2070] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:31:05 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:31:05.210530 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753a7b11-5728-4e30-bfde-5fd3879a80fe admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:05.223221 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753a7b11-5728-4e30-bfde-5fd3879a80fe admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:05.230381 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8bf0fe-e13a-4188-b602-52411799a1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:05.231312 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8bf0fe-e13a-4188-b602-52411799a1dd admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:05.231819 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8bf0fe-e13a-4188-b602-52411799a1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:05.232196 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8bf0fe-e13a-4188-b602-52411799a1dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:05.233122 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8bf0fe-e13a-4188-b602-52411799a1dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:05.242140 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8bf0fe-e13a-4188-b602-52411799a1dd admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:05.247447 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1043/2071] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:31:05 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 16:31:05.251318 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8bf0fe-e13a-4188-b602-52411799a1dd admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:05.264401 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8bf0fe-e13a-4188-b602-52411799a1dd admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:05.272920 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8604aac-38ca-4988-a913-cd7628b85dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:05.273812 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8604aac-38ca-4988-a913-cd7628b85dfd admin admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:05.274095 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8604aac-38ca-4988-a913-cd7628b85dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:05.274405 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8604aac-38ca-4988-a913-cd7628b85dfd admin admin] PATH_INFO: `/v3/projects/840a863c347b40efbb1b861e03d97a55/users/3467afbebc424284a603901c2a15591a/roles/c8ce6d197f654598ac45f6016ecccabd` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:05.280512 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1029/2072] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:31:05 2022] POST /identity/v3/projects => generated 365 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:31:05.284935 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1913d6d-095d-4cbf-9157-c9c26f0468d0 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:05.291537 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8604aac-38ca-4988-a913-cd7628b85dfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=840a863c347b40efbb1b861e03d97a55, user_id=3467afbebc424284a603901c2a15591a, role_id=c8ce6d197f654598ac45f6016ecccabd)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:05.294492 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8604aac-38ca-4988-a913-cd7628b85dfd admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:05.356444 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1913d6d-095d-4cbf-9157-c9c26f0468d0 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:05.361625 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225f5abc-e437-46ff-a59e-5c223a3c8b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:05.362935 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f5abc-e437-46ff-a59e-5c223a3c8b0e admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:05.363164 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f5abc-e437-46ff-a59e-5c223a3c8b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:05.363449 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f5abc-e437-46ff-a59e-5c223a3c8b0e admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:05.364144 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225f5abc-e437-46ff-a59e-5c223a3c8b0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:05.366147 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225f5abc-e437-46ff-a59e-5c223a3c8b0e admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:05.408630 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:31:05.423912 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1044/2073] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:31:05 2022] PUT /identity/v3/projects/840a863c347b40efbb1b861e03d97a55/users/3467afbebc424284a603901c2a15591a/roles/c8ce6d197f654598ac45f6016ecccabd => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:31:05.436709 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8604aac-38ca-4988-a913-cd7628b85dfd admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:05.441566 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-e8604aac-38ca-4988-a913-cd7628b85dfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:05.511353 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8604aac-38ca-4988-a913-cd7628b85dfd admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:05.516067 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b47f59-0860-4da6-afef-2d6720fad2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:05.516924 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b47f59-0860-4da6-afef-2d6720fad2b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:05.517215 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b47f59-0860-4da6-afef-2d6720fad2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:05.517494 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b47f59-0860-4da6-afef-2d6720fad2b9 admin admin] PATH_INFO: `/v3/projects/3ee2cd9ac00d4f099c8c67b02e914a96` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:05.518743 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b47f59-0860-4da6-afef-2d6720fad2b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ee2cd9ac00d4f099c8c67b02e914a96)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:05.520653 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b47f59-0860-4da6-afef-2d6720fad2b9 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:05.557411 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1030/2074] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:31:05 2022] POST /identity/v3/users => generated 283 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:31:05.558740 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6dc33e-5b7c-4647-bf2e-2b6f9faca1e8 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:05.559039 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6dc33e-5b7c-4647-bf2e-2b6f9faca1e8 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:05.559322 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6dc33e-5b7c-4647-bf2e-2b6f9faca1e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:05.586780 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-6b6dc33e-5b7c-4647-bf2e-2b6f9faca1e8 None None] MFA Rules not processed for user `3467afbebc424284a603901c2a15591a`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:31:05.589844 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-6b6dc33e-5b7c-4647-bf2e-2b6f9faca1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:05.630884 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-37b47f59-0860-4da6-afef-2d6720fad2b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ee2cd9ac00d4f099c8c67b02e914a96', 'request_id': 'req-37b47f59-0860-4da6-afef-2d6720fad2b9'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:05.637571 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-37b47f59-0860-4da6-afef-2d6720fad2b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ee2cd9ac00d4f099c8c67b02e914a96', 'request_id': 'req-37b47f59-0860-4da6-afef-2d6720fad2b9'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:05.644234 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-37b47f59-0860-4da6-afef-2d6720fad2b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ee2cd9ac00d4f099c8c67b02e914a96', 'request_id': 'req-37b47f59-0860-4da6-afef-2d6720fad2b9'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:05.663807 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1031/2075] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:31:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:31:05.667635 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6dc33e-5b7c-4647-bf2e-2b6f9faca1e8 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:05.675119 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6dc33e-5b7c-4647-bf2e-2b6f9faca1e8 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:05.737988 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dec479e-bd6c-4569-9ec0-2d8ec79498fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:05.738782 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec479e-bd6c-4569-9ec0-2d8ec79498fb admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:05.739189 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec479e-bd6c-4569-9ec0-2d8ec79498fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:05.741615 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec479e-bd6c-4569-9ec0-2d8ec79498fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:05.742427 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dec479e-bd6c-4569-9ec0-2d8ec79498fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:05.744070 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dec479e-bd6c-4569-9ec0-2d8ec79498fb admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:05.746324 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-37b47f59-0860-4da6-afef-2d6720fad2b9 admin admin] The token cache is being invalidate because project 3ee2cd9ac00d4f099c8c67b02e914a96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80288) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:31:05.746620 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-37b47f59-0860-4da6-afef-2d6720fad2b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:05.747303 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-37b47f59-0860-4da6-afef-2d6720fad2b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:05.748895 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1045/2076] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:31:05 2022] DELETE /identity/v3/projects/3ee2cd9ac00d4f099c8c67b02e914a96 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:31:05.749637 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b47f59-0860-4da6-afef-2d6720fad2b9 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:05.751233 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-37b47f59-0860-4da6-afef-2d6720fad2b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:05.757354 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1032/2077] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:31:05 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:31:05.758150 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dec479e-bd6c-4569-9ec0-2d8ec79498fb admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:05.762021 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-7dec479e-bd6c-4569-9ec0-2d8ec79498fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:05.764423 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b47f59-0860-4da6-afef-2d6720fad2b9 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:05.769339 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd329a0-c9e9-4628-a5cb-465b91566e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:05.769937 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd329a0-c9e9-4628-a5cb-465b91566e10 admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:05.770224 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd329a0-c9e9-4628-a5cb-465b91566e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:05.770533 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd329a0-c9e9-4628-a5cb-465b91566e10 admin admin] PATH_INFO: `/v3/projects` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:05.771259 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd329a0-c9e9-4628-a5cb-465b91566e10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:05.773167 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd329a0-c9e9-4628-a5cb-465b91566e10 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:05.774461 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dec479e-bd6c-4569-9ec0-2d8ec79498fb admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:05.779525 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ed21f0-0657-4941-90d5-d63f80b1975e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:05.780419 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ed21f0-0657-4941-90d5-d63f80b1975e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:05.780712 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ed21f0-0657-4941-90d5-d63f80b1975e admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:05.781002 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ed21f0-0657-4941-90d5-d63f80b1975e admin admin] PATH_INFO: `/v3/users/9849609af4c746f3a33cdad4861e09fd` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:05.782274 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ed21f0-0657-4941-90d5-d63f80b1975e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9849609af4c746f3a33cdad4861e09fd)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:05.784254 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ed21f0-0657-4941-90d5-d63f80b1975e admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:05.931400 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:31:05.938689 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1046/2078] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:31:05 2022] POST /identity/v3/projects => generated 385 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:31:05.939702 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd329a0-c9e9-4628-a5cb-465b91566e10 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:05.941946 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-bcd329a0-c9e9-4628-a5cb-465b91566e10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:06.005155 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd329a0-c9e9-4628-a5cb-465b91566e10 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:06.010112 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5369dc-be7f-4888-a6d4-65f9c6857fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:06.010820 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5369dc-be7f-4888-a6d4-65f9c6857fbf admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:06.011108 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5369dc-be7f-4888-a6d4-65f9c6857fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:06.011384 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5369dc-be7f-4888-a6d4-65f9c6857fbf admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:06.012115 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5369dc-be7f-4888-a6d4-65f9c6857fbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:06.013706 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5369dc-be7f-4888-a6d4-65f9c6857fbf admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:06.023934 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1047/2079] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:31:05 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:31:06.024777 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5369dc-be7f-4888-a6d4-65f9c6857fbf admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:06.035055 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5369dc-be7f-4888-a6d4-65f9c6857fbf admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:06.039709 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cfab3c-c091-48df-8f67-4b288c8f5932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:06.040329 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cfab3c-c091-48df-8f67-4b288c8f5932 admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:06.040647 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cfab3c-c091-48df-8f67-4b288c8f5932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:06.040928 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cfab3c-c091-48df-8f67-4b288c8f5932 admin admin] PATH_INFO: `/v3/users` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:06.041598 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cfab3c-c091-48df-8f67-4b288c8f5932 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:06.043526 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cfab3c-c091-48df-8f67-4b288c8f5932 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:06.115774 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b2ed21f0-0657-4941-90d5-d63f80b1975e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9849609af4c746f3a33cdad4861e09fd'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:06.122921 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b2ed21f0-0657-4941-90d5-d63f80b1975e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9849609af4c746f3a33cdad4861e09fd'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:06.123667 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b2ed21f0-0657-4941-90d5-d63f80b1975e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9849609af4c746f3a33cdad4861e09fd'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:06.124287 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b2ed21f0-0657-4941-90d5-d63f80b1975e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9849609af4c746f3a33cdad4861e09fd'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:06.150076 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1048/2080] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:31:06 2022] POST /identity/v3/users => generated 293 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:31:06.150076 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cfab3c-c091-48df-8f67-4b288c8f5932 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:06.153258 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-39cfab3c-c091-48df-8f67-4b288c8f5932 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:06.163698 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cfab3c-c091-48df-8f67-4b288c8f5932 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:06.169295 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d4183b-7177-48be-b7f7-2096a374ff84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:06.170272 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d4183b-7177-48be-b7f7-2096a374ff84 admin admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:06.170514 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d4183b-7177-48be-b7f7-2096a374ff84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:06.170804 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d4183b-7177-48be-b7f7-2096a374ff84 admin admin] PATH_INFO: `/v3/projects/03608fb3b9b7484ba619c81359bf242e/users/230741a8d94a45f4b2480a07417ae731/roles/c8ce6d197f654598ac45f6016ecccabd` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:06.187046 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d4183b-7177-48be-b7f7-2096a374ff84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03608fb3b9b7484ba619c81359bf242e, user_id=230741a8d94a45f4b2480a07417ae731, role_id=c8ce6d197f654598ac45f6016ecccabd)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:06.189956 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d4183b-7177-48be-b7f7-2096a374ff84 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:06.236427 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b2ed21f0-0657-4941-90d5-d63f80b1975e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9849609af4c746f3a33cdad4861e09fd'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:06.254853 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1033/2081] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:31:05 2022] DELETE /identity/v3/users/9849609af4c746f3a33cdad4861e09fd => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:31:06.258432 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ed21f0-0657-4941-90d5-d63f80b1975e admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:06.258432 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-b2ed21f0-0657-4941-90d5-d63f80b1975e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:06.272893 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1049/2082] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:31:06 2022] PUT /identity/v3/projects/03608fb3b9b7484ba619c81359bf242e/users/230741a8d94a45f4b2480a07417ae731/roles/c8ce6d197f654598ac45f6016ecccabd => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:31:06.294736 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e55dfb-3e2d-4d01-acc4-d49265f87d7e None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:06.295273 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e55dfb-3e2d-4d01-acc4-d49265f87d7e None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:06.295797 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e55dfb-3e2d-4d01-acc4-d49265f87d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:06.332860 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-62e55dfb-3e2d-4d01-acc4-d49265f87d7e None None] MFA Rules not processed for user `230741a8d94a45f4b2480a07417ae731`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:31:06.334197 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-62e55dfb-3e2d-4d01-acc4-d49265f87d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:06.350808 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ed21f0-0657-4941-90d5-d63f80b1975e admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:06.406940 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1050/2083] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:31:06 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:31:06.412042 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e55dfb-3e2d-4d01-acc4-d49265f87d7e None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:06.421470 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fbbb39-034f-463c-bbea-6c10aad3b9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:06.422180 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fbbb39-034f-463c-bbea-6c10aad3b9b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:06.422506 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fbbb39-034f-463c-bbea-6c10aad3b9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:06.422793 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fbbb39-034f-463c-bbea-6c10aad3b9b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:06.423552 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fbbb39-034f-463c-bbea-6c10aad3b9b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:06.425265 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fbbb39-034f-463c-bbea-6c10aad3b9b6 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:06.428292 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e55dfb-3e2d-4d01-acc4-d49265f87d7e None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:06.433132 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcb285a-8936-4f49-a4f5-7b74d7b80860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:06.433814 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb285a-8936-4f49-a4f5-7b74d7b80860 admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:06.434214 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb285a-8936-4f49-a4f5-7b74d7b80860 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:06.434545 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb285a-8936-4f49-a4f5-7b74d7b80860 admin admin] PATH_INFO: `/v3/projects` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:06.435310 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcb285a-8936-4f49-a4f5-7b74d7b80860 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:06.437267 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcb285a-8936-4f49-a4f5-7b74d7b80860 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:06.458043 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1034/2084] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:31:06 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:31:06.460520 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fbbb39-034f-463c-bbea-6c10aad3b9b6 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:06.472781 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fbbb39-034f-463c-bbea-6c10aad3b9b6 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:06.478778 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c702d082-0f01-4f2f-b7e0-7a4aad82824f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:06.479354 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c702d082-0f01-4f2f-b7e0-7a4aad82824f admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:06.480071 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c702d082-0f01-4f2f-b7e0-7a4aad82824f admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:06.480320 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c702d082-0f01-4f2f-b7e0-7a4aad82824f admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:06.481984 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c702d082-0f01-4f2f-b7e0-7a4aad82824f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:06.483480 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c702d082-0f01-4f2f-b7e0-7a4aad82824f admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:06.498962 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1035/2085] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:31:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:31:06.500670 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c702d082-0f01-4f2f-b7e0-7a4aad82824f admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:06.519578 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c702d082-0f01-4f2f-b7e0-7a4aad82824f admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:06.525027 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748b53d5-b05f-459b-91bf-3e22bdf1f2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:06.526105 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b53d5-b05f-459b-91bf-3e22bdf1f2eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:06.526704 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b53d5-b05f-459b-91bf-3e22bdf1f2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:06.526989 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b53d5-b05f-459b-91bf-3e22bdf1f2eb admin admin] PATH_INFO: `/v3/projects/59c5050528904a8abb6878eb3e4103d9/users/ebac2c6ee0764a83b38de4fe60a43d49/roles/c8ce6d197f654598ac45f6016ecccabd` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:06.545243 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748b53d5-b05f-459b-91bf-3e22bdf1f2eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=59c5050528904a8abb6878eb3e4103d9, user_id=ebac2c6ee0764a83b38de4fe60a43d49, role_id=c8ce6d197f654598ac45f6016ecccabd)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:06.548136 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748b53d5-b05f-459b-91bf-3e22bdf1f2eb admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:06.564905 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1051/2086] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:31:06 2022] POST /identity/v3/projects => generated 365 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:31:06.568684 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcb285a-8936-4f49-a4f5-7b74d7b80860 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:06.638315 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcb285a-8936-4f49-a4f5-7b74d7b80860 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:06.647419 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdee8c21-69a6-4535-aedd-27ae65687909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:06.648138 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee8c21-69a6-4535-aedd-27ae65687909 admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:06.648425 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee8c21-69a6-4535-aedd-27ae65687909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:06.648701 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee8c21-69a6-4535-aedd-27ae65687909 admin admin] PATH_INFO: `/v3/users` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:06.649962 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdee8c21-69a6-4535-aedd-27ae65687909 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:06.651558 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdee8c21-69a6-4535-aedd-27ae65687909 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:06.662333 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1036/2087] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:31:06 2022] PUT /identity/v3/projects/59c5050528904a8abb6878eb3e4103d9/users/ebac2c6ee0764a83b38de4fe60a43d49/roles/c8ce6d197f654598ac45f6016ecccabd => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:31:06.672320 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed54c229-f24d-4a80-b0d3-876c99f28075 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:06.672872 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed54c229-f24d-4a80-b0d3-876c99f28075 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:06.673133 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed54c229-f24d-4a80-b0d3-876c99f28075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:06.703284 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-ed54c229-f24d-4a80-b0d3-876c99f28075 None None] MFA Rules not processed for user `ebac2c6ee0764a83b38de4fe60a43d49`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:31:06.704308 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-ed54c229-f24d-4a80-b0d3-876c99f28075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:06.781771 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1037/2088] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:31:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:31:06.785980 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed54c229-f24d-4a80-b0d3-876c99f28075 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:06.830175 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1052/2089] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:31:06 2022] POST /identity/v3/users => generated 289 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:31:06.831725 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdee8c21-69a6-4535-aedd-27ae65687909 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:06.843461 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdee8c21-69a6-4535-aedd-27ae65687909 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:06.848343 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867cd453-263f-43f6-aaa5-8245b3e568f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:06.849008 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867cd453-263f-43f6-aaa5-8245b3e568f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:06.849317 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867cd453-263f-43f6-aaa5-8245b3e568f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:06.849593 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867cd453-263f-43f6-aaa5-8245b3e568f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:06.849877 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed54c229-f24d-4a80-b0d3-876c99f28075 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:06.850357 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867cd453-263f-43f6-aaa5-8245b3e568f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:06.851964 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867cd453-263f-43f6-aaa5-8245b3e568f2 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:06.854647 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d476bef8-73af-4501-a1a5-cbd274709e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:06.855305 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d476bef8-73af-4501-a1a5-cbd274709e54 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:06.855596 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d476bef8-73af-4501-a1a5-cbd274709e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:06.858387 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d476bef8-73af-4501-a1a5-cbd274709e54 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:06.858387 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d476bef8-73af-4501-a1a5-cbd274709e54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:06.858611 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d476bef8-73af-4501-a1a5-cbd274709e54 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:06.863929 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1053/2090] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:31:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:31:06.867096 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867cd453-263f-43f6-aaa5-8245b3e568f2 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:06.877401 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867cd453-263f-43f6-aaa5-8245b3e568f2 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:06.888363 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1667fc-88fd-49f3-8fec-8dd90c5cf4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:06.889277 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1667fc-88fd-49f3-8fec-8dd90c5cf4ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:06.889567 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1667fc-88fd-49f3-8fec-8dd90c5cf4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:06.894169 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1667fc-88fd-49f3-8fec-8dd90c5cf4ad admin admin] PATH_INFO: `/v3/projects/8a9ad93ac30040898e325e08ed24f87c/users/314038692d1e4b0589c238b4f439823b/roles/e04fe3eb1f714d74901ac83e33ea8a16` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:06.905317 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1667fc-88fd-49f3-8fec-8dd90c5cf4ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a9ad93ac30040898e325e08ed24f87c, user_id=314038692d1e4b0589c238b4f439823b, role_id=e04fe3eb1f714d74901ac83e33ea8a16)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:06.908101 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1667fc-88fd-49f3-8fec-8dd90c5cf4ad admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:06.999994 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1038/2091] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:31:06 2022] POST /identity/v3/projects => generated 385 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:31:06.999994 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d476bef8-73af-4501-a1a5-cbd274709e54 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:07.003194 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-d476bef8-73af-4501-a1a5-cbd274709e54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:07.031603 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1054/2092] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:31:06 2022] PUT /identity/v3/projects/8a9ad93ac30040898e325e08ed24f87c/users/314038692d1e4b0589c238b4f439823b/roles/e04fe3eb1f714d74901ac83e33ea8a16 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:31:07.034001 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1667fc-88fd-49f3-8fec-8dd90c5cf4ad admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:07.074313 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d476bef8-73af-4501-a1a5-cbd274709e54 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:07.113984 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1667fc-88fd-49f3-8fec-8dd90c5cf4ad admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:07.121179 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3f97d8-4fd3-44fc-9014-224c0ec9ae44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:07.125979 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3f97d8-4fd3-44fc-9014-224c0ec9ae44 admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:07.125979 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3f97d8-4fd3-44fc-9014-224c0ec9ae44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:07.125979 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3f97d8-4fd3-44fc-9014-224c0ec9ae44 admin admin] PATH_INFO: `/v3/users` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:07.125979 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3f97d8-4fd3-44fc-9014-224c0ec9ae44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:07.125979 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3f97d8-4fd3-44fc-9014-224c0ec9ae44 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:07.146534 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90476cb-47f4-45ec-beec-e9febd60ae12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:07.146534 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90476cb-47f4-45ec-beec-e9febd60ae12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:07.146534 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90476cb-47f4-45ec-beec-e9febd60ae12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:07.146534 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90476cb-47f4-45ec-beec-e9febd60ae12 admin admin] PATH_INFO: `/v3/projects/a7a89b6b3cd94b958731721c60697afb` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:07.150208 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90476cb-47f4-45ec-beec-e9febd60ae12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7a89b6b3cd94b958731721c60697afb)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:07.156207 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90476cb-47f4-45ec-beec-e9febd60ae12 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:07.223248 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1055/2093] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:31:07 2022] POST /identity/v3/users => generated 299 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:31:07.225277 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3f97d8-4fd3-44fc-9014-224c0ec9ae44 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:07.236202 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3f97d8-4fd3-44fc-9014-224c0ec9ae44 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:07.242118 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a7cef-47b0-4d30-af56-8cf0aa63f4de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:07.242810 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a7cef-47b0-4d30-af56-8cf0aa63f4de admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:07.243181 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a7cef-47b0-4d30-af56-8cf0aa63f4de admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:07.243520 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a7cef-47b0-4d30-af56-8cf0aa63f4de admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:07.244335 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0a7cef-47b0-4d30-af56-8cf0aa63f4de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:07.246080 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0a7cef-47b0-4d30-af56-8cf0aa63f4de admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:07.261534 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1056/2094] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:31:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:31:07.261534 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a7cef-47b0-4d30-af56-8cf0aa63f4de admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:07.272112 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a7cef-47b0-4d30-af56-8cf0aa63f4de admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:07.291169 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d0cb2b-6aca-4aaf-88c7-93957acfdd45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:07.292217 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d0cb2b-6aca-4aaf-88c7-93957acfdd45 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:07.292582 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d0cb2b-6aca-4aaf-88c7-93957acfdd45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:07.292939 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d0cb2b-6aca-4aaf-88c7-93957acfdd45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:07.293766 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d0cb2b-6aca-4aaf-88c7-93957acfdd45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:07.295879 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d0cb2b-6aca-4aaf-88c7-93957acfdd45 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:07.305878 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-c90476cb-47f4-45ec-beec-e9febd60ae12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7a89b6b3cd94b958731721c60697afb', 'request_id': 'req-c90476cb-47f4-45ec-beec-e9febd60ae12'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:07.311240 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1057/2095] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:31:07 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:31:07.312183 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d0cb2b-6aca-4aaf-88c7-93957acfdd45 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:07.318297 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-c90476cb-47f4-45ec-beec-e9febd60ae12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7a89b6b3cd94b958731721c60697afb', 'request_id': 'req-c90476cb-47f4-45ec-beec-e9febd60ae12'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:07.326004 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d0cb2b-6aca-4aaf-88c7-93957acfdd45 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:07.417495 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8387270-b138-4418-954c-dc5962602aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:07.418876 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8387270-b138-4418-954c-dc5962602aeb admin admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:07.419231 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8387270-b138-4418-954c-dc5962602aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:07.419580 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8387270-b138-4418-954c-dc5962602aeb admin admin] PATH_INFO: `/v3/projects/8a9ad93ac30040898e325e08ed24f87c/users/314038692d1e4b0589c238b4f439823b/roles/e04fe3eb1f714d74901ac83e33ea8a16` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:07.421210 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-c90476cb-47f4-45ec-beec-e9febd60ae12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7a89b6b3cd94b958731721c60697afb', 'request_id': 'req-c90476cb-47f4-45ec-beec-e9febd60ae12'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:07.423652 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8387270-b138-4418-954c-dc5962602aeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a9ad93ac30040898e325e08ed24f87c, user_id=314038692d1e4b0589c238b4f439823b, role_id=e04fe3eb1f714d74901ac83e33ea8a16)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:07.427421 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8387270-b138-4418-954c-dc5962602aeb admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:07.447062 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-c90476cb-47f4-45ec-beec-e9febd60ae12 admin admin] The token cache is being invalidate because project a7a89b6b3cd94b958731721c60697afb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:31:07.447344 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-c90476cb-47f4-45ec-beec-e9febd60ae12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:07.448095 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-c90476cb-47f4-45ec-beec-e9febd60ae12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:07.448402 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1058/2096] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:31:07 2022] PUT /identity/v3/projects/8a9ad93ac30040898e325e08ed24f87c/users/314038692d1e4b0589c238b4f439823b/roles/e04fe3eb1f714d74901ac83e33ea8a16 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:31:07.456786 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1039/2097] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:31:06 2022] DELETE /identity/v3/projects/a7a89b6b3cd94b958731721c60697afb => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:31:07.458563 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8387270-b138-4418-954c-dc5962602aeb admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:07.461111 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901fc394-d5aa-4436-a281-77b19ae59750 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:07.461410 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901fc394-d5aa-4436-a281-77b19ae59750 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:07.461698 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901fc394-d5aa-4436-a281-77b19ae59750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:07.463611 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-c8387270-b138-4418-954c-dc5962602aeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:07.491287 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-901fc394-d5aa-4436-a281-77b19ae59750 None None] MFA Rules not processed for user `314038692d1e4b0589c238b4f439823b`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:31:07.492526 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-901fc394-d5aa-4436-a281-77b19ae59750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:07.713072 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8387270-b138-4418-954c-dc5962602aeb admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:07.713072 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e77d30-fd65-4a78-bf9e-09167072338b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:07.713072 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e77d30-fd65-4a78-bf9e-09167072338b admin admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:07.713072 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e77d30-fd65-4a78-bf9e-09167072338b admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:07.713700 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e77d30-fd65-4a78-bf9e-09167072338b admin admin] PATH_INFO: `/v3/projects/af13f9aac54b4489a1eac949f5965213/users/bfee18f84f974d7a9e4f692242b93127/roles/e04fe3eb1f714d74901ac83e33ea8a16` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:07.713700 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e77d30-fd65-4a78-bf9e-09167072338b admin admin] RBAC: Authorizing `identity:create_grant(project_id=af13f9aac54b4489a1eac949f5965213, user_id=bfee18f84f974d7a9e4f692242b93127, role_id=e04fe3eb1f714d74901ac83e33ea8a16)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:07.713700 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e77d30-fd65-4a78-bf9e-09167072338b admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:07.713952 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1040/2098] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:31:07 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:31:07.713952 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e041551-94df-496b-8d0e-5eacbdaa8251 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:07.713952 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e041551-94df-496b-8d0e-5eacbdaa8251 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:07.713952 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e041551-94df-496b-8d0e-5eacbdaa8251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:07.713952 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-4e041551-94df-496b-8d0e-5eacbdaa8251 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:31:07.713952 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-4e041551-94df-496b-8d0e-5eacbdaa8251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:07.714778 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1041/2099] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:31:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:31:07.740790 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a657e-a5db-4b9d-bdf2-3c196fe850ac None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:07.741120 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a657e-a5db-4b9d-bdf2-3c196fe850ac None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:07.741409 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a657e-a5db-4b9d-bdf2-3c196fe850ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:07.771949 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-e95a657e-a5db-4b9d-bdf2-3c196fe850ac None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:31:07.773184 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-e95a657e-a5db-4b9d-bdf2-3c196fe850ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:07.787241 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1042/2100] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:31:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:31:07.791322 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95a657e-a5db-4b9d-bdf2-3c196fe850ac None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:07.803754 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95a657e-a5db-4b9d-bdf2-3c196fe850ac None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:07.809516 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9a64f2-40f0-4d26-b834-a86378ee058a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:07.810415 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a64f2-40f0-4d26-b834-a86378ee058a admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:07.810761 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a64f2-40f0-4d26-b834-a86378ee058a admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:07.811040 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a64f2-40f0-4d26-b834-a86378ee058a admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:07.811851 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9a64f2-40f0-4d26-b834-a86378ee058a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:31:07.812218 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9a64f2-40f0-4d26-b834-a86378ee058a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:07.813998 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9a64f2-40f0-4d26-b834-a86378ee058a admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:07.827974 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1043/2101] 10.222.0.62 () {58 vars in 1152 bytes} [Fri May 27 16:31:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:31:07.832525 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9a64f2-40f0-4d26-b834-a86378ee058a admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:07.843542 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9a64f2-40f0-4d26-b834-a86378ee058a admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:07.858574 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975fae23-a972-4b8d-b91e-69c6e3a617db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:07.858574 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975fae23-a972-4b8d-b91e-69c6e3a617db admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:07.858574 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975fae23-a972-4b8d-b91e-69c6e3a617db admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:07.858574 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975fae23-a972-4b8d-b91e-69c6e3a617db admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:07.859356 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975fae23-a972-4b8d-b91e-69c6e3a617db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:07.859356 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975fae23-a972-4b8d-b91e-69c6e3a617db admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:07.908796 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1059/2102] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:31:07 2022] PUT /identity/v3/projects/af13f9aac54b4489a1eac949f5965213/users/bfee18f84f974d7a9e4f692242b93127/roles/e04fe3eb1f714d74901ac83e33ea8a16 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:31:07.913539 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e77d30-fd65-4a78-bf9e-09167072338b admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:08.002081 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e77d30-fd65-4a78-bf9e-09167072338b admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:08.007791 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85ca131-e6a5-4ce2-9fef-ab27e4b5b72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:08.008464 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ca131-e6a5-4ce2-9fef-ab27e4b5b72d admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:08.009312 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ca131-e6a5-4ce2-9fef-ab27e4b5b72d admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:08.009312 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ca131-e6a5-4ce2-9fef-ab27e4b5b72d admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:08.009907 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85ca131-e6a5-4ce2-9fef-ab27e4b5b72d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:08.011627 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85ca131-e6a5-4ce2-9fef-ab27e4b5b72d admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:08.022884 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1060/2103] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:31:07 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:31:08.023715 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85ca131-e6a5-4ce2-9fef-ab27e4b5b72d admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:08.025522 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-c85ca131-e6a5-4ce2-9fef-ab27e4b5b72d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:08.041719 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1044/2104] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:31:07 2022] POST /identity/v3/projects => generated 385 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:31:08.043914 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975fae23-a972-4b8d-b91e-69c6e3a617db admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:08.104246 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85ca131-e6a5-4ce2-9fef-ab27e4b5b72d admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:08.127661 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975fae23-a972-4b8d-b91e-69c6e3a617db admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:08.134584 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44caf9f6-1375-455f-b0e9-24a13cf741d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:08.137715 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44caf9f6-1375-455f-b0e9-24a13cf741d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:08.138132 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44caf9f6-1375-455f-b0e9-24a13cf741d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:08.138502 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44caf9f6-1375-455f-b0e9-24a13cf741d2 admin admin] PATH_INFO: `/v3/projects/af13f9aac54b4489a1eac949f5965213/users/bfee18f84f974d7a9e4f692242b93127/roles/e04fe3eb1f714d74901ac83e33ea8a16` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:08.141693 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44caf9f6-1375-455f-b0e9-24a13cf741d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af13f9aac54b4489a1eac949f5965213, user_id=bfee18f84f974d7a9e4f692242b93127, role_id=e04fe3eb1f714d74901ac83e33ea8a16)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:08.146715 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44caf9f6-1375-455f-b0e9-24a13cf741d2 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:08.170393 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1045/2105] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:31:08 2022] PUT /identity/v3/projects/af13f9aac54b4489a1eac949f5965213/users/bfee18f84f974d7a9e4f692242b93127/roles/e04fe3eb1f714d74901ac83e33ea8a16 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:31:08.170393 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44caf9f6-1375-455f-b0e9-24a13cf741d2 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:08.173212 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd626224-bab3-4825-9289-f101e2732989 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8693a1e72f14fdfb383f11e96330726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:08.174104 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd626224-bab3-4825-9289-f101e2732989 service cinder] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:08.174358 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd626224-bab3-4825-9289-f101e2732989 service cinder] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:08.174673 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd626224-bab3-4825-9289-f101e2732989 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:08.264691 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd626224-bab3-4825-9289-f101e2732989 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:08.266445 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd626224-bab3-4825-9289-f101e2732989 service cinder] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:08.280691 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1061/2106] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:31:08 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:31:08.282417 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7094b4b6-6376-427b-b5a2-2549ef5a518d None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:08.282813 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7094b4b6-6376-427b-b5a2-2549ef5a518d None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:08.283339 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7094b4b6-6376-427b-b5a2-2549ef5a518d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:08.297186 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44caf9f6-1375-455f-b0e9-24a13cf741d2 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:08.324382 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41fd1c3-4f61-4fc3-8dc6-919098f39059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:08.326271 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41fd1c3-4f61-4fc3-8dc6-919098f39059 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:08.326557 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41fd1c3-4f61-4fc3-8dc6-919098f39059 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:08.327118 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41fd1c3-4f61-4fc3-8dc6-919098f39059 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:08.329125 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41fd1c3-4f61-4fc3-8dc6-919098f39059 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:08.333406 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41fd1c3-4f61-4fc3-8dc6-919098f39059 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:08.343247 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-7094b4b6-6376-427b-b5a2-2549ef5a518d None None] MFA Rules not processed for user `bfee18f84f974d7a9e4f692242b93127`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:31:08.355314 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-7094b4b6-6376-427b-b5a2-2549ef5a518d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:08.463054 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1046/2107] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:31:08 2022] POST /identity/v3/users => generated 293 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:31:08.463054 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41fd1c3-4f61-4fc3-8dc6-919098f39059 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:08.467516 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-f41fd1c3-4f61-4fc3-8dc6-919098f39059 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:08.468597 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1062/2108] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:31:08 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:31:08.469584 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7094b4b6-6376-427b-b5a2-2549ef5a518d None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:08.490056 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7094b4b6-6376-427b-b5a2-2549ef5a518d None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:08.495290 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab648019-ee79-4833-bdfc-39038175c2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:08.496061 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab648019-ee79-4833-bdfc-39038175c2cc admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:08.496535 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab648019-ee79-4833-bdfc-39038175c2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:08.496828 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab648019-ee79-4833-bdfc-39038175c2cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:08.497557 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab648019-ee79-4833-bdfc-39038175c2cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:08.499219 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab648019-ee79-4833-bdfc-39038175c2cc admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:08.512371 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1063/2109] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:31:08.517415 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab648019-ee79-4833-bdfc-39038175c2cc admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:08.529238 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab648019-ee79-4833-bdfc-39038175c2cc admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:08.536120 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8173c2-a09d-4dde-8a4c-d49fb32117a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:08.536842 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8173c2-a09d-4dde-8a4c-d49fb32117a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:08.537125 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8173c2-a09d-4dde-8a4c-d49fb32117a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:08.537409 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8173c2-a09d-4dde-8a4c-d49fb32117a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:08.538541 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8173c2-a09d-4dde-8a4c-d49fb32117a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:08.540554 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8173c2-a09d-4dde-8a4c-d49fb32117a6 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:08.551831 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41fd1c3-4f61-4fc3-8dc6-919098f39059 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:08.558588 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1064/2110] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:31:08.558588 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8173c2-a09d-4dde-8a4c-d49fb32117a6 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:08.560088 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a9554-83da-4eef-a2a7-1d1e060f79ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8693a1e72f14fdfb383f11e96330726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:08.560881 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a9554-83da-4eef-a2a7-1d1e060f79ff service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:08.561753 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a9554-83da-4eef-a2a7-1d1e060f79ff service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:08.562145 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a9554-83da-4eef-a2a7-1d1e060f79ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:08.566525 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-1d0a9554-83da-4eef-a2a7-1d1e060f79ff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:08.570436 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8173c2-a09d-4dde-8a4c-d49fb32117a6 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:08.575653 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2816b9d5-2286-49a1-88d5-b6a3af774500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:08.576593 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816b9d5-2286-49a1-88d5-b6a3af774500 admin admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:08.577016 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816b9d5-2286-49a1-88d5-b6a3af774500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:08.577305 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816b9d5-2286-49a1-88d5-b6a3af774500 admin admin] PATH_INFO: `/v3/projects/34ff9634a00a48be80c167e4f61562b0/users/0849b14e56a44d2ba11ae32b484bcab8/roles/c8ce6d197f654598ac45f6016ecccabd` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:08.596020 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2816b9d5-2286-49a1-88d5-b6a3af774500 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34ff9634a00a48be80c167e4f61562b0, user_id=0849b14e56a44d2ba11ae32b484bcab8, role_id=c8ce6d197f654598ac45f6016ecccabd)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:08.600387 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2816b9d5-2286-49a1-88d5-b6a3af774500 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:08.650027 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0a9554-83da-4eef-a2a7-1d1e060f79ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:08.651751 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0a9554-83da-4eef-a2a7-1d1e060f79ff service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:08.662651 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1047/2111] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:31:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:31:08.665252 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a9554-83da-4eef-a2a7-1d1e060f79ff service cinder] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:08.674063 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a9554-83da-4eef-a2a7-1d1e060f79ff service cinder] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:08.679621 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5699d0d7-efab-402d-af6b-2c237a860588 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8693a1e72f14fdfb383f11e96330726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:08.680361 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5699d0d7-efab-402d-af6b-2c237a860588 service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:08.680718 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5699d0d7-efab-402d-af6b-2c237a860588 service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:08.681068 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5699d0d7-efab-402d-af6b-2c237a860588 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:08.693770 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5699d0d7-efab-402d-af6b-2c237a860588 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:08.695346 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5699d0d7-efab-402d-af6b-2c237a860588 service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:08.708094 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1048/2112] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:31:08 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:31:08.718133 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1065/2113] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:31:08 2022] PUT /identity/v3/projects/34ff9634a00a48be80c167e4f61562b0/users/0849b14e56a44d2ba11ae32b484bcab8/roles/c8ce6d197f654598ac45f6016ecccabd => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:31:08.728959 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e54d1e-df97-4fed-b679-4f292256643c None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:08.729447 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e54d1e-df97-4fed-b679-4f292256643c None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:08.729545 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e54d1e-df97-4fed-b679-4f292256643c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:08.768287 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2816b9d5-2286-49a1-88d5-b6a3af774500 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:08.780178 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-f1e54d1e-df97-4fed-b679-4f292256643c None None] MFA Rules not processed for user `0849b14e56a44d2ba11ae32b484bcab8`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:31:08.781550 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-f1e54d1e-df97-4fed-b679-4f292256643c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:08.838061 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2816b9d5-2286-49a1-88d5-b6a3af774500 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:08.843315 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a826c5dc-527b-4fa5-9170-dbb2c1f1f9f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8693a1e72f14fdfb383f11e96330726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:08.844127 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826c5dc-527b-4fa5-9170-dbb2c1f1f9f6 service cinder] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:08.844595 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826c5dc-527b-4fa5-9170-dbb2c1f1f9f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:08.848151 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826c5dc-527b-4fa5-9170-dbb2c1f1f9f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:08.853922 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-a826c5dc-527b-4fa5-9170-dbb2c1f1f9f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:08.897467 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1049/2114] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:31:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:31:08.902164 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e54d1e-df97-4fed-b679-4f292256643c None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:08.937670 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:31:08.973757 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a826c5dc-527b-4fa5-9170-dbb2c1f1f9f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:08.975243 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a826c5dc-527b-4fa5-9170-dbb2c1f1f9f6 service cinder] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:08.990713 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1066/2115] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:31:08 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 16:31:09.028074 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e54d1e-df97-4fed-b679-4f292256643c None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:09.036214 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8591e1-86e1-4df5-b576-c03eaf0d6e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:09.037020 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8591e1-86e1-4df5-b576-c03eaf0d6e75 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:09.037421 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8591e1-86e1-4df5-b576-c03eaf0d6e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:09.037793 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8591e1-86e1-4df5-b576-c03eaf0d6e75 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:09.038712 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8591e1-86e1-4df5-b576-c03eaf0d6e75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:09.043604 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8591e1-86e1-4df5-b576-c03eaf0d6e75 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:09.202896 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1050/2116] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:31:08 2022] POST /identity/v3/projects => generated 385 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:31:09.204066 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a826c5dc-527b-4fa5-9170-dbb2c1f1f9f6 service cinder] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:09.219002 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a826c5dc-527b-4fa5-9170-dbb2c1f1f9f6 service cinder] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:09.293223 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b9e6cc-6b1e-4366-ad04-6094eb4cddc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:09.294179 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b9e6cc-6b1e-4366-ad04-6094eb4cddc4 admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:09.294512 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b9e6cc-6b1e-4366-ad04-6094eb4cddc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:09.294797 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b9e6cc-6b1e-4366-ad04-6094eb4cddc4 admin admin] PATH_INFO: `/v3/users` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:09.295814 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b9e6cc-6b1e-4366-ad04-6094eb4cddc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:09.297984 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b9e6cc-6b1e-4366-ad04-6094eb4cddc4 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:09.423815 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1067/2117] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:31:09 2022] POST /identity/v3/users => generated 299 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:31:09.428880 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8591e1-86e1-4df5-b576-c03eaf0d6e75 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:09.435718 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:INSERT=2,keystone:DELETE=1,keystone:SELECT=97 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:31:09.458058 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8591e1-86e1-4df5-b576-c03eaf0d6e75 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:09.464438 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe86059-c5ab-4485-a2b9-e75150b69dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:09.465713 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe86059-c5ab-4485-a2b9-e75150b69dcc admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:09.466100 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe86059-c5ab-4485-a2b9-e75150b69dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:09.467056 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe86059-c5ab-4485-a2b9-e75150b69dcc admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:09.467905 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe86059-c5ab-4485-a2b9-e75150b69dcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:09.470794 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe86059-c5ab-4485-a2b9-e75150b69dcc admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:09.489178 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1051/2118] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 16:31:09.490551 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b9e6cc-6b1e-4366-ad04-6094eb4cddc4 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:09.504970 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b9e6cc-6b1e-4366-ad04-6094eb4cddc4 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:09.511409 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e769c-5046-49c4-a570-bc4da2db2f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:09.512761 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e769c-5046-49c4-a570-bc4da2db2f67 admin admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:09.513257 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e769c-5046-49c4-a570-bc4da2db2f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:09.513789 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e769c-5046-49c4-a570-bc4da2db2f67 admin admin] PATH_INFO: `/v3/projects/e9d23191cd344445827c581f8a45f6f1/users/a0aab6ec24e44395bca08fa94aaeff0a/roles/e04fe3eb1f714d74901ac83e33ea8a16` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:09.533838 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33e769c-5046-49c4-a570-bc4da2db2f67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9d23191cd344445827c581f8a45f6f1, user_id=a0aab6ec24e44395bca08fa94aaeff0a, role_id=e04fe3eb1f714d74901ac83e33ea8a16)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:09.537242 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33e769c-5046-49c4-a570-bc4da2db2f67 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:09.662277 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1068/2119] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:31:09 2022] PUT /identity/v3/projects/e9d23191cd344445827c581f8a45f6f1/users/a0aab6ec24e44395bca08fa94aaeff0a/roles/e04fe3eb1f714d74901ac83e33ea8a16 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:31:09.666554 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe86059-c5ab-4485-a2b9-e75150b69dcc admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:09.677870 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe86059-c5ab-4485-a2b9-e75150b69dcc admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:09.750462 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba35a285-6a87-4c1b-a820-ec00e4780394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:09.750462 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba35a285-6a87-4c1b-a820-ec00e4780394 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:09.750462 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba35a285-6a87-4c1b-a820-ec00e4780394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:09.750462 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba35a285-6a87-4c1b-a820-ec00e4780394 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:09.751425 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba35a285-6a87-4c1b-a820-ec00e4780394 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:09.752693 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba35a285-6a87-4c1b-a820-ec00e4780394 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:09.764658 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1052/2120] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 16:31:09.769276 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e769c-5046-49c4-a570-bc4da2db2f67 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:09.780244 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e769c-5046-49c4-a570-bc4da2db2f67 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:09.785954 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de051a-6f45-4501-b5cd-d8c37cf90070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:09.787028 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de051a-6f45-4501-b5cd-d8c37cf90070 admin admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:09.787416 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de051a-6f45-4501-b5cd-d8c37cf90070 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:09.787796 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de051a-6f45-4501-b5cd-d8c37cf90070 admin admin] PATH_INFO: `/v3/projects/e9d23191cd344445827c581f8a45f6f1/users/a0aab6ec24e44395bca08fa94aaeff0a/roles/e04fe3eb1f714d74901ac83e33ea8a16` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:09.789910 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9de051a-6f45-4501-b5cd-d8c37cf90070 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9d23191cd344445827c581f8a45f6f1, user_id=a0aab6ec24e44395bca08fa94aaeff0a, role_id=e04fe3eb1f714d74901ac83e33ea8a16)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:09.792751 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9de051a-6f45-4501-b5cd-d8c37cf90070 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:09.804926 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1069/2121] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:31:09 2022] PUT /identity/v3/projects/e9d23191cd344445827c581f8a45f6f1/users/a0aab6ec24e44395bca08fa94aaeff0a/roles/e04fe3eb1f714d74901ac83e33ea8a16 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:31:09.816029 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4b6e8-a4eb-4126-94a3-6bf7327d333e None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:09.816324 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4b6e8-a4eb-4126-94a3-6bf7327d333e None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:09.816608 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4b6e8-a4eb-4126-94a3-6bf7327d333e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:09.849491 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-19b4b6e8-a4eb-4126-94a3-6bf7327d333e None None] MFA Rules not processed for user `a0aab6ec24e44395bca08fa94aaeff0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:31:09.850893 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-19b4b6e8-a4eb-4126-94a3-6bf7327d333e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:09.996062 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1053/2122] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:31:09 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:31:10.671985 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de051a-6f45-4501-b5cd-d8c37cf90070 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:10.738872 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de051a-6f45-4501-b5cd-d8c37cf90070 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:10.742956 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d1c92e-970f-47ae-a14a-7a52b141527f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8693a1e72f14fdfb383f11e96330726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:10.743631 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d1c92e-970f-47ae-a14a-7a52b141527f service cinder] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:10.743911 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d1c92e-970f-47ae-a14a-7a52b141527f service cinder] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:10.744194 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d1c92e-970f-47ae-a14a-7a52b141527f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:10.831925 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d1c92e-970f-47ae-a14a-7a52b141527f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:10.834465 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d1c92e-970f-47ae-a14a-7a52b141527f service cinder] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:10.858543 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1070/2123] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:31:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 16:31:11.973239 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547fc741-1d73-4468-9e2f-0475f9760c47 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:11.973723 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547fc741-1d73-4468-9e2f-0475f9760c47 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:11.973871 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547fc741-1d73-4468-9e2f-0475f9760c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:12.006326 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-547fc741-1d73-4468-9e2f-0475f9760c47 None None] MFA Rules not processed for user `9eb9fb33e55a4b80b04c6462403195c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:31:12.007410 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-547fc741-1d73-4468-9e2f-0475f9760c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:12.086788 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1054/2124] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:31:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:31:12.101406 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d1c92e-970f-47ae-a14a-7a52b141527f service cinder] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:12.102004 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-70d1c92e-970f-47ae-a14a-7a52b141527f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:12.199004 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d1c92e-970f-47ae-a14a-7a52b141527f service cinder] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:12.205660 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81da1e74-5dfe-4cca-8e25-eba5e3919bbe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb13ad6d8b1e46029262556bff398796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:12.207306 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da1e74-5dfe-4cca-8e25-eba5e3919bbe service nova] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:12.207636 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da1e74-5dfe-4cca-8e25-eba5e3919bbe service nova] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:12.208159 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da1e74-5dfe-4cca-8e25-eba5e3919bbe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:12.224673 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81da1e74-5dfe-4cca-8e25-eba5e3919bbe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:12.226673 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81da1e74-5dfe-4cca-8e25-eba5e3919bbe service nova] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:12.250997 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1071/2125] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:31:12 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:31:12.559400 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547fc741-1d73-4468-9e2f-0475f9760c47 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:12.566387 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547fc741-1d73-4468-9e2f-0475f9760c47 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:12.570002 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf8d37-6081-4075-beb2-2fee3ce9841a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8693a1e72f14fdfb383f11e96330726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:12.570683 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf8d37-6081-4075-beb2-2fee3ce9841a service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:12.570965 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf8d37-6081-4075-beb2-2fee3ce9841a service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:12.571245 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf8d37-6081-4075-beb2-2fee3ce9841a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:12.573026 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-6faf8d37-6081-4075-beb2-2fee3ce9841a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:12.649046 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faf8d37-6081-4075-beb2-2fee3ce9841a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:12.651333 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faf8d37-6081-4075-beb2-2fee3ce9841a service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:12.663733 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1055/2126] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:31:12 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:31:12.969635 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:31:13.098097 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81da1e74-5dfe-4cca-8e25-eba5e3919bbe service nova] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:13.107228 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81da1e74-5dfe-4cca-8e25-eba5e3919bbe service nova] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:13.111564 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1e61f1-9886-4283-9145-c3c2496d8a7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8693a1e72f14fdfb383f11e96330726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:13.112326 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1e61f1-9886-4283-9145-c3c2496d8a7c service cinder] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:13.112566 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1e61f1-9886-4283-9145-c3c2496d8a7c service cinder] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:13.113336 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1e61f1-9886-4283-9145-c3c2496d8a7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:13.115162 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-0e1e61f1-9886-4283-9145-c3c2496d8a7c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:13.176139 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1e61f1-9886-4283-9145-c3c2496d8a7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:13.178002 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1e61f1-9886-4283-9145-c3c2496d8a7c service cinder] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:13.188360 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1072/2127] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:31:13 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:31:13.740333 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:31:15.983254 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a2db1-a802-4b64-b9f2-4354ec719299 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:15.983798 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a2db1-a802-4b64-b9f2-4354ec719299 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:15.984158 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a2db1-a802-4b64-b9f2-4354ec719299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:16.006688 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-591a2db1-a802-4b64-b9f2-4354ec719299 None None] MFA Rules not processed for user `9eb9fb33e55a4b80b04c6462403195c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:31:16.008135 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-591a2db1-a802-4b64-b9f2-4354ec719299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:16.016173 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1056/2128] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:31:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:31:16.395151 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898686e0-7c17-4a00-bd74-55db2272a2b8 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:16.395684 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898686e0-7c17-4a00-bd74-55db2272a2b8 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:16.395684 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898686e0-7c17-4a00-bd74-55db2272a2b8 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:16.397396 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1073/2129] 10.222.0.62 () {54 vars in 912 bytes} [Fri May 27 16:31:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:31:16.403503 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad21b7a-39c2-4df7-868f-887a91d2fee2 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:16.403995 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad21b7a-39c2-4df7-868f-887a91d2fee2 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:16.409188 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad21b7a-39c2-4df7-868f-887a91d2fee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:16.423290 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-8ad21b7a-39c2-4df7-868f-887a91d2fee2 None None] MFA Rules not processed for user `b367ccea28d540a0b24ec4e42ebfef65`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:31:16.425010 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-8ad21b7a-39c2-4df7-868f-887a91d2fee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:16.485155 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1057/2130] 10.222.0.62 () {58 vars in 1009 bytes} [Fri May 27 16:31:16 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:31:16.497047 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898686e0-7c17-4a00-bd74-55db2272a2b8 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:16.498892 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-898686e0-7c17-4a00-bd74-55db2272a2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:16.512920 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898686e0-7c17-4a00-bd74-55db2272a2b8 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:16.516745 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9b9ca3-6e41-4a12-9134-866bcc64484c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:16.517394 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9b9ca3-6e41-4a12-9134-866bcc64484c service neutron] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:16.517681 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9b9ca3-6e41-4a12-9134-866bcc64484c service neutron] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:16.523688 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9b9ca3-6e41-4a12-9134-866bcc64484c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:16.525770 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9b9ca3-6e41-4a12-9134-866bcc64484c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:16.527260 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9b9ca3-6e41-4a12-9134-866bcc64484c service neutron] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:16.535447 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1074/2131] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:31:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:31:16.747379 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:31:17.387112 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:INSERT=5,keystone:DELETE=3,keystone:SELECT=92 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:31:17.906023 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:31:18.970507 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad21b7a-39c2-4df7-868f-887a91d2fee2 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:18.972427 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-8ad21b7a-39c2-4df7-868f-887a91d2fee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:19.042878 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad21b7a-39c2-4df7-868f-887a91d2fee2 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:19.048982 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da5f5f5-ec16-4261-a3c9-d847b92ca8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:19.050000 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5f5f5-ec16-4261-a3c9-d847b92ca8d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:19.058805 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5f5f5-ec16-4261-a3c9-d847b92ca8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:19.059325 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5f5f5-ec16-4261-a3c9-d847b92ca8d9 admin admin] PATH_INFO: `/v3/users/5ebfccd5c7474777bfe1395aeb6345da` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:19.062828 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da5f5f5-ec16-4261-a3c9-d847b92ca8d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ebfccd5c7474777bfe1395aeb6345da)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:19.066456 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da5f5f5-ec16-4261-a3c9-d847b92ca8d9 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:19.653045 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-8da5f5f5-ec16-4261-a3c9-d847b92ca8d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ebfccd5c7474777bfe1395aeb6345da'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:19.661839 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-8da5f5f5-ec16-4261-a3c9-d847b92ca8d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ebfccd5c7474777bfe1395aeb6345da'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:19.662629 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-8da5f5f5-ec16-4261-a3c9-d847b92ca8d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ebfccd5c7474777bfe1395aeb6345da'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:19.667909 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-8da5f5f5-ec16-4261-a3c9-d847b92ca8d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ebfccd5c7474777bfe1395aeb6345da'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:19.707355 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9b9ca3-6e41-4a12-9134-866bcc64484c service neutron] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:19.709143 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-2b9b9ca3-6e41-4a12-9134-866bcc64484c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:19.725204 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9b9ca3-6e41-4a12-9134-866bcc64484c service neutron] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:19.738593 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0329c1-28ee-421e-9c50-02a0f71a82e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:19.739487 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0329c1-28ee-421e-9c50-02a0f71a82e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:19.739922 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0329c1-28ee-421e-9c50-02a0f71a82e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:19.740207 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0329c1-28ee-421e-9c50-02a0f71a82e1 admin admin] PATH_INFO: `/v3/users/230741a8d94a45f4b2480a07417ae731` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:19.741436 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0329c1-28ee-421e-9c50-02a0f71a82e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=230741a8d94a45f4b2480a07417ae731)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:19.743753 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0329c1-28ee-421e-9c50-02a0f71a82e1 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:19.798129 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-8da5f5f5-ec16-4261-a3c9-d847b92ca8d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ebfccd5c7474777bfe1395aeb6345da'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:19.816961 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1058/2132] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:31:18 2022] DELETE /identity/v3/users/5ebfccd5c7474777bfe1395aeb6345da => generated 0 bytes in 847 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:31:19.817796 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da5f5f5-ec16-4261-a3c9-d847b92ca8d9 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:19.819222 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-8da5f5f5-ec16-4261-a3c9-d847b92ca8d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:19.879055 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da5f5f5-ec16-4261-a3c9-d847b92ca8d9 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:19.883007 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bcf365-03dc-4cfb-9641-0a98326a0cf3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8693a1e72f14fdfb383f11e96330726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:19.883654 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bcf365-03dc-4cfb-9641-0a98326a0cf3 service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:19.883942 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bcf365-03dc-4cfb-9641-0a98326a0cf3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:19.884225 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bcf365-03dc-4cfb-9641-0a98326a0cf3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:19.886011 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-32bcf365-03dc-4cfb-9641-0a98326a0cf3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:19.950404 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bcf365-03dc-4cfb-9641-0a98326a0cf3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:19.951872 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bcf365-03dc-4cfb-9641-0a98326a0cf3 service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:19.961300 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1059/2133] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:31:19 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:31:19.962598 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b532cc7-991d-44e5-96f7-1d1466767b2f None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:19.962889 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b532cc7-991d-44e5-96f7-1d1466767b2f None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:19.963171 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b532cc7-991d-44e5-96f7-1d1466767b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:19.981551 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-9b532cc7-991d-44e5-96f7-1d1466767b2f None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:31:19.982859 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-9b532cc7-991d-44e5-96f7-1d1466767b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:19.996422 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-7b0329c1-28ee-421e-9c50-02a0f71a82e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '230741a8d94a45f4b2480a07417ae731'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:20.011540 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-7b0329c1-28ee-421e-9c50-02a0f71a82e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '230741a8d94a45f4b2480a07417ae731'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:20.012249 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-7b0329c1-28ee-421e-9c50-02a0f71a82e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '230741a8d94a45f4b2480a07417ae731'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:20.013019 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-7b0329c1-28ee-421e-9c50-02a0f71a82e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '230741a8d94a45f4b2480a07417ae731'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:20.045603 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1060/2134] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:31:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:31:20.055292 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b532cc7-991d-44e5-96f7-1d1466767b2f None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:20.056836 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-9b532cc7-991d-44e5-96f7-1d1466767b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:20.120328 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b532cc7-991d-44e5-96f7-1d1466767b2f None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:20.124023 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c692b0c-ae72-4af3-903a-aff31576bfdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:20.124670 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c692b0c-ae72-4af3-903a-aff31576bfdc service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:20.124955 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c692b0c-ae72-4af3-903a-aff31576bfdc service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:20.125236 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c692b0c-ae72-4af3-903a-aff31576bfdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:20.127375 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-7b0329c1-28ee-421e-9c50-02a0f71a82e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '230741a8d94a45f4b2480a07417ae731'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:20.136086 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c692b0c-ae72-4af3-903a-aff31576bfdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:20.138160 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c692b0c-ae72-4af3-903a-aff31576bfdc service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:20.144324 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1075/2135] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:31:19 2022] DELETE /identity/v3/users/230741a8d94a45f4b2480a07417ae731 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:31:20.149002 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532710a0-f09f-41ad-9c1d-981cb4481ffa None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:20.149406 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532710a0-f09f-41ad-9c1d-981cb4481ffa None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:20.149790 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532710a0-f09f-41ad-9c1d-981cb4481ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:20.150645 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1061/2136] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:31:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 16:31:20.170041 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-532710a0-f09f-41ad-9c1d-981cb4481ffa None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:31:20.171457 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-532710a0-f09f-41ad-9c1d-981cb4481ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:20.233961 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1076/2137] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:31:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:31:20.244739 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c692b0c-ae72-4af3-903a-aff31576bfdc service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:20.247594 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-8c692b0c-ae72-4af3-903a-aff31576bfdc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:20.259152 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c692b0c-ae72-4af3-903a-aff31576bfdc service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:20.311524 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69285187-0c4f-4845-8680-ab3477b2c61e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:20.312738 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69285187-0c4f-4845-8680-ab3477b2c61e service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:20.313028 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69285187-0c4f-4845-8680-ab3477b2c61e service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:20.313311 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69285187-0c4f-4845-8680-ab3477b2c61e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:20.323129 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69285187-0c4f-4845-8680-ab3477b2c61e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:20.324571 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69285187-0c4f-4845-8680-ab3477b2c61e service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:20.334264 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1062/2138] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:31:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:31:20.776005 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532710a0-f09f-41ad-9c1d-981cb4481ffa None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:20.777493 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-532710a0-f09f-41ad-9c1d-981cb4481ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:20.792063 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532710a0-f09f-41ad-9c1d-981cb4481ffa None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:20.798356 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5272c4a7-21fb-4e09-afda-5884e62941e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:20.799669 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5272c4a7-21fb-4e09-afda-5884e62941e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:20.800112 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5272c4a7-21fb-4e09-afda-5884e62941e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:20.800531 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5272c4a7-21fb-4e09-afda-5884e62941e2 admin admin] PATH_INFO: `/v3/projects/7413bc6221e74c9aaeb392b307fabcb8` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:20.805182 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5272c4a7-21fb-4e09-afda-5884e62941e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7413bc6221e74c9aaeb392b307fabcb8)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:20.807806 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5272c4a7-21fb-4e09-afda-5884e62941e2 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:20.919943 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69285187-0c4f-4845-8680-ab3477b2c61e service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:20.919943 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-69285187-0c4f-4845-8680-ab3477b2c61e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:21.000884 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-5272c4a7-21fb-4e09-afda-5884e62941e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7413bc6221e74c9aaeb392b307fabcb8', 'request_id': 'req-5272c4a7-21fb-4e09-afda-5884e62941e2'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:21.006416 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69285187-0c4f-4845-8680-ab3477b2c61e service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:21.012044 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-5272c4a7-21fb-4e09-afda-5884e62941e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7413bc6221e74c9aaeb392b307fabcb8', 'request_id': 'req-5272c4a7-21fb-4e09-afda-5884e62941e2'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:21.016908 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-5272c4a7-21fb-4e09-afda-5884e62941e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7413bc6221e74c9aaeb392b307fabcb8', 'request_id': 'req-5272c4a7-21fb-4e09-afda-5884e62941e2'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:21.078966 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40a6f95-8799-4b35-89b2-78353d07e94b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8693a1e72f14fdfb383f11e96330726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:21.079636 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a6f95-8799-4b35-89b2-78353d07e94b service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:21.079922 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a6f95-8799-4b35-89b2-78353d07e94b service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:21.080195 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a6f95-8799-4b35-89b2-78353d07e94b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:21.085265 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-c40a6f95-8799-4b35-89b2-78353d07e94b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:21.151936 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-5272c4a7-21fb-4e09-afda-5884e62941e2 admin admin] The token cache is being invalidate because project 7413bc6221e74c9aaeb392b307fabcb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80288) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:31:21.161172 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-5272c4a7-21fb-4e09-afda-5884e62941e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:21.161172 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-5272c4a7-21fb-4e09-afda-5884e62941e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:21.161172 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1077/2139] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:31:20 2022] DELETE /identity/v3/projects/7413bc6221e74c9aaeb392b307fabcb8 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:31:21.161172 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5272c4a7-21fb-4e09-afda-5884e62941e2 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:21.161172 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-5272c4a7-21fb-4e09-afda-5884e62941e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:21.161741 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40a6f95-8799-4b35-89b2-78353d07e94b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:21.161741 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40a6f95-8799-4b35-89b2-78353d07e94b service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:21.170813 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1063/2140] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:31:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 16:31:21.173001 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40a6f95-8799-4b35-89b2-78353d07e94b service cinder] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:21.174407 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-c40a6f95-8799-4b35-89b2-78353d07e94b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:21.249450 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5272c4a7-21fb-4e09-afda-5884e62941e2 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:21.256241 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d369eb01-c3c3-4c43-bdee-014083423a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:21.256395 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40a6f95-8799-4b35-89b2-78353d07e94b service cinder] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:21.256591 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d369eb01-c3c3-4c43-bdee-014083423a00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:21.257185 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d369eb01-c3c3-4c43-bdee-014083423a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:21.257588 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d369eb01-c3c3-4c43-bdee-014083423a00 admin admin] PATH_INFO: `/v3/projects/03608fb3b9b7484ba619c81359bf242e` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:21.259326 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d369eb01-c3c3-4c43-bdee-014083423a00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03608fb3b9b7484ba619c81359bf242e)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:21.262006 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15151cf6-044e-4c39-a819-47ec6d88cd18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:21.262150 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d369eb01-c3c3-4c43-bdee-014083423a00 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:21.263059 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15151cf6-044e-4c39-a819-47ec6d88cd18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:21.263649 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15151cf6-044e-4c39-a819-47ec6d88cd18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:21.264011 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15151cf6-044e-4c39-a819-47ec6d88cd18 admin admin] PATH_INFO: `/v3/users/beb5c8a530b44ce3abf89b04ae4d798c` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:21.265551 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15151cf6-044e-4c39-a819-47ec6d88cd18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=beb5c8a530b44ce3abf89b04ae4d798c)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:21.269460 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15151cf6-044e-4c39-a819-47ec6d88cd18 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:21.451334 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-d369eb01-c3c3-4c43-bdee-014083423a00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03608fb3b9b7484ba619c81359bf242e', 'request_id': 'req-d369eb01-c3c3-4c43-bdee-014083423a00'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:21.457969 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-d369eb01-c3c3-4c43-bdee-014083423a00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03608fb3b9b7484ba619c81359bf242e', 'request_id': 'req-d369eb01-c3c3-4c43-bdee-014083423a00'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:21.463594 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-d369eb01-c3c3-4c43-bdee-014083423a00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03608fb3b9b7484ba619c81359bf242e', 'request_id': 'req-d369eb01-c3c3-4c43-bdee-014083423a00'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:21.488297 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:31:21.576733 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-d369eb01-c3c3-4c43-bdee-014083423a00 admin admin] The token cache is being invalidate because project 03608fb3b9b7484ba619c81359bf242e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80288) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:31:21.577085 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-d369eb01-c3c3-4c43-bdee-014083423a00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:21.577761 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-d369eb01-c3c3-4c43-bdee-014083423a00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:21.580177 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1078/2141] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:31:21 2022] DELETE /identity/v3/projects/03608fb3b9b7484ba619c81359bf242e => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:31:21.581519 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d369eb01-c3c3-4c43-bdee-014083423a00 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:21.583827 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-d369eb01-c3c3-4c43-bdee-014083423a00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:21.584434 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-15151cf6-044e-4c39-a819-47ec6d88cd18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'beb5c8a530b44ce3abf89b04ae4d798c'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:21.596556 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-15151cf6-044e-4c39-a819-47ec6d88cd18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'beb5c8a530b44ce3abf89b04ae4d798c'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:21.597794 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-15151cf6-044e-4c39-a819-47ec6d88cd18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'beb5c8a530b44ce3abf89b04ae4d798c'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:21.598677 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-15151cf6-044e-4c39-a819-47ec6d88cd18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'beb5c8a530b44ce3abf89b04ae4d798c'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:21.653849 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d369eb01-c3c3-4c43-bdee-014083423a00 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:21.658588 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c4d53a-1ea3-4020-b30a-0c1c99b162d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:21.659546 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4d53a-1ea3-4020-b30a-0c1c99b162d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:21.659833 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4d53a-1ea3-4020-b30a-0c1c99b162d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:21.660112 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4d53a-1ea3-4020-b30a-0c1c99b162d6 admin admin] PATH_INFO: `/v3/users/fb09b4b02b69435ea53cfb0e5e5fa82a` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:21.661301 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c4d53a-1ea3-4020-b30a-0c1c99b162d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb09b4b02b69435ea53cfb0e5e5fa82a)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:21.663263 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c4d53a-1ea3-4020-b30a-0c1c99b162d6 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:21.736464 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-15151cf6-044e-4c39-a819-47ec6d88cd18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'beb5c8a530b44ce3abf89b04ae4d798c'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:21.762842 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1064/2142] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:31:21 2022] DELETE /identity/v3/users/beb5c8a530b44ce3abf89b04ae4d798c => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:31:21.763769 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15151cf6-044e-4c39-a819-47ec6d88cd18 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:21.765176 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-15151cf6-044e-4c39-a819-47ec6d88cd18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:21.832763 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15151cf6-044e-4c39-a819-47ec6d88cd18 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:21.837452 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf74099-a3c9-4f37-8c46-101578a0459a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:21.838374 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf74099-a3c9-4f37-8c46-101578a0459a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:21.838665 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf74099-a3c9-4f37-8c46-101578a0459a admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:21.839811 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf74099-a3c9-4f37-8c46-101578a0459a admin admin] PATH_INFO: `/v3/users/314038692d1e4b0589c238b4f439823b` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:21.843533 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf74099-a3c9-4f37-8c46-101578a0459a admin admin] RBAC: Authorizing `identity:delete_user(user_id=314038692d1e4b0589c238b4f439823b)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:21.845690 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf74099-a3c9-4f37-8c46-101578a0459a admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:22.171147 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-07c4d53a-1ea3-4020-b30a-0c1c99b162d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb09b4b02b69435ea53cfb0e5e5fa82a'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:22.184278 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-07c4d53a-1ea3-4020-b30a-0c1c99b162d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb09b4b02b69435ea53cfb0e5e5fa82a'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:22.185030 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-07c4d53a-1ea3-4020-b30a-0c1c99b162d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb09b4b02b69435ea53cfb0e5e5fa82a'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:22.185674 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-07c4d53a-1ea3-4020-b30a-0c1c99b162d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb09b4b02b69435ea53cfb0e5e5fa82a'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:22.308933 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-07c4d53a-1ea3-4020-b30a-0c1c99b162d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb09b4b02b69435ea53cfb0e5e5fa82a'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:22.321082 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-4bf74099-a3c9-4f37-8c46-101578a0459a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '314038692d1e4b0589c238b4f439823b'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:22.324104 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1079/2143] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:31:21 2022] DELETE /identity/v3/users/fb09b4b02b69435ea53cfb0e5e5fa82a => generated 0 bytes in 743 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:31:22.325636 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1531e0-a73d-4b3c-9022-6bef368129a3 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:22.326442 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1531e0-a73d-4b3c-9022-6bef368129a3 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:22.326873 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1531e0-a73d-4b3c-9022-6bef368129a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:22.344728 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-4bf74099-a3c9-4f37-8c46-101578a0459a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '314038692d1e4b0589c238b4f439823b'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:22.345693 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-4bf74099-a3c9-4f37-8c46-101578a0459a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '314038692d1e4b0589c238b4f439823b'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:22.347338 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-4bf74099-a3c9-4f37-8c46-101578a0459a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '314038692d1e4b0589c238b4f439823b'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:22.383099 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-da1531e0-a73d-4b3c-9022-6bef368129a3 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:31:22.384417 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-da1531e0-a73d-4b3c-9022-6bef368129a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:22.439011 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-4bf74099-a3c9-4f37-8c46-101578a0459a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '314038692d1e4b0589c238b4f439823b'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:22.460121 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1065/2144] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:31:21 2022] DELETE /identity/v3/users/314038692d1e4b0589c238b4f439823b => generated 0 bytes in 697 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:31:22.488466 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1080/2145] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:31:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:31:22.508401 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf74099-a3c9-4f37-8c46-101578a0459a admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:22.512360 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-4bf74099-a3c9-4f37-8c46-101578a0459a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:22.512537 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:31:22.625383 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf74099-a3c9-4f37-8c46-101578a0459a admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:22.630047 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe41d1a9-2367-431d-86e3-ae9ca642f6b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:22.631352 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe41d1a9-2367-431d-86e3-ae9ca642f6b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:22.631352 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe41d1a9-2367-431d-86e3-ae9ca642f6b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:22.631526 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe41d1a9-2367-431d-86e3-ae9ca642f6b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:22.693414 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe41d1a9-2367-431d-86e3-ae9ca642f6b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:22.694915 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe41d1a9-2367-431d-86e3-ae9ca642f6b9 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:22.705388 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1066/2146] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:31:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:31:22.968314 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1531e0-a73d-4b3c-9022-6bef368129a3 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:22.969867 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-da1531e0-a73d-4b3c-9022-6bef368129a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:22.985820 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1531e0-a73d-4b3c-9022-6bef368129a3 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:23.005094 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7bf9e3-37de-442d-8fe7-adc494729a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:23.005094 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7bf9e3-37de-442d-8fe7-adc494729a15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:23.005094 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7bf9e3-37de-442d-8fe7-adc494729a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:23.005094 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7bf9e3-37de-442d-8fe7-adc494729a15 admin admin] PATH_INFO: `/v3/projects/83709d70214048d49061d17ca4486edc` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:23.006460 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7bf9e3-37de-442d-8fe7-adc494729a15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83709d70214048d49061d17ca4486edc)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:23.006460 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7bf9e3-37de-442d-8fe7-adc494729a15 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:23.090936 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe41d1a9-2367-431d-86e3-ae9ca642f6b9 service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:23.091425 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-fe41d1a9-2367-431d-86e3-ae9ca642f6b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:23.121576 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe41d1a9-2367-431d-86e3-ae9ca642f6b9 service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:23.127329 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3949afbe-e1ff-4c38-aa15-38c10497332a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:23.128766 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3949afbe-e1ff-4c38-aa15-38c10497332a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:23.129238 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3949afbe-e1ff-4c38-aa15-38c10497332a admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:23.129682 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3949afbe-e1ff-4c38-aa15-38c10497332a admin admin] PATH_INFO: `/v3/projects/8a9ad93ac30040898e325e08ed24f87c` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:23.131360 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3949afbe-e1ff-4c38-aa15-38c10497332a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a9ad93ac30040898e325e08ed24f87c)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:23.133936 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3949afbe-e1ff-4c38-aa15-38c10497332a admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:23.179233 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-eb7bf9e3-37de-442d-8fe7-adc494729a15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83709d70214048d49061d17ca4486edc', 'request_id': 'req-eb7bf9e3-37de-442d-8fe7-adc494729a15'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:23.215098 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-eb7bf9e3-37de-442d-8fe7-adc494729a15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83709d70214048d49061d17ca4486edc', 'request_id': 'req-eb7bf9e3-37de-442d-8fe7-adc494729a15'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:23.251129 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-eb7bf9e3-37de-442d-8fe7-adc494729a15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83709d70214048d49061d17ca4486edc', 'request_id': 'req-eb7bf9e3-37de-442d-8fe7-adc494729a15'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:23.355529 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-3949afbe-e1ff-4c38-aa15-38c10497332a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a9ad93ac30040898e325e08ed24f87c', 'request_id': 'req-3949afbe-e1ff-4c38-aa15-38c10497332a'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:23.364778 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-eb7bf9e3-37de-442d-8fe7-adc494729a15 admin admin] The token cache is being invalidate because project 83709d70214048d49061d17ca4486edc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80288) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:31:23.365249 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-eb7bf9e3-37de-442d-8fe7-adc494729a15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:23.366110 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-eb7bf9e3-37de-442d-8fe7-adc494729a15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:23.369142 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1081/2147] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:31:22 2022] DELETE /identity/v3/projects/83709d70214048d49061d17ca4486edc => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:31:23.374726 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a13ab-e444-4d22-bb17-31c7faa1d503 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:23.375264 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a13ab-e444-4d22-bb17-31c7faa1d503 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:23.375696 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a13ab-e444-4d22-bb17-31c7faa1d503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:23.414669 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-3949afbe-e1ff-4c38-aa15-38c10497332a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a9ad93ac30040898e325e08ed24f87c', 'request_id': 'req-3949afbe-e1ff-4c38-aa15-38c10497332a'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:23.445069 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-e31a13ab-e444-4d22-bb17-31c7faa1d503 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:31:23.459409 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-e31a13ab-e444-4d22-bb17-31c7faa1d503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:23.552882 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-3949afbe-e1ff-4c38-aa15-38c10497332a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a9ad93ac30040898e325e08ed24f87c', 'request_id': 'req-3949afbe-e1ff-4c38-aa15-38c10497332a'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:23.563409 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1082/2148] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:31:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:31:23.566065 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-3949afbe-e1ff-4c38-aa15-38c10497332a admin admin] The token cache is being invalidate because project 8a9ad93ac30040898e325e08ed24f87c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:31:23.566401 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-3949afbe-e1ff-4c38-aa15-38c10497332a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:23.567066 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-3949afbe-e1ff-4c38-aa15-38c10497332a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:23.568866 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1067/2149] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:31:23 2022] DELETE /identity/v3/projects/8a9ad93ac30040898e325e08ed24f87c => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:31:23.571319 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418b9b1-91db-491a-bc28-78bc22bd5a90 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:23.571504 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418b9b1-91db-491a-bc28-78bc22bd5a90 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:23.571790 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418b9b1-91db-491a-bc28-78bc22bd5a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:23.573527 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c192866-376b-4885-a505-ad4077c91f56 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:23.574068 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c192866-376b-4885-a505-ad4077c91f56 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:23.574538 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c192866-376b-4885-a505-ad4077c91f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:23.592043 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-6418b9b1-91db-491a-bc28-78bc22bd5a90 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:31:23.593176 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-7c192866-376b-4885-a505-ad4077c91f56 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:31:23.593509 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-6418b9b1-91db-491a-bc28-78bc22bd5a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:23.594594 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-7c192866-376b-4885-a505-ad4077c91f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:23.604276 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1068/2150] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:31:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:31:23.607473 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1083/2151] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:31:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:31:23.614603 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c192866-376b-4885-a505-ad4077c91f56 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:23.616246 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e389e25c-ddc2-4fda-9d96-2d128dd720b4 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:23.616544 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e389e25c-ddc2-4fda-9d96-2d128dd720b4 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:23.616830 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e389e25c-ddc2-4fda-9d96-2d128dd720b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:23.626617 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c192866-376b-4885-a505-ad4077c91f56 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:23.633746 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c519106-4331-4a52-a3ed-e52bf9a10a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:23.634620 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c519106-4331-4a52-a3ed-e52bf9a10a63 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:23.634911 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c519106-4331-4a52-a3ed-e52bf9a10a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:23.635736 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c519106-4331-4a52-a3ed-e52bf9a10a63 admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:23.636483 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c519106-4331-4a52-a3ed-e52bf9a10a63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:31:23.636794 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c519106-4331-4a52-a3ed-e52bf9a10a63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:23.636985 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-e389e25c-ddc2-4fda-9d96-2d128dd720b4 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:31:23.638206 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-e389e25c-ddc2-4fda-9d96-2d128dd720b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:23.638482 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c519106-4331-4a52-a3ed-e52bf9a10a63 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:23.646753 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1084/2152] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:31:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:31:23.650859 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e389e25c-ddc2-4fda-9d96-2d128dd720b4 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:23.654609 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1069/2153] 10.222.0.62 () {58 vars in 1152 bytes} [Fri May 27 16:31:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:31:23.655893 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c519106-4331-4a52-a3ed-e52bf9a10a63 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:23.662662 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e389e25c-ddc2-4fda-9d96-2d128dd720b4 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:23.668412 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c43f21-dd0f-4d2a-9be2-c85b1c78d214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:23.683116 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c43f21-dd0f-4d2a-9be2-c85b1c78d214 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:23.683116 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c43f21-dd0f-4d2a-9be2-c85b1c78d214 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:23.683116 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c43f21-dd0f-4d2a-9be2-c85b1c78d214 admin admin] PATH_INFO: `/v3/domains` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:23.683116 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c43f21-dd0f-4d2a-9be2-c85b1c78d214 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:31:23.683116 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c43f21-dd0f-4d2a-9be2-c85b1c78d214 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:23.683646 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c519106-4331-4a52-a3ed-e52bf9a10a63 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:23.683738 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c43f21-dd0f-4d2a-9be2-c85b1c78d214 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:23.683822 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34ce740-21ca-49c8-a996-e1fc768a2dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:23.683822 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34ce740-21ca-49c8-a996-e1fc768a2dd2 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:23.683822 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34ce740-21ca-49c8-a996-e1fc768a2dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:23.683822 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34ce740-21ca-49c8-a996-e1fc768a2dd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:23.684139 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34ce740-21ca-49c8-a996-e1fc768a2dd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:23.684139 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34ce740-21ca-49c8-a996-e1fc768a2dd2 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:23.687893 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1085/2154] 10.222.0.62 () {58 vars in 1152 bytes} [Fri May 27 16:31:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:31:23.692220 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c43f21-dd0f-4d2a-9be2-c85b1c78d214 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:23.702941 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c43f21-dd0f-4d2a-9be2-c85b1c78d214 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:23.708146 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962100f0-5bfd-496e-860a-d2a4245250b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:23.708896 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962100f0-5bfd-496e-860a-d2a4245250b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:23.709234 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962100f0-5bfd-496e-860a-d2a4245250b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:23.709443 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962100f0-5bfd-496e-860a-d2a4245250b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:23.710170 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962100f0-5bfd-496e-860a-d2a4245250b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:23.712332 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962100f0-5bfd-496e-860a-d2a4245250b4 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:23.729269 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:31:23.906567 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1070/2155] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:31:23 2022] POST /identity/v3/projects => generated 379 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:31:23.906567 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34ce740-21ca-49c8-a996-e1fc768a2dd2 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:23.906567 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-e34ce740-21ca-49c8-a996-e1fc768a2dd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:23.958313 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1086/2156] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:31:23 2022] POST /identity/v3/projects => generated 373 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:31:23.959160 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962100f0-5bfd-496e-860a-d2a4245250b4 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:23.967894 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34ce740-21ca-49c8-a996-e1fc768a2dd2 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:24.028020 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9027f83c-9859-4094-95cc-be05a3957c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:24.028207 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962100f0-5bfd-496e-860a-d2a4245250b4 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:24.028963 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9027f83c-9859-4094-95cc-be05a3957c19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:24.029247 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9027f83c-9859-4094-95cc-be05a3957c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:24.029532 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9027f83c-9859-4094-95cc-be05a3957c19 admin admin] PATH_INFO: `/v3/projects/72e16628fe62477abe892411987d77e6` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:24.030830 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9027f83c-9859-4094-95cc-be05a3957c19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72e16628fe62477abe892411987d77e6)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:24.032865 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9027f83c-9859-4094-95cc-be05a3957c19 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:24.033114 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d85bfa-12f9-4929-ab1c-e8b6284ce16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:24.033831 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d85bfa-12f9-4929-ab1c-e8b6284ce16a admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:24.034700 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d85bfa-12f9-4929-ab1c-e8b6284ce16a admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:24.034982 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d85bfa-12f9-4929-ab1c-e8b6284ce16a admin admin] PATH_INFO: `/v3/users` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:24.035715 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d85bfa-12f9-4929-ab1c-e8b6284ce16a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:24.037623 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d85bfa-12f9-4929-ab1c-e8b6284ce16a admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:24.184399 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1087/2157] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:31:23 2022] POST /identity/v3/users => generated 290 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:31:24.184399 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d85bfa-12f9-4929-ab1c-e8b6284ce16a admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:24.192467 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d85bfa-12f9-4929-ab1c-e8b6284ce16a admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:24.195861 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-9027f83c-9859-4094-95cc-be05a3957c19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72e16628fe62477abe892411987d77e6', 'request_id': 'req-9027f83c-9859-4094-95cc-be05a3957c19'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:24.202266 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-9027f83c-9859-4094-95cc-be05a3957c19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72e16628fe62477abe892411987d77e6', 'request_id': 'req-9027f83c-9859-4094-95cc-be05a3957c19'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:24.248987 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad60f042-2821-4c08-8765-0ec684c29cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:24.249666 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60f042-2821-4c08-8765-0ec684c29cdb admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:24.249958 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60f042-2821-4c08-8765-0ec684c29cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:24.250270 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60f042-2821-4c08-8765-0ec684c29cdb admin admin] PATH_INFO: `/v3/users` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:24.250966 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad60f042-2821-4c08-8765-0ec684c29cdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:24.253528 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad60f042-2821-4c08-8765-0ec684c29cdb admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:24.278356 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-9027f83c-9859-4094-95cc-be05a3957c19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72e16628fe62477abe892411987d77e6', 'request_id': 'req-9027f83c-9859-4094-95cc-be05a3957c19'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:24.289689 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-9027f83c-9859-4094-95cc-be05a3957c19 admin admin] The token cache is being invalidate because project 72e16628fe62477abe892411987d77e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:31:24.289984 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-9027f83c-9859-4094-95cc-be05a3957c19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:24.290629 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-9027f83c-9859-4094-95cc-be05a3957c19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:24.292202 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1071/2158] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:31:23 2022] DELETE /identity/v3/projects/72e16628fe62477abe892411987d77e6 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:31:24.293051 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9027f83c-9859-4094-95cc-be05a3957c19 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:24.294426 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-9027f83c-9859-4094-95cc-be05a3957c19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:24.306827 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9027f83c-9859-4094-95cc-be05a3957c19 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:24.312494 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ac9c7d-abc8-4dc8-8219-5b6fe6a37ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:24.313189 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac9c7d-abc8-4dc8-8219-5b6fe6a37ad3 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:24.313478 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac9c7d-abc8-4dc8-8219-5b6fe6a37ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:24.313761 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac9c7d-abc8-4dc8-8219-5b6fe6a37ad3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:24.314539 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ac9c7d-abc8-4dc8-8219-5b6fe6a37ad3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:24.316679 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ac9c7d-abc8-4dc8-8219-5b6fe6a37ad3 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:24.326663 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1072/2159] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:31:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:31:24.327436 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ac9c7d-abc8-4dc8-8219-5b6fe6a37ad3 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:24.329098 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-d1ac9c7d-abc8-4dc8-8219-5b6fe6a37ad3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:24.341713 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ac9c7d-abc8-4dc8-8219-5b6fe6a37ad3 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:24.347257 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293464cc-570c-4d05-a753-83b2671ad67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:24.348182 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293464cc-570c-4d05-a753-83b2671ad67d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:24.348491 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293464cc-570c-4d05-a753-83b2671ad67d admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:24.348743 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293464cc-570c-4d05-a753-83b2671ad67d admin admin] PATH_INFO: `/v3/users/94662e93cf4f42f486c9b91ac683f38d` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:24.350014 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293464cc-570c-4d05-a753-83b2671ad67d admin admin] RBAC: Authorizing `identity:delete_user(user_id=94662e93cf4f42f486c9b91ac683f38d)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:24.351996 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293464cc-570c-4d05-a753-83b2671ad67d admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:24.457224 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1088/2160] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:31:24 2022] POST /identity/v3/users => generated 287 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:31:24.458430 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad60f042-2821-4c08-8765-0ec684c29cdb admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:24.470312 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad60f042-2821-4c08-8765-0ec684c29cdb admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:24.477488 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef9a644-040f-48dc-a203-f4b5c82915f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:24.478208 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef9a644-040f-48dc-a203-f4b5c82915f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:24.478528 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef9a644-040f-48dc-a203-f4b5c82915f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:24.478809 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef9a644-040f-48dc-a203-f4b5c82915f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:24.479804 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef9a644-040f-48dc-a203-f4b5c82915f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:24.481443 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef9a644-040f-48dc-a203-f4b5c82915f4 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:24.493594 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1089/2161] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:31:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:31:24.494680 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef9a644-040f-48dc-a203-f4b5c82915f4 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:24.496571 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-bef9a644-040f-48dc-a203-f4b5c82915f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:24.510110 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef9a644-040f-48dc-a203-f4b5c82915f4 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:24.515493 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cea4b9c-3fed-4664-b520-2586358613a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:24.516173 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea4b9c-3fed-4664-b520-2586358613a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:24.516461 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea4b9c-3fed-4664-b520-2586358613a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:24.516743 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea4b9c-3fed-4664-b520-2586358613a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:24.517488 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cea4b9c-3fed-4664-b520-2586358613a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:24.519719 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cea4b9c-3fed-4664-b520-2586358613a9 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:24.535056 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1090/2162] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:31:24 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:31:24.535056 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cea4b9c-3fed-4664-b520-2586358613a9 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:24.553460 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cea4b9c-3fed-4664-b520-2586358613a9 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:24.559006 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6cd505-e19f-4012-9c7e-89633a1b230d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:24.560054 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6cd505-e19f-4012-9c7e-89633a1b230d admin admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:24.560448 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6cd505-e19f-4012-9c7e-89633a1b230d admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:24.560855 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6cd505-e19f-4012-9c7e-89633a1b230d admin admin] PATH_INFO: `/v3/projects/13fba9ac0bfc4062bceb8a64c02a1e12/users/f0b649166f8f4eaaa2700ef310986c9b/roles/c8ce6d197f654598ac45f6016ecccabd` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:24.580260 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6cd505-e19f-4012-9c7e-89633a1b230d admin admin] RBAC: Authorizing `identity:create_grant(project_id=13fba9ac0bfc4062bceb8a64c02a1e12, user_id=f0b649166f8f4eaaa2700ef310986c9b, role_id=c8ce6d197f654598ac45f6016ecccabd)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:24.583734 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6cd505-e19f-4012-9c7e-89633a1b230d admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:24.674585 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1091/2163] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:31:24 2022] PUT /identity/v3/projects/13fba9ac0bfc4062bceb8a64c02a1e12/users/f0b649166f8f4eaaa2700ef310986c9b/roles/c8ce6d197f654598ac45f6016ecccabd => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:31:24.674585 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6cd505-e19f-4012-9c7e-89633a1b230d admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:24.692709 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-293464cc-570c-4d05-a753-83b2671ad67d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94662e93cf4f42f486c9b91ac683f38d'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:24.703497 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-293464cc-570c-4d05-a753-83b2671ad67d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94662e93cf4f42f486c9b91ac683f38d'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:24.704235 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-293464cc-570c-4d05-a753-83b2671ad67d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94662e93cf4f42f486c9b91ac683f38d'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:24.704856 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-293464cc-570c-4d05-a753-83b2671ad67d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94662e93cf4f42f486c9b91ac683f38d'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:24.746913 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6cd505-e19f-4012-9c7e-89633a1b230d admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:24.751684 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15055ad-5c01-4d82-adf5-91c9cc527940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:24.752351 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15055ad-5c01-4d82-adf5-91c9cc527940 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:24.752664 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15055ad-5c01-4d82-adf5-91c9cc527940 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:24.752939 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15055ad-5c01-4d82-adf5-91c9cc527940 admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:24.753662 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15055ad-5c01-4d82-adf5-91c9cc527940 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:24.755534 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15055ad-5c01-4d82-adf5-91c9cc527940 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:24.765550 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1092/2164] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:31:24 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:31:24.767163 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44bf898-66bb-45d5-8bc8-476eeb74cd86 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:24.767163 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44bf898-66bb-45d5-8bc8-476eeb74cd86 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:24.767431 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44bf898-66bb-45d5-8bc8-476eeb74cd86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:24.795489 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-c44bf898-66bb-45d5-8bc8-476eeb74cd86 None None] MFA Rules not processed for user `f0b649166f8f4eaaa2700ef310986c9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:31:24.796824 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-c44bf898-66bb-45d5-8bc8-476eeb74cd86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:24.849866 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-293464cc-570c-4d05-a753-83b2671ad67d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94662e93cf4f42f486c9b91ac683f38d'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:24.862565 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1093/2165] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:31:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:31:24.863224 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44bf898-66bb-45d5-8bc8-476eeb74cd86 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:24.864528 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-c44bf898-66bb-45d5-8bc8-476eeb74cd86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:24.876950 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1073/2166] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:31:24 2022] DELETE /identity/v3/users/94662e93cf4f42f486c9b91ac683f38d => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:31:24.878505 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293464cc-570c-4d05-a753-83b2671ad67d admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:24.880073 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-293464cc-570c-4d05-a753-83b2671ad67d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:24.887674 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44bf898-66bb-45d5-8bc8-476eeb74cd86 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:24.958859 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9770db9-f3d2-43ba-a0d3-639429e7f0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:24.959814 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9770db9-f3d2-43ba-a0d3-639429e7f0ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:24.960091 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9770db9-f3d2-43ba-a0d3-639429e7f0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:24.960426 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9770db9-f3d2-43ba-a0d3-639429e7f0ea admin admin] PATH_INFO: `/v3/projects/eacf7ad63d954bb3891473308346e548/users/4025e748e7674fd3b92dc6c80ae94740/roles/c8ce6d197f654598ac45f6016ecccabd` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:24.973150 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293464cc-570c-4d05-a753-83b2671ad67d admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:24.975827 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb371e58-0e03-44c3-b8c5-f2545b523f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:24.976793 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb371e58-0e03-44c3-b8c5-f2545b523f03 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:24.977179 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb371e58-0e03-44c3-b8c5-f2545b523f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:24.977586 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb371e58-0e03-44c3-b8c5-f2545b523f03 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:24.978473 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb371e58-0e03-44c3-b8c5-f2545b523f03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:24.980701 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb371e58-0e03-44c3-b8c5-f2545b523f03 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:24.982178 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9770db9-f3d2-43ba-a0d3-639429e7f0ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=eacf7ad63d954bb3891473308346e548, user_id=4025e748e7674fd3b92dc6c80ae94740, role_id=c8ce6d197f654598ac45f6016ecccabd)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:24.985327 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9770db9-f3d2-43ba-a0d3-639429e7f0ea admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:25.143289 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1094/2167] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:31:24 2022] PUT /identity/v3/projects/eacf7ad63d954bb3891473308346e548/users/4025e748e7674fd3b92dc6c80ae94740/roles/c8ce6d197f654598ac45f6016ecccabd => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:31:25.147976 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188af02c-5b41-496d-9109-25f723e3b0c1 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:25.148275 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188af02c-5b41-496d-9109-25f723e3b0c1 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:25.148559 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188af02c-5b41-496d-9109-25f723e3b0c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:25.152670 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1074/2168] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:31:24 2022] POST /identity/v3/projects => generated 379 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:31:25.155880 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb371e58-0e03-44c3-b8c5-f2545b523f03 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:25.175624 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-188af02c-5b41-496d-9109-25f723e3b0c1 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:31:25.179633 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-188af02c-5b41-496d-9109-25f723e3b0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:25.256013 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb371e58-0e03-44c3-b8c5-f2545b523f03 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:25.261700 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8765db-6a06-43f8-8a79-7201c7d4b7db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:25.262612 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8765db-6a06-43f8-8a79-7201c7d4b7db admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:25.263397 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8765db-6a06-43f8-8a79-7201c7d4b7db admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:25.263861 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8765db-6a06-43f8-8a79-7201c7d4b7db admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:25.265549 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8765db-6a06-43f8-8a79-7201c7d4b7db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:25.268856 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8765db-6a06-43f8-8a79-7201c7d4b7db admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:25.284219 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1095/2169] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:31:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:31:25.294018 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188af02c-5b41-496d-9109-25f723e3b0c1 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:25.295576 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-188af02c-5b41-496d-9109-25f723e3b0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:25.353982 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188af02c-5b41-496d-9109-25f723e3b0c1 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:25.360823 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae9b74e-b349-4458-b5b2-296227ce8262 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:25.361754 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae9b74e-b349-4458-b5b2-296227ce8262 service neutron] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:25.362622 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae9b74e-b349-4458-b5b2-296227ce8262 service neutron] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:25.362927 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae9b74e-b349-4458-b5b2-296227ce8262 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:25.373229 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae9b74e-b349-4458-b5b2-296227ce8262 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:25.374769 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae9b74e-b349-4458-b5b2-296227ce8262 service neutron] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:25.386338 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1096/2170] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:31:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 16:31:25.423822 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1075/2171] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:31:25 2022] POST /identity/v3/users => generated 296 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:31:25.431140 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae9b74e-b349-4458-b5b2-296227ce8262 service neutron] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:25.444288 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae9b74e-b349-4458-b5b2-296227ce8262 service neutron] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:25.449580 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd2f84f-07da-4172-ba75-2b45cde8ace0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:25.450297 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2f84f-07da-4172-ba75-2b45cde8ace0 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:25.450593 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2f84f-07da-4172-ba75-2b45cde8ace0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:25.450908 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2f84f-07da-4172-ba75-2b45cde8ace0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:25.451676 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd2f84f-07da-4172-ba75-2b45cde8ace0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:25.453275 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd2f84f-07da-4172-ba75-2b45cde8ace0 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:25.466594 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1097/2172] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:31:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:31:25.470186 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8765db-6a06-43f8-8a79-7201c7d4b7db admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:25.481899 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8765db-6a06-43f8-8a79-7201c7d4b7db admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:25.488211 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceedbf1e-b142-4cff-85af-8cbbd5d83e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:25.489288 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceedbf1e-b142-4cff-85af-8cbbd5d83e19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:25.489623 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceedbf1e-b142-4cff-85af-8cbbd5d83e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:25.489907 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceedbf1e-b142-4cff-85af-8cbbd5d83e19 admin admin] PATH_INFO: `/v3/projects/a8cfcbe2443847738da8ec895189f0e1/users/72848db371f4462ea139132696bf9648/roles/e04fe3eb1f714d74901ac83e33ea8a16` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:25.509343 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceedbf1e-b142-4cff-85af-8cbbd5d83e19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8cfcbe2443847738da8ec895189f0e1, user_id=72848db371f4462ea139132696bf9648, role_id=e04fe3eb1f714d74901ac83e33ea8a16)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:25.512735 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceedbf1e-b142-4cff-85af-8cbbd5d83e19 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:25.655639 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1076/2173] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:31:25 2022] PUT /identity/v3/projects/a8cfcbe2443847738da8ec895189f0e1/users/72848db371f4462ea139132696bf9648/roles/e04fe3eb1f714d74901ac83e33ea8a16 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:31:25.660327 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd2f84f-07da-4172-ba75-2b45cde8ace0 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:25.670546 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd2f84f-07da-4172-ba75-2b45cde8ace0 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:25.728963 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fbba1c-460b-49b0-9f1d-0aa9d95ec570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:25.729738 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fbba1c-460b-49b0-9f1d-0aa9d95ec570 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:25.730026 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fbba1c-460b-49b0-9f1d-0aa9d95ec570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:25.730417 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fbba1c-460b-49b0-9f1d-0aa9d95ec570 admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:25.731184 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fbba1c-460b-49b0-9f1d-0aa9d95ec570 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:25.732883 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fbba1c-460b-49b0-9f1d-0aa9d95ec570 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:25.743936 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1098/2174] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:31:25 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 16:31:25.749093 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceedbf1e-b142-4cff-85af-8cbbd5d83e19 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:25.760766 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceedbf1e-b142-4cff-85af-8cbbd5d83e19 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:25.765610 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85b9ea8-2493-46a4-a90d-c3547d69d2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:25.766559 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b9ea8-2493-46a4-a90d-c3547d69d2f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:25.766866 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b9ea8-2493-46a4-a90d-c3547d69d2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:25.767141 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b9ea8-2493-46a4-a90d-c3547d69d2f6 admin admin] PATH_INFO: `/v3/projects/a8cfcbe2443847738da8ec895189f0e1/users/72848db371f4462ea139132696bf9648/roles/e04fe3eb1f714d74901ac83e33ea8a16` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:25.769201 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85b9ea8-2493-46a4-a90d-c3547d69d2f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8cfcbe2443847738da8ec895189f0e1, user_id=72848db371f4462ea139132696bf9648, role_id=e04fe3eb1f714d74901ac83e33ea8a16)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:25.771969 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85b9ea8-2493-46a4-a90d-c3547d69d2f6 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:25.789655 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fbba1c-460b-49b0-9f1d-0aa9d95ec570 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:25.801062 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-49fbba1c-460b-49b0-9f1d-0aa9d95ec570 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:25.801609 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1077/2175] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:31:25 2022] PUT /identity/v3/projects/a8cfcbe2443847738da8ec895189f0e1/users/72848db371f4462ea139132696bf9648/roles/e04fe3eb1f714d74901ac83e33ea8a16 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:31:25.811884 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93454f56-ca19-420d-80ea-2bf7b5781502 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:25.812418 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93454f56-ca19-420d-80ea-2bf7b5781502 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:25.812861 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93454f56-ca19-420d-80ea-2bf7b5781502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:25.816184 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fbba1c-460b-49b0-9f1d-0aa9d95ec570 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:25.823138 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:31:25.873167 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-93454f56-ca19-420d-80ea-2bf7b5781502 None None] MFA Rules not processed for user `72848db371f4462ea139132696bf9648`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:31:25.875306 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-93454f56-ca19-420d-80ea-2bf7b5781502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:25.927215 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fbd415-846a-4d4c-a1a1-0fa2398c3702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:25.929182 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fbd415-846a-4d4c-a1a1-0fa2398c3702 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:25.929182 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fbd415-846a-4d4c-a1a1-0fa2398c3702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:25.929550 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fbd415-846a-4d4c-a1a1-0fa2398c3702 admin admin] PATH_INFO: `/v3/projects/c74e9355689e458da6dace1a1bb6c955` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:25.931414 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fbd415-846a-4d4c-a1a1-0fa2398c3702 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c74e9355689e458da6dace1a1bb6c955)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:25.935763 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fbd415-846a-4d4c-a1a1-0fa2398c3702 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:26.015952 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1078/2176] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:31:25 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:31:26.028592 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93454f56-ca19-420d-80ea-2bf7b5781502 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:26.030081 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-93454f56-ca19-420d-80ea-2bf7b5781502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:26.106974 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93454f56-ca19-420d-80ea-2bf7b5781502 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:26.110964 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3806b029-3cc3-47f0-9f39-7bc2e25f2c51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8693a1e72f14fdfb383f11e96330726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:26.112568 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3806b029-3cc3-47f0-9f39-7bc2e25f2c51 service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:26.112855 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3806b029-3cc3-47f0-9f39-7bc2e25f2c51 service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:26.121497 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3806b029-3cc3-47f0-9f39-7bc2e25f2c51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:26.123298 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3806b029-3cc3-47f0-9f39-7bc2e25f2c51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:26.124737 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3806b029-3cc3-47f0-9f39-7bc2e25f2c51 service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:26.136466 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1079/2177] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:31:26 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 16:31:26.165031 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-d5fbd415-846a-4d4c-a1a1-0fa2398c3702 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c74e9355689e458da6dace1a1bb6c955', 'request_id': 'req-d5fbd415-846a-4d4c-a1a1-0fa2398c3702'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:26.176055 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-d5fbd415-846a-4d4c-a1a1-0fa2398c3702 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c74e9355689e458da6dace1a1bb6c955', 'request_id': 'req-d5fbd415-846a-4d4c-a1a1-0fa2398c3702'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:26.182970 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-d5fbd415-846a-4d4c-a1a1-0fa2398c3702 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c74e9355689e458da6dace1a1bb6c955', 'request_id': 'req-d5fbd415-846a-4d4c-a1a1-0fa2398c3702'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:26.420451 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-d5fbd415-846a-4d4c-a1a1-0fa2398c3702 admin admin] The token cache is being invalidate because project c74e9355689e458da6dace1a1bb6c955 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80288) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:31:26.421086 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-d5fbd415-846a-4d4c-a1a1-0fa2398c3702 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:26.421737 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-d5fbd415-846a-4d4c-a1a1-0fa2398c3702 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:26.423662 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1099/2178] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:31:25 2022] DELETE /identity/v3/projects/c74e9355689e458da6dace1a1bb6c955 => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:31:26.427845 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3806b029-3cc3-47f0-9f39-7bc2e25f2c51 service cinder] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:26.439691 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3806b029-3cc3-47f0-9f39-7bc2e25f2c51 service cinder] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:26.534002 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccaee83-821a-4404-a948-59d605fbf71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:26.534960 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccaee83-821a-4404-a948-59d605fbf71f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:26.535249 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccaee83-821a-4404-a948-59d605fbf71f admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:26.535528 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccaee83-821a-4404-a948-59d605fbf71f admin admin] PATH_INFO: `/v3/users/4e869e57bb0d45b299ec88df801880eb` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:26.536719 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccaee83-821a-4404-a948-59d605fbf71f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e869e57bb0d45b299ec88df801880eb)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:26.538756 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccaee83-821a-4404-a948-59d605fbf71f admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:26.829175 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-1ccaee83-821a-4404-a948-59d605fbf71f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e869e57bb0d45b299ec88df801880eb'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:26.838491 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-1ccaee83-821a-4404-a948-59d605fbf71f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e869e57bb0d45b299ec88df801880eb'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:26.839297 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-1ccaee83-821a-4404-a948-59d605fbf71f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e869e57bb0d45b299ec88df801880eb'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:26.839923 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-1ccaee83-821a-4404-a948-59d605fbf71f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e869e57bb0d45b299ec88df801880eb'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:27.017414 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-1ccaee83-821a-4404-a948-59d605fbf71f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e869e57bb0d45b299ec88df801880eb'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:27.057464 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1080/2179] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:31:26 2022] DELETE /identity/v3/users/4e869e57bb0d45b299ec88df801880eb => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:31:27.086395 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fbd415-846a-4d4c-a1a1-0fa2398c3702 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:27.087824 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-d5fbd415-846a-4d4c-a1a1-0fa2398c3702 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:27.128804 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fbd415-846a-4d4c-a1a1-0fa2398c3702 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:27.189649 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d4d547-5e33-4266-921e-3ddc35a0488f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:27.190639 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4d547-5e33-4266-921e-3ddc35a0488f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:27.190926 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4d547-5e33-4266-921e-3ddc35a0488f admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:27.191205 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4d547-5e33-4266-921e-3ddc35a0488f admin admin] PATH_INFO: `/v3/users/3467afbebc424284a603901c2a15591a` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:27.192420 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d4d547-5e33-4266-921e-3ddc35a0488f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3467afbebc424284a603901c2a15591a)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:27.194428 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d4d547-5e33-4266-921e-3ddc35a0488f admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:27.248185 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccaee83-821a-4404-a948-59d605fbf71f admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:27.254971 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-1ccaee83-821a-4404-a948-59d605fbf71f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:27.292536 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccaee83-821a-4404-a948-59d605fbf71f admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:27.297210 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3148463c-4ec7-4cff-b237-b4d72d688589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:27.298115 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3148463c-4ec7-4cff-b237-b4d72d688589 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:27.298433 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3148463c-4ec7-4cff-b237-b4d72d688589 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:27.298713 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3148463c-4ec7-4cff-b237-b4d72d688589 admin admin] PATH_INFO: `/v3/users/f0b649166f8f4eaaa2700ef310986c9b` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:27.299950 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3148463c-4ec7-4cff-b237-b4d72d688589 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0b649166f8f4eaaa2700ef310986c9b)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:27.301869 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3148463c-4ec7-4cff-b237-b4d72d688589 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:27.432042 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-60d4d547-5e33-4266-921e-3ddc35a0488f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3467afbebc424284a603901c2a15591a'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:27.446971 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-60d4d547-5e33-4266-921e-3ddc35a0488f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3467afbebc424284a603901c2a15591a'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:27.447869 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-60d4d547-5e33-4266-921e-3ddc35a0488f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3467afbebc424284a603901c2a15591a'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:27.448553 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-60d4d547-5e33-4266-921e-3ddc35a0488f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3467afbebc424284a603901c2a15591a'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:27.454654 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:31:27.557748 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-60d4d547-5e33-4266-921e-3ddc35a0488f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3467afbebc424284a603901c2a15591a'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:27.570804 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1100/2180] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:31:27 2022] DELETE /identity/v3/users/3467afbebc424284a603901c2a15591a => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:31:27.571898 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-3148463c-4ec7-4cff-b237-b4d72d688589 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0b649166f8f4eaaa2700ef310986c9b'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:27.572072 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b546167-bfa6-4dd6-9a57-b2efdab9c1f5 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:27.572364 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b546167-bfa6-4dd6-9a57-b2efdab9c1f5 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:27.572643 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b546167-bfa6-4dd6-9a57-b2efdab9c1f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:27.579294 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-3148463c-4ec7-4cff-b237-b4d72d688589 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0b649166f8f4eaaa2700ef310986c9b'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:27.580182 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-3148463c-4ec7-4cff-b237-b4d72d688589 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0b649166f8f4eaaa2700ef310986c9b'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:27.581307 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-3148463c-4ec7-4cff-b237-b4d72d688589 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0b649166f8f4eaaa2700ef310986c9b'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:27.606389 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-1b546167-bfa6-4dd6-9a57-b2efdab9c1f5 None None] MFA Rules not processed for user `4025e748e7674fd3b92dc6c80ae94740`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:31:27.607862 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-1b546167-bfa6-4dd6-9a57-b2efdab9c1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:27.673841 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1101/2181] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:31:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:31:27.675721 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1423d6f-f64e-48c4-a47b-f52782f22be9 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:27.676016 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1423d6f-f64e-48c4-a47b-f52782f22be9 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:27.676298 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1423d6f-f64e-48c4-a47b-f52782f22be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:27.694392 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-b1423d6f-f64e-48c4-a47b-f52782f22be9 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:31:27.695699 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-b1423d6f-f64e-48c4-a47b-f52782f22be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:27.704369 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-3148463c-4ec7-4cff-b237-b4d72d688589 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0b649166f8f4eaaa2700ef310986c9b'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:27.722652 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1081/2182] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:31:27 2022] DELETE /identity/v3/users/f0b649166f8f4eaaa2700ef310986c9b => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:31:27.723657 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3148463c-4ec7-4cff-b237-b4d72d688589 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:27.725172 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-3148463c-4ec7-4cff-b237-b4d72d688589 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:27.754529 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1102/2183] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:31:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:31:27.755597 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1423d6f-f64e-48c4-a47b-f52782f22be9 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:27.756909 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-b1423d6f-f64e-48c4-a47b-f52782f22be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:27.769796 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1423d6f-f64e-48c4-a47b-f52782f22be9 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:27.793192 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3148463c-4ec7-4cff-b237-b4d72d688589 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:27.797882 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed89f327-8a85-4240-bbbe-117d42203a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:27.798792 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed89f327-8a85-4240-bbbe-117d42203a88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:27.799068 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed89f327-8a85-4240-bbbe-117d42203a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:27.802120 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed89f327-8a85-4240-bbbe-117d42203a88 admin admin] PATH_INFO: `/v3/projects/17e9e51a0e4d411cbe243298646d9fb0` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:27.802120 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed89f327-8a85-4240-bbbe-117d42203a88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17e9e51a0e4d411cbe243298646d9fb0)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:27.803015 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed89f327-8a85-4240-bbbe-117d42203a88 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:27.827606 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6455fc4f-9b7a-4551-9a19-480db5c1b7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:27.828269 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455fc4f-9b7a-4551-9a19-480db5c1b7c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:27.828560 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455fc4f-9b7a-4551-9a19-480db5c1b7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:27.828846 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455fc4f-9b7a-4551-9a19-480db5c1b7c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:27.829534 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6455fc4f-9b7a-4551-9a19-480db5c1b7c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:27.831517 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6455fc4f-9b7a-4551-9a19-480db5c1b7c7 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:27.969546 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-ed89f327-8a85-4240-bbbe-117d42203a88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17e9e51a0e4d411cbe243298646d9fb0', 'request_id': 'req-ed89f327-8a85-4240-bbbe-117d42203a88'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:27.976478 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-ed89f327-8a85-4240-bbbe-117d42203a88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17e9e51a0e4d411cbe243298646d9fb0', 'request_id': 'req-ed89f327-8a85-4240-bbbe-117d42203a88'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:28.002156 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1103/2184] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:31:27 2022] POST /identity/v3/projects => generated 373 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:31:28.002156 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f414f-a934-4e1b-9603-8936308f22ef None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:28.002156 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f414f-a934-4e1b-9603-8936308f22ef None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:28.002156 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f414f-a934-4e1b-9603-8936308f22ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:28.016074 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-8e8f414f-a934-4e1b-9603-8936308f22ef None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:31:28.017285 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-8e8f414f-a934-4e1b-9603-8936308f22ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:28.067640 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-ed89f327-8a85-4240-bbbe-117d42203a88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17e9e51a0e4d411cbe243298646d9fb0', 'request_id': 'req-ed89f327-8a85-4240-bbbe-117d42203a88'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:28.072746 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-ed89f327-8a85-4240-bbbe-117d42203a88 admin admin] The token cache is being invalidate because project 17e9e51a0e4d411cbe243298646d9fb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:31:28.073038 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-ed89f327-8a85-4240-bbbe-117d42203a88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:28.073677 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-ed89f327-8a85-4240-bbbe-117d42203a88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:28.075535 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1082/2185] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:31:27 2022] DELETE /identity/v3/projects/17e9e51a0e4d411cbe243298646d9fb0 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:31:28.078806 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed89f327-8a85-4240-bbbe-117d42203a88 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:28.078806 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-ed89f327-8a85-4240-bbbe-117d42203a88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:28.079750 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1104/2186] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:31:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:31:28.080631 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f414f-a934-4e1b-9603-8936308f22ef None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:28.082119 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-8e8f414f-a934-4e1b-9603-8936308f22ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:28.093921 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f414f-a934-4e1b-9603-8936308f22ef None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:28.099211 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a59118-6b8a-4c46-8eb6-04f81cb38c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:28.099877 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a59118-6b8a-4c46-8eb6-04f81cb38c77 admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:28.100160 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a59118-6b8a-4c46-8eb6-04f81cb38c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:28.100435 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a59118-6b8a-4c46-8eb6-04f81cb38c77 admin admin] PATH_INFO: `/v3/users` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:28.101119 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a59118-6b8a-4c46-8eb6-04f81cb38c77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:28.103080 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a59118-6b8a-4c46-8eb6-04f81cb38c77 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:28.138929 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed89f327-8a85-4240-bbbe-117d42203a88 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:28.194411 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1105/2187] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:31:28 2022] POST /identity/v3/users => generated 293 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:31:28.195584 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a59118-6b8a-4c46-8eb6-04f81cb38c77 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:28.199886 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-e0a59118-6b8a-4c46-8eb6-04f81cb38c77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:28.202201 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f045c4-841b-4849-a11d-39ce4d7711ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:28.204114 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f045c4-841b-4849-a11d-39ce4d7711ca service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:28.204528 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f045c4-841b-4849-a11d-39ce4d7711ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:28.204909 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f045c4-841b-4849-a11d-39ce4d7711ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:28.207750 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-15f045c4-841b-4849-a11d-39ce4d7711ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:28.225881 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f045c4-841b-4849-a11d-39ce4d7711ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:28.225995 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a59118-6b8a-4c46-8eb6-04f81cb38c77 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:28.226089 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f045c4-841b-4849-a11d-39ce4d7711ca service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:28.237843 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f281f4-f50d-4761-a6b1-648129a3964f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:28.238836 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f281f4-f50d-4761-a6b1-648129a3964f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:28.239194 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f281f4-f50d-4761-a6b1-648129a3964f admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:28.239604 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f281f4-f50d-4761-a6b1-648129a3964f admin admin] PATH_INFO: `/v3/users/0849b14e56a44d2ba11ae32b484bcab8` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:28.241596 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1083/2188] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:31:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:31:28.243976 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f281f4-f50d-4761-a6b1-648129a3964f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0849b14e56a44d2ba11ae32b484bcab8)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:28.246092 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f281f4-f50d-4761-a6b1-648129a3964f admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:28.256249 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa21f1-dcc6-4ea2-9fa2-9463a4fc8f27 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:28.257076 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa21f1-dcc6-4ea2-9fa2-9463a4fc8f27 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:28.257578 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa21f1-dcc6-4ea2-9fa2-9463a4fc8f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:28.300172 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-bcfa21f1-dcc6-4ea2-9fa2-9463a4fc8f27 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:31:28.301417 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-bcfa21f1-dcc6-4ea2-9fa2-9463a4fc8f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:28.310895 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1084/2189] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:31:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:31:28.311922 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfa21f1-dcc6-4ea2-9fa2-9463a4fc8f27 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:28.322221 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfa21f1-dcc6-4ea2-9fa2-9463a4fc8f27 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:28.326214 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7731299c-066a-4a7b-8fe5-91d69714d70d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:28.326889 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7731299c-066a-4a7b-8fe5-91d69714d70d service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:28.331319 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7731299c-066a-4a7b-8fe5-91d69714d70d service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:28.331319 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7731299c-066a-4a7b-8fe5-91d69714d70d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:28.338766 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7731299c-066a-4a7b-8fe5-91d69714d70d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:28.340389 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7731299c-066a-4a7b-8fe5-91d69714d70d service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:28.352264 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1085/2190] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:31:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:31:28.353102 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7731299c-066a-4a7b-8fe5-91d69714d70d service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:28.362336 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7731299c-066a-4a7b-8fe5-91d69714d70d service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:28.366956 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def76962-b11c-40b7-be5b-eea99d7be96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:28.367669 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def76962-b11c-40b7-be5b-eea99d7be96f admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:28.367957 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def76962-b11c-40b7-be5b-eea99d7be96f admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:28.368236 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def76962-b11c-40b7-be5b-eea99d7be96f admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:28.368991 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def76962-b11c-40b7-be5b-eea99d7be96f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:28.370629 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def76962-b11c-40b7-be5b-eea99d7be96f admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:28.380904 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1086/2191] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:31:28 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:31:28.382078 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e1d03-4706-42ba-a17a-f742cd420b89 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:28.382396 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e1d03-4706-42ba-a17a-f742cd420b89 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:28.382679 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e1d03-4706-42ba-a17a-f742cd420b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:28.402977 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-622e1d03-4706-42ba-a17a-f742cd420b89 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:31:28.404199 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-622e1d03-4706-42ba-a17a-f742cd420b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:28.412728 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1087/2192] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:31:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:31:28.415301 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622e1d03-4706-42ba-a17a-f742cd420b89 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:28.426275 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622e1d03-4706-42ba-a17a-f742cd420b89 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:28.431270 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded7bdcf-9247-49dc-8ea4-7d79ade949ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:28.435645 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7bdcf-9247-49dc-8ea4-7d79ade949ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:28.435942 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7bdcf-9247-49dc-8ea4-7d79ade949ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:28.436213 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7bdcf-9247-49dc-8ea4-7d79ade949ca admin admin] PATH_INFO: `/v3/projects/f2583b2d74f4436a8a9acae11b868c24/users/a9e89eb14e1e4eeb99b5c925fa5a3582/roles/e04fe3eb1f714d74901ac83e33ea8a16` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:28.452040 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded7bdcf-9247-49dc-8ea4-7d79ade949ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2583b2d74f4436a8a9acae11b868c24, user_id=a9e89eb14e1e4eeb99b5c925fa5a3582, role_id=e04fe3eb1f714d74901ac83e33ea8a16)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:28.454718 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded7bdcf-9247-49dc-8ea4-7d79ade949ca admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:28.638096 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1088/2193] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:31:28 2022] PUT /identity/v3/projects/f2583b2d74f4436a8a9acae11b868c24/users/a9e89eb14e1e4eeb99b5c925fa5a3582/roles/e04fe3eb1f714d74901ac83e33ea8a16 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:31:28.638096 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded7bdcf-9247-49dc-8ea4-7d79ade949ca admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:28.644193 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-40f281f4-f50d-4761-a6b1-648129a3964f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0849b14e56a44d2ba11ae32b484bcab8'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:28.661733 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-40f281f4-f50d-4761-a6b1-648129a3964f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0849b14e56a44d2ba11ae32b484bcab8'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:28.664243 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-40f281f4-f50d-4761-a6b1-648129a3964f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0849b14e56a44d2ba11ae32b484bcab8'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:28.664243 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-40f281f4-f50d-4761-a6b1-648129a3964f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0849b14e56a44d2ba11ae32b484bcab8'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:28.710182 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded7bdcf-9247-49dc-8ea4-7d79ade949ca admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:28.715124 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3eaffd-2940-46c7-97ec-dd3edf3cd23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:28.715799 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3eaffd-2940-46c7-97ec-dd3edf3cd23e admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:28.716088 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3eaffd-2940-46c7-97ec-dd3edf3cd23e admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:28.716373 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3eaffd-2940-46c7-97ec-dd3edf3cd23e admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:28.717144 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3eaffd-2940-46c7-97ec-dd3edf3cd23e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:31:28.717460 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3eaffd-2940-46c7-97ec-dd3edf3cd23e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:28.719129 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3eaffd-2940-46c7-97ec-dd3edf3cd23e admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:28.735478 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1089/2194] 10.222.0.62 () {58 vars in 1152 bytes} [Fri May 27 16:31:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:31:28.735478 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3eaffd-2940-46c7-97ec-dd3edf3cd23e admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:28.735478 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-8e3eaffd-2940-46c7-97ec-dd3edf3cd23e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:28.750948 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3eaffd-2940-46c7-97ec-dd3edf3cd23e admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:28.756669 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aa22f4-acf3-435b-8c44-6efb6944e457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:28.757367 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa22f4-acf3-435b-8c44-6efb6944e457 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:28.757652 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa22f4-acf3-435b-8c44-6efb6944e457 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:28.757927 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa22f4-acf3-435b-8c44-6efb6944e457 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:28.758703 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aa22f4-acf3-435b-8c44-6efb6944e457 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:28.760312 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aa22f4-acf3-435b-8c44-6efb6944e457 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:28.764740 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-40f281f4-f50d-4761-a6b1-648129a3964f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0849b14e56a44d2ba11ae32b484bcab8'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:28.772721 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1090/2195] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:31:28 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:31:28.773611 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aa22f4-acf3-435b-8c44-6efb6944e457 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:28.775388 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-a7aa22f4-acf3-435b-8c44-6efb6944e457 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:28.786639 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1106/2196] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:31:28 2022] DELETE /identity/v3/users/0849b14e56a44d2ba11ae32b484bcab8 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:31:28.786639 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f281f4-f50d-4761-a6b1-648129a3964f admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:28.789541 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aa22f4-acf3-435b-8c44-6efb6944e457 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:28.853297 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f281f4-f50d-4761-a6b1-648129a3964f admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:28.858768 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbda5e6b-9cf0-45e3-8eb0-9a0f2e688e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:28.859865 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda5e6b-9cf0-45e3-8eb0-9a0f2e688e06 admin admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:28.860211 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda5e6b-9cf0-45e3-8eb0-9a0f2e688e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:28.860650 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda5e6b-9cf0-45e3-8eb0-9a0f2e688e06 admin admin] PATH_INFO: `/v3/projects/f2583b2d74f4436a8a9acae11b868c24/users/a9e89eb14e1e4eeb99b5c925fa5a3582/roles/e04fe3eb1f714d74901ac83e33ea8a16` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:28.863281 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbda5e6b-9cf0-45e3-8eb0-9a0f2e688e06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2583b2d74f4436a8a9acae11b868c24, user_id=a9e89eb14e1e4eeb99b5c925fa5a3582, role_id=e04fe3eb1f714d74901ac83e33ea8a16)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:28.866058 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbda5e6b-9cf0-45e3-8eb0-9a0f2e688e06 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:28.875640 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1598efc0-9ba1-44f2-aea3-d34283804edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:28.876189 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1598efc0-9ba1-44f2-aea3-d34283804edd admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:28.876548 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1598efc0-9ba1-44f2-aea3-d34283804edd admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:28.876898 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1598efc0-9ba1-44f2-aea3-d34283804edd admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:28.878199 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1598efc0-9ba1-44f2-aea3-d34283804edd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:28.880840 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1598efc0-9ba1-44f2-aea3-d34283804edd admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:28.884532 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1107/2197] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:31:28 2022] PUT /identity/v3/projects/f2583b2d74f4436a8a9acae11b868c24/users/a9e89eb14e1e4eeb99b5c925fa5a3582/roles/e04fe3eb1f714d74901ac83e33ea8a16 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:31:28.886120 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3c6a90-32fa-4e2d-af2b-c172b120d20a None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:28.886423 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3c6a90-32fa-4e2d-af2b-c172b120d20a None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:28.886707 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3c6a90-32fa-4e2d-af2b-c172b120d20a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:28.908098 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-eb3c6a90-32fa-4e2d-af2b-c172b120d20a None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:31:28.910063 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-eb3c6a90-32fa-4e2d-af2b-c172b120d20a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:28.970677 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1108/2198] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:31:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:31:28.971722 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3c6a90-32fa-4e2d-af2b-c172b120d20a None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:28.973160 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-eb3c6a90-32fa-4e2d-af2b-c172b120d20a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:28.985103 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3c6a90-32fa-4e2d-af2b-c172b120d20a None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:28.990185 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a950dd-b0f7-4840-9b3f-e65084988a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:28.991075 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a950dd-b0f7-4840-9b3f-e65084988a96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:28.991360 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a950dd-b0f7-4840-9b3f-e65084988a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:28.991637 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a950dd-b0f7-4840-9b3f-e65084988a96 admin admin] PATH_INFO: `/v3/projects/840a863c347b40efbb1b861e03d97a55` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:28.992823 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a950dd-b0f7-4840-9b3f-e65084988a96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=840a863c347b40efbb1b861e03d97a55)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:28.994749 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a950dd-b0f7-4840-9b3f-e65084988a96 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:29.014851 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1091/2199] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:31:28 2022] POST /identity/v3/projects => generated 383 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:31:29.016157 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1598efc0-9ba1-44f2-aea3-d34283804edd admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:29.019080 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-1598efc0-9ba1-44f2-aea3-d34283804edd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:29.081276 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1598efc0-9ba1-44f2-aea3-d34283804edd admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:29.085330 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc501e7-b401-4eab-8f33-23c686a8a4f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:29.086056 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc501e7-b401-4eab-8f33-23c686a8a4f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:29.086469 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc501e7-b401-4eab-8f33-23c686a8a4f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:29.086825 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc501e7-b401-4eab-8f33-23c686a8a4f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:29.135562 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-14a950dd-b0f7-4840-9b3f-e65084988a96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '840a863c347b40efbb1b861e03d97a55', 'request_id': 'req-14a950dd-b0f7-4840-9b3f-e65084988a96'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:29.141764 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-14a950dd-b0f7-4840-9b3f-e65084988a96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '840a863c347b40efbb1b861e03d97a55', 'request_id': 'req-14a950dd-b0f7-4840-9b3f-e65084988a96'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:29.148312 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-14a950dd-b0f7-4840-9b3f-e65084988a96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '840a863c347b40efbb1b861e03d97a55', 'request_id': 'req-14a950dd-b0f7-4840-9b3f-e65084988a96'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:29.148800 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc501e7-b401-4eab-8f33-23c686a8a4f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:29.150318 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc501e7-b401-4eab-8f33-23c686a8a4f9 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:29.159994 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1092/2200] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:31:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:31:29.160795 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc501e7-b401-4eab-8f33-23c686a8a4f9 service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:29.162069 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-8bc501e7-b401-4eab-8f33-23c686a8a4f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:29.171039 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:31:29.177828 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc501e7-b401-4eab-8f33-23c686a8a4f9 service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:29.234329 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3e6d50-9782-48af-b359-d3b62ffc9f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:29.235232 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e6d50-9782-48af-b359-d3b62ffc9f77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:29.235521 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e6d50-9782-48af-b359-d3b62ffc9f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:29.235823 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e6d50-9782-48af-b359-d3b62ffc9f77 admin admin] PATH_INFO: `/v3/projects/13fba9ac0bfc4062bceb8a64c02a1e12` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:29.237599 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3e6d50-9782-48af-b359-d3b62ffc9f77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13fba9ac0bfc4062bceb8a64c02a1e12)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:29.239565 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3e6d50-9782-48af-b359-d3b62ffc9f77 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:29.284175 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-14a950dd-b0f7-4840-9b3f-e65084988a96 admin admin] The token cache is being invalidate because project 840a863c347b40efbb1b861e03d97a55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80288) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:31:29.294822 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-14a950dd-b0f7-4840-9b3f-e65084988a96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:29.294822 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-14a950dd-b0f7-4840-9b3f-e65084988a96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:29.294822 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1109/2201] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:31:28 2022] DELETE /identity/v3/projects/840a863c347b40efbb1b861e03d97a55 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:31:29.294822 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a950dd-b0f7-4840-9b3f-e65084988a96 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:29.294822 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-14a950dd-b0f7-4840-9b3f-e65084988a96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:29.305612 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a950dd-b0f7-4840-9b3f-e65084988a96 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:29.310738 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ba1f8-d036-4e3e-85a5-54ec49ea3a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:29.311665 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ba1f8-d036-4e3e-85a5-54ec49ea3a5b admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:29.312147 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ba1f8-d036-4e3e-85a5-54ec49ea3a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:29.312430 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ba1f8-d036-4e3e-85a5-54ec49ea3a5b admin admin] PATH_INFO: `/v3/users` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:29.313129 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494ba1f8-d036-4e3e-85a5-54ec49ea3a5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:29.315673 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494ba1f8-d036-4e3e-85a5-54ec49ea3a5b admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:29.459883 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1110/2202] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:31:29 2022] POST /identity/v3/users => generated 292 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:31:29.461139 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ba1f8-d036-4e3e-85a5-54ec49ea3a5b admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:29.463248 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-494ba1f8-d036-4e3e-85a5-54ec49ea3a5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:29.468872 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-2a3e6d50-9782-48af-b359-d3b62ffc9f77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13fba9ac0bfc4062bceb8a64c02a1e12', 'request_id': 'req-2a3e6d50-9782-48af-b359-d3b62ffc9f77'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:29.476533 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-2a3e6d50-9782-48af-b359-d3b62ffc9f77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13fba9ac0bfc4062bceb8a64c02a1e12', 'request_id': 'req-2a3e6d50-9782-48af-b359-d3b62ffc9f77'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:29.477501 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ba1f8-d036-4e3e-85a5-54ec49ea3a5b admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:29.561390 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1023b951-57ad-4704-b1ec-0fa71ac8ca6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:29.564941 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1023b951-57ad-4704-b1ec-0fa71ac8ca6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:29.565563 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1023b951-57ad-4704-b1ec-0fa71ac8ca6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:29.566026 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1023b951-57ad-4704-b1ec-0fa71ac8ca6e admin admin] PATH_INFO: `/v3/users/ebac2c6ee0764a83b38de4fe60a43d49` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:29.568922 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1023b951-57ad-4704-b1ec-0fa71ac8ca6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebac2c6ee0764a83b38de4fe60a43d49)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:29.571093 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1023b951-57ad-4704-b1ec-0fa71ac8ca6e admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:29.615940 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-2a3e6d50-9782-48af-b359-d3b62ffc9f77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13fba9ac0bfc4062bceb8a64c02a1e12', 'request_id': 'req-2a3e6d50-9782-48af-b359-d3b62ffc9f77'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:29.628499 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-2a3e6d50-9782-48af-b359-d3b62ffc9f77 admin admin] The token cache is being invalidate because project 13fba9ac0bfc4062bceb8a64c02a1e12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:31:29.628882 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-2a3e6d50-9782-48af-b359-d3b62ffc9f77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:29.630516 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-2a3e6d50-9782-48af-b359-d3b62ffc9f77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:29.635009 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1093/2203] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:31:29 2022] DELETE /identity/v3/projects/13fba9ac0bfc4062bceb8a64c02a1e12 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:31:29.635009 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3e6d50-9782-48af-b359-d3b62ffc9f77 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:29.638572 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-2a3e6d50-9782-48af-b359-d3b62ffc9f77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:29.659675 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3e6d50-9782-48af-b359-d3b62ffc9f77 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:29.664257 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5127d7c9-46c1-4cbb-bed9-9bcfbef06613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:29.665051 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127d7c9-46c1-4cbb-bed9-9bcfbef06613 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:29.665454 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127d7c9-46c1-4cbb-bed9-9bcfbef06613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:29.665831 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127d7c9-46c1-4cbb-bed9-9bcfbef06613 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:29.666778 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5127d7c9-46c1-4cbb-bed9-9bcfbef06613 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:29.668718 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5127d7c9-46c1-4cbb-bed9-9bcfbef06613 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:29.683210 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1094/2204] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:31:29 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:31:29.683210 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5127d7c9-46c1-4cbb-bed9-9bcfbef06613 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:29.686058 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-5127d7c9-46c1-4cbb-bed9-9bcfbef06613 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:29.698896 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5127d7c9-46c1-4cbb-bed9-9bcfbef06613 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:29.703889 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d62a8a-10bf-43fe-8f50-44f99dbb338f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:29.704954 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d62a8a-10bf-43fe-8f50-44f99dbb338f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:29.705307 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d62a8a-10bf-43fe-8f50-44f99dbb338f admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:29.705688 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d62a8a-10bf-43fe-8f50-44f99dbb338f admin admin] PATH_INFO: `/v3/users/72848db371f4462ea139132696bf9648` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:29.706926 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d62a8a-10bf-43fe-8f50-44f99dbb338f admin admin] RBAC: Authorizing `identity:delete_user(user_id=72848db371f4462ea139132696bf9648)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:29.708890 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d62a8a-10bf-43fe-8f50-44f99dbb338f admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:29.791659 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-1023b951-57ad-4704-b1ec-0fa71ac8ca6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebac2c6ee0764a83b38de4fe60a43d49'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:29.807474 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-1023b951-57ad-4704-b1ec-0fa71ac8ca6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebac2c6ee0764a83b38de4fe60a43d49'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:29.808402 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-1023b951-57ad-4704-b1ec-0fa71ac8ca6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebac2c6ee0764a83b38de4fe60a43d49'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:29.809044 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-1023b951-57ad-4704-b1ec-0fa71ac8ca6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebac2c6ee0764a83b38de4fe60a43d49'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:29.958085 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-1023b951-57ad-4704-b1ec-0fa71ac8ca6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebac2c6ee0764a83b38de4fe60a43d49'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:29.972123 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1111/2205] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:31:29 2022] DELETE /identity/v3/users/ebac2c6ee0764a83b38de4fe60a43d49 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:31:29.973237 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1023b951-57ad-4704-b1ec-0fa71ac8ca6e admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:29.974654 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-1023b951-57ad-4704-b1ec-0fa71ac8ca6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:30.018629 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-18d62a8a-10bf-43fe-8f50-44f99dbb338f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72848db371f4462ea139132696bf9648'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:30.026968 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-18d62a8a-10bf-43fe-8f50-44f99dbb338f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72848db371f4462ea139132696bf9648'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:30.027707 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-18d62a8a-10bf-43fe-8f50-44f99dbb338f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72848db371f4462ea139132696bf9648'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:30.028333 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-18d62a8a-10bf-43fe-8f50-44f99dbb338f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72848db371f4462ea139132696bf9648'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:30.047102 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1023b951-57ad-4704-b1ec-0fa71ac8ca6e admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:30.051757 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6658fbbc-49d2-4340-9a14-62ef9886fb03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:30.052427 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658fbbc-49d2-4340-9a14-62ef9886fb03 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:30.052707 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658fbbc-49d2-4340-9a14-62ef9886fb03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:30.052989 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658fbbc-49d2-4340-9a14-62ef9886fb03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:30.056741 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6658fbbc-49d2-4340-9a14-62ef9886fb03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:30.056741 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6658fbbc-49d2-4340-9a14-62ef9886fb03 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:30.065447 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1112/2206] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:31:29 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:31:30.067329 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6658fbbc-49d2-4340-9a14-62ef9886fb03 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:30.069425 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-6658fbbc-49d2-4340-9a14-62ef9886fb03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:30.083571 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6658fbbc-49d2-4340-9a14-62ef9886fb03 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:30.089885 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb989eb-ef67-4526-9c53-77940c1cc822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:30.094625 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb989eb-ef67-4526-9c53-77940c1cc822 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:30.094625 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb989eb-ef67-4526-9c53-77940c1cc822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:30.094625 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb989eb-ef67-4526-9c53-77940c1cc822 admin admin] PATH_INFO: `/v3/projects/34ff9634a00a48be80c167e4f61562b0` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:30.094625 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb989eb-ef67-4526-9c53-77940c1cc822 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34ff9634a00a48be80c167e4f61562b0)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:30.094625 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb989eb-ef67-4526-9c53-77940c1cc822 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:30.124001 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-18d62a8a-10bf-43fe-8f50-44f99dbb338f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72848db371f4462ea139132696bf9648'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:30.157326 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1095/2207] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:31:29 2022] DELETE /identity/v3/users/72848db371f4462ea139132696bf9648 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:31:30.159444 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d62a8a-10bf-43fe-8f50-44f99dbb338f admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:30.162194 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-18d62a8a-10bf-43fe-8f50-44f99dbb338f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:30.252397 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d62a8a-10bf-43fe-8f50-44f99dbb338f admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:30.257679 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee04eb2-5cff-4ebc-a641-1e9416ccc0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:30.258619 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee04eb2-5cff-4ebc-a641-1e9416ccc0cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:30.258899 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee04eb2-5cff-4ebc-a641-1e9416ccc0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:30.259172 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee04eb2-5cff-4ebc-a641-1e9416ccc0cb admin admin] PATH_INFO: `/v3/projects/84b4b0f9a9334a248352f9462e575223/users/9fc5d1641d5047b89fdb6d23b053a2c5/roles/c8ce6d197f654598ac45f6016ecccabd` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:30.285795 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee04eb2-5cff-4ebc-a641-1e9416ccc0cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=84b4b0f9a9334a248352f9462e575223, user_id=9fc5d1641d5047b89fdb6d23b053a2c5, role_id=c8ce6d197f654598ac45f6016ecccabd)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:30.288847 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee04eb2-5cff-4ebc-a641-1e9416ccc0cb admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:30.313646 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:31:30.502516 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-9cb989eb-ef67-4526-9c53-77940c1cc822 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34ff9634a00a48be80c167e4f61562b0', 'request_id': 'req-9cb989eb-ef67-4526-9c53-77940c1cc822'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:30.504012 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1096/2208] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:31:30 2022] PUT /identity/v3/projects/84b4b0f9a9334a248352f9462e575223/users/9fc5d1641d5047b89fdb6d23b053a2c5/roles/c8ce6d197f654598ac45f6016ecccabd => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:31:30.510415 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-9cb989eb-ef67-4526-9c53-77940c1cc822 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34ff9634a00a48be80c167e4f61562b0', 'request_id': 'req-9cb989eb-ef67-4526-9c53-77940c1cc822'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:30.513795 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7418d499-47d5-43e4-9b29-2876ba036564 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:30.514700 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7418d499-47d5-43e4-9b29-2876ba036564 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:30.515142 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7418d499-47d5-43e4-9b29-2876ba036564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:30.517388 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-9cb989eb-ef67-4526-9c53-77940c1cc822 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34ff9634a00a48be80c167e4f61562b0', 'request_id': 'req-9cb989eb-ef67-4526-9c53-77940c1cc822'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:30.558967 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-7418d499-47d5-43e4-9b29-2876ba036564 None None] MFA Rules not processed for user `9fc5d1641d5047b89fdb6d23b053a2c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:31:30.560791 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-7418d499-47d5-43e4-9b29-2876ba036564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:30.640813 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1097/2209] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:31:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:31:30.658522 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7418d499-47d5-43e4-9b29-2876ba036564 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:30.661443 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-7418d499-47d5-43e4-9b29-2876ba036564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:30.693543 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-9cb989eb-ef67-4526-9c53-77940c1cc822 admin admin] The token cache is being invalidate because project 34ff9634a00a48be80c167e4f61562b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80288) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:31:30.697261 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-9cb989eb-ef67-4526-9c53-77940c1cc822 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:30.697261 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-9cb989eb-ef67-4526-9c53-77940c1cc822 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:30.697261 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1113/2210] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:31:30 2022] DELETE /identity/v3/projects/34ff9634a00a48be80c167e4f61562b0 => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:31:30.700859 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb989eb-ef67-4526-9c53-77940c1cc822 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:30.715996 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-9cb989eb-ef67-4526-9c53-77940c1cc822 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:30.773909 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7418d499-47d5-43e4-9b29-2876ba036564 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:30.778834 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bf0501-5f88-4bcb-9f0a-320eb9a6f1c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8693a1e72f14fdfb383f11e96330726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:30.779604 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bf0501-5f88-4bcb-9f0a-320eb9a6f1c8 service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:30.784407 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bf0501-5f88-4bcb-9f0a-320eb9a6f1c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:30.784407 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bf0501-5f88-4bcb-9f0a-320eb9a6f1c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:30.784580 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-04bf0501-5f88-4bcb-9f0a-320eb9a6f1c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:30.806714 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bf0501-5f88-4bcb-9f0a-320eb9a6f1c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:30.809117 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bf0501-5f88-4bcb-9f0a-320eb9a6f1c8 service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:30.844690 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1098/2211] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:31:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:31:30.844690 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bf0501-5f88-4bcb-9f0a-320eb9a6f1c8 service cinder] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:30.844690 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-04bf0501-5f88-4bcb-9f0a-320eb9a6f1c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:30.868491 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb989eb-ef67-4526-9c53-77940c1cc822 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:30.883659 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bf0501-5f88-4bcb-9f0a-320eb9a6f1c8 service cinder] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:30.897138 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838ce6ff-dd74-449e-a67b-175c08f030c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:30.901233 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ce6ff-dd74-449e-a67b-175c08f030c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:30.901611 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ce6ff-dd74-449e-a67b-175c08f030c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:30.901725 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7fb261-5d94-45ed-99c3-e859e99ee4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:30.902134 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ce6ff-dd74-449e-a67b-175c08f030c7 admin admin] PATH_INFO: `/v3/users/a0aab6ec24e44395bca08fa94aaeff0a` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:30.902750 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7fb261-5d94-45ed-99c3-e859e99ee4ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:30.902912 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7fb261-5d94-45ed-99c3-e859e99ee4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:30.903261 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7fb261-5d94-45ed-99c3-e859e99ee4ac admin admin] PATH_INFO: `/v3/projects/59c5050528904a8abb6878eb3e4103d9` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:30.905595 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7fb261-5d94-45ed-99c3-e859e99ee4ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=59c5050528904a8abb6878eb3e4103d9)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:30.907564 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7fb261-5d94-45ed-99c3-e859e99ee4ac admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:30.914799 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838ce6ff-dd74-449e-a67b-175c08f030c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0aab6ec24e44395bca08fa94aaeff0a)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:30.922836 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838ce6ff-dd74-449e-a67b-175c08f030c7 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:31.094559 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-9b7fb261-5d94-45ed-99c3-e859e99ee4ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59c5050528904a8abb6878eb3e4103d9', 'request_id': 'req-9b7fb261-5d94-45ed-99c3-e859e99ee4ac'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:31.101221 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-9b7fb261-5d94-45ed-99c3-e859e99ee4ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59c5050528904a8abb6878eb3e4103d9', 'request_id': 'req-9b7fb261-5d94-45ed-99c3-e859e99ee4ac'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:31.344791 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-9b7fb261-5d94-45ed-99c3-e859e99ee4ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59c5050528904a8abb6878eb3e4103d9', 'request_id': 'req-9b7fb261-5d94-45ed-99c3-e859e99ee4ac'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:31.359862 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-838ce6ff-dd74-449e-a67b-175c08f030c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0aab6ec24e44395bca08fa94aaeff0a'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:31.360757 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-9b7fb261-5d94-45ed-99c3-e859e99ee4ac admin admin] The token cache is being invalidate because project 59c5050528904a8abb6878eb3e4103d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:31:31.361183 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-9b7fb261-5d94-45ed-99c3-e859e99ee4ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:31.361877 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-9b7fb261-5d94-45ed-99c3-e859e99ee4ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:31.363948 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1099/2212] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:31:30 2022] DELETE /identity/v3/projects/59c5050528904a8abb6878eb3e4103d9 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:31:31.365206 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05345424-67f8-4ede-b0c1-8f9e65dace15 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:31.365498 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05345424-67f8-4ede-b0c1-8f9e65dace15 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:31.365779 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05345424-67f8-4ede-b0c1-8f9e65dace15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:31.374749 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-838ce6ff-dd74-449e-a67b-175c08f030c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0aab6ec24e44395bca08fa94aaeff0a'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:31.375442 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-838ce6ff-dd74-449e-a67b-175c08f030c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0aab6ec24e44395bca08fa94aaeff0a'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:31.376045 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-838ce6ff-dd74-449e-a67b-175c08f030c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0aab6ec24e44395bca08fa94aaeff0a'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:31.391229 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-05345424-67f8-4ede-b0c1-8f9e65dace15 None None] MFA Rules not processed for user `a9e89eb14e1e4eeb99b5c925fa5a3582`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:31:31.392431 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-05345424-67f8-4ede-b0c1-8f9e65dace15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:31.459116 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1100/2213] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:31:31 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:31:31.459962 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05345424-67f8-4ede-b0c1-8f9e65dace15 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:31.461322 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-05345424-67f8-4ede-b0c1-8f9e65dace15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:31.523857 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05345424-67f8-4ede-b0c1-8f9e65dace15 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:31.528471 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbf04b1-dc08-46c3-8fc0-3fc5dfc92448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:31.529320 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf04b1-dc08-46c3-8fc0-3fc5dfc92448 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:31.529608 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf04b1-dc08-46c3-8fc0-3fc5dfc92448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:31.529888 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf04b1-dc08-46c3-8fc0-3fc5dfc92448 admin admin] PATH_INFO: `/v3/projects/a8cfcbe2443847738da8ec895189f0e1` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:31.531104 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbf04b1-dc08-46c3-8fc0-3fc5dfc92448 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8cfcbe2443847738da8ec895189f0e1)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:31.533020 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbf04b1-dc08-46c3-8fc0-3fc5dfc92448 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:31.620889 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-838ce6ff-dd74-449e-a67b-175c08f030c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0aab6ec24e44395bca08fa94aaeff0a'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:31.636923 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1114/2214] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:31:30 2022] DELETE /identity/v3/users/a0aab6ec24e44395bca08fa94aaeff0a => generated 0 bytes in 934 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:31:31.636923 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838ce6ff-dd74-449e-a67b-175c08f030c7 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:31.636923 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-838ce6ff-dd74-449e-a67b-175c08f030c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:31.723706 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838ce6ff-dd74-449e-a67b-175c08f030c7 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:31.728962 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b7beb0-54c1-4c72-a2f2-8ca4f0615039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:31.729848 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b7beb0-54c1-4c72-a2f2-8ca4f0615039 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:31.730139 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b7beb0-54c1-4c72-a2f2-8ca4f0615039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:31.730455 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b7beb0-54c1-4c72-a2f2-8ca4f0615039 admin admin] PATH_INFO: `/v3/users/bfee18f84f974d7a9e4f692242b93127` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:31.731659 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b7beb0-54c1-4c72-a2f2-8ca4f0615039 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfee18f84f974d7a9e4f692242b93127)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:31.733593 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b7beb0-54c1-4c72-a2f2-8ca4f0615039 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:31.771652 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-1fbf04b1-dc08-46c3-8fc0-3fc5dfc92448 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8cfcbe2443847738da8ec895189f0e1', 'request_id': 'req-1fbf04b1-dc08-46c3-8fc0-3fc5dfc92448'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:31.777741 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-1fbf04b1-dc08-46c3-8fc0-3fc5dfc92448 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8cfcbe2443847738da8ec895189f0e1', 'request_id': 'req-1fbf04b1-dc08-46c3-8fc0-3fc5dfc92448'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:31.946236 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-1fbf04b1-dc08-46c3-8fc0-3fc5dfc92448 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8cfcbe2443847738da8ec895189f0e1', 'request_id': 'req-1fbf04b1-dc08-46c3-8fc0-3fc5dfc92448'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:31.958208 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-1fbf04b1-dc08-46c3-8fc0-3fc5dfc92448 admin admin] The token cache is being invalidate because project a8cfcbe2443847738da8ec895189f0e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:31:31.966106 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-1fbf04b1-dc08-46c3-8fc0-3fc5dfc92448 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:31.966106 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-1fbf04b1-dc08-46c3-8fc0-3fc5dfc92448 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:31.966106 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1101/2215] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:31:31 2022] DELETE /identity/v3/projects/a8cfcbe2443847738da8ec895189f0e1 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:31:31.966106 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a465ee2a-8683-4948-b8e0-c4a25b2ab271 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:31.966106 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a465ee2a-8683-4948-b8e0-c4a25b2ab271 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:31.966106 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a465ee2a-8683-4948-b8e0-c4a25b2ab271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:31.982869 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-a465ee2a-8683-4948-b8e0-c4a25b2ab271 None None] MFA Rules not processed for user `4025e748e7674fd3b92dc6c80ae94740`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:31:31.984105 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-a465ee2a-8683-4948-b8e0-c4a25b2ab271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:32.057024 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1102/2216] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:31:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:31:32.058391 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52954e43-125b-4f1f-a586-bed6510e0e8e None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:32.058689 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52954e43-125b-4f1f-a586-bed6510e0e8e None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:32.059018 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52954e43-125b-4f1f-a586-bed6510e0e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:32.076729 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-52954e43-125b-4f1f-a586-bed6510e0e8e None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:31:32.081093 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-52954e43-125b-4f1f-a586-bed6510e0e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:32.140457 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1103/2217] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:31:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:31:32.146975 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52954e43-125b-4f1f-a586-bed6510e0e8e None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:32.146975 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-52954e43-125b-4f1f-a586-bed6510e0e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:32.220985 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-57b7beb0-54c1-4c72-a2f2-8ca4f0615039 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfee18f84f974d7a9e4f692242b93127'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:32.222583 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52954e43-125b-4f1f-a586-bed6510e0e8e None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:32.229724 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb620e9a-6e80-4a95-943e-5ff281cbae32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb13ad6d8b1e46029262556bff398796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:32.230584 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb620e9a-6e80-4a95-943e-5ff281cbae32 service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:32.231114 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb620e9a-6e80-4a95-943e-5ff281cbae32 service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:32.240865 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb620e9a-6e80-4a95-943e-5ff281cbae32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:32.240865 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-fb620e9a-6e80-4a95-943e-5ff281cbae32 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:32.241037 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-57b7beb0-54c1-4c72-a2f2-8ca4f0615039 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfee18f84f974d7a9e4f692242b93127'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:32.241037 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-57b7beb0-54c1-4c72-a2f2-8ca4f0615039 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfee18f84f974d7a9e4f692242b93127'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:32.251984 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-57b7beb0-54c1-4c72-a2f2-8ca4f0615039 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfee18f84f974d7a9e4f692242b93127'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:32.253497 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb620e9a-6e80-4a95-943e-5ff281cbae32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:32.255193 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb620e9a-6e80-4a95-943e-5ff281cbae32 service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:32.266481 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1104/2218] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:31:32 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:31:32.268907 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4f692-069f-43c7-a39b-10e7eeaa6f8c None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:32.269212 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4f692-069f-43c7-a39b-10e7eeaa6f8c None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:32.269500 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4f692-069f-43c7-a39b-10e7eeaa6f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:32.291662 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-4ef4f692-069f-43c7-a39b-10e7eeaa6f8c None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:31:32.294206 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-4ef4f692-069f-43c7-a39b-10e7eeaa6f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:32.302342 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1105/2219] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:31:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:31:32.303225 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef4f692-069f-43c7-a39b-10e7eeaa6f8c None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:32.304564 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-4ef4f692-069f-43c7-a39b-10e7eeaa6f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:32.317704 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef4f692-069f-43c7-a39b-10e7eeaa6f8c None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:32.322357 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31f9160-2691-4645-8e29-9a0220a9059e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:32.323186 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f9160-2691-4645-8e29-9a0220a9059e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:32.323474 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f9160-2691-4645-8e29-9a0220a9059e admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:32.323804 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f9160-2691-4645-8e29-9a0220a9059e admin admin] PATH_INFO: `/v3/projects/e9d23191cd344445827c581f8a45f6f1` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:32.324982 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31f9160-2691-4645-8e29-9a0220a9059e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9d23191cd344445827c581f8a45f6f1)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:32.326946 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31f9160-2691-4645-8e29-9a0220a9059e admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:32.501507 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-57b7beb0-54c1-4c72-a2f2-8ca4f0615039 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfee18f84f974d7a9e4f692242b93127'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:32.526950 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1115/2220] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:31:31 2022] DELETE /identity/v3/users/bfee18f84f974d7a9e4f692242b93127 => generated 0 bytes in 889 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:31:32.527144 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b31f9160-2691-4645-8e29-9a0220a9059e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9d23191cd344445827c581f8a45f6f1', 'request_id': 'req-b31f9160-2691-4645-8e29-9a0220a9059e'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:32.527244 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b7beb0-54c1-4c72-a2f2-8ca4f0615039 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:32.531719 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b31f9160-2691-4645-8e29-9a0220a9059e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9d23191cd344445827c581f8a45f6f1', 'request_id': 'req-b31f9160-2691-4645-8e29-9a0220a9059e'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:32.602108 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b7beb0-54c1-4c72-a2f2-8ca4f0615039 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:32.606895 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365f6d46-bd16-4225-b999-10d5763f8aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:32.607847 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365f6d46-bd16-4225-b999-10d5763f8aa6 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:32.607847 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365f6d46-bd16-4225-b999-10d5763f8aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:32.608102 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365f6d46-bd16-4225-b999-10d5763f8aa6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:32.608866 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365f6d46-bd16-4225-b999-10d5763f8aa6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:31:32.609177 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365f6d46-bd16-4225-b999-10d5763f8aa6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:32.610828 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365f6d46-bd16-4225-b999-10d5763f8aa6 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:32.623786 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1116/2221] 10.222.0.62 () {58 vars in 1152 bytes} [Fri May 27 16:31:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:31:32.628852 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365f6d46-bd16-4225-b999-10d5763f8aa6 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:32.639088 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365f6d46-bd16-4225-b999-10d5763f8aa6 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:32.644314 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17872b0f-48d8-4e4d-9456-a4f58eec1de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:32.644969 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17872b0f-48d8-4e4d-9456-a4f58eec1de8 admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:32.645844 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17872b0f-48d8-4e4d-9456-a4f58eec1de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:32.645844 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17872b0f-48d8-4e4d-9456-a4f58eec1de8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:32.646206 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17872b0f-48d8-4e4d-9456-a4f58eec1de8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:32.648231 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17872b0f-48d8-4e4d-9456-a4f58eec1de8 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:32.666104 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b31f9160-2691-4645-8e29-9a0220a9059e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9d23191cd344445827c581f8a45f6f1', 'request_id': 'req-b31f9160-2691-4645-8e29-9a0220a9059e'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:32.678747 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b31f9160-2691-4645-8e29-9a0220a9059e admin admin] The token cache is being invalidate because project e9d23191cd344445827c581f8a45f6f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:31:32.679037 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b31f9160-2691-4645-8e29-9a0220a9059e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:32.680357 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b31f9160-2691-4645-8e29-9a0220a9059e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:32.681687 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1106/2222] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:31:32 2022] DELETE /identity/v3/projects/e9d23191cd344445827c581f8a45f6f1 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:31:32.687342 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa0d716-eea2-4294-bef4-ffce4a0a9e75 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:32.687598 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa0d716-eea2-4294-bef4-ffce4a0a9e75 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:32.687859 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa0d716-eea2-4294-bef4-ffce4a0a9e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:32.706963 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-3aa0d716-eea2-4294-bef4-ffce4a0a9e75 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:31:32.711592 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-3aa0d716-eea2-4294-bef4-ffce4a0a9e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:32.716250 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1107/2223] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:31:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:31:32.724218 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f3d827-b8c2-43d8-8ae0-33582ebc0863 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:32.724509 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f3d827-b8c2-43d8-8ae0-33582ebc0863 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:32.724792 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f3d827-b8c2-43d8-8ae0-33582ebc0863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:32.743196 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-37f3d827-b8c2-43d8-8ae0-33582ebc0863 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:31:32.751977 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-37f3d827-b8c2-43d8-8ae0-33582ebc0863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:32.753578 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1108/2224] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:31:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:31:32.757664 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f3d827-b8c2-43d8-8ae0-33582ebc0863 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:32.766969 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f3d827-b8c2-43d8-8ae0-33582ebc0863 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:32.772223 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be85baf1-6c2f-42ee-8fbf-71ba2bea83b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:32.772886 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be85baf1-6c2f-42ee-8fbf-71ba2bea83b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:32.773172 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be85baf1-6c2f-42ee-8fbf-71ba2bea83b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:32.773453 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be85baf1-6c2f-42ee-8fbf-71ba2bea83b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:32.774183 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be85baf1-6c2f-42ee-8fbf-71ba2bea83b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:31:32.774571 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be85baf1-6c2f-42ee-8fbf-71ba2bea83b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:32.776196 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be85baf1-6c2f-42ee-8fbf-71ba2bea83b9 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:32.787691 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1117/2225] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:31:32 2022] POST /identity/v3/projects => generated 377 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:31:32.790904 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1109/2226] 10.222.0.62 () {58 vars in 1152 bytes} [Fri May 27 16:31:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:31:32.792139 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17872b0f-48d8-4e4d-9456-a4f58eec1de8 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:32.794391 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-17872b0f-48d8-4e4d-9456-a4f58eec1de8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:32.795084 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be85baf1-6c2f-42ee-8fbf-71ba2bea83b9 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:32.807949 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be85baf1-6c2f-42ee-8fbf-71ba2bea83b9 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:32.873678 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17872b0f-48d8-4e4d-9456-a4f58eec1de8 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:32.884447 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568d88a7-9e1e-482e-b457-9016c25f37da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:32.885709 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d88a7-9e1e-482e-b457-9016c25f37da admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:32.886188 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d88a7-9e1e-482e-b457-9016c25f37da admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:32.886711 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d88a7-9e1e-482e-b457-9016c25f37da admin admin] PATH_INFO: `/v3/users` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:32.887755 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568d88a7-9e1e-482e-b457-9016c25f37da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:32.889935 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568d88a7-9e1e-482e-b457-9016c25f37da admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:32.890943 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f587b9-191c-4f30-b910-25f2486b5845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:32.892707 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f587b9-191c-4f30-b910-25f2486b5845 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:32.893562 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f587b9-191c-4f30-b910-25f2486b5845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:32.893932 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f587b9-191c-4f30-b910-25f2486b5845 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:32.894755 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f587b9-191c-4f30-b910-25f2486b5845 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:32.897336 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f587b9-191c-4f30-b910-25f2486b5845 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:33.006279 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1118/2227] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:31:32 2022] POST /identity/v3/users => generated 289 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:31:33.010066 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568d88a7-9e1e-482e-b457-9016c25f37da admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:33.017240 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1110/2228] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:31:32 2022] POST /identity/v3/projects => generated 373 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:31:33.021376 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f587b9-191c-4f30-b910-25f2486b5845 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:33.043000 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568d88a7-9e1e-482e-b457-9016c25f37da admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:33.157550 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f587b9-191c-4f30-b910-25f2486b5845 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:33.165180 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd91cd52-c523-4059-9357-f234e8b9c844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:33.165884 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd91cd52-c523-4059-9357-f234e8b9c844 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:33.166405 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd91cd52-c523-4059-9357-f234e8b9c844 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:33.166720 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd91cd52-c523-4059-9357-f234e8b9c844 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:33.167532 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd91cd52-c523-4059-9357-f234e8b9c844 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:33.169806 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd91cd52-c523-4059-9357-f234e8b9c844 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:33.181790 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39a5368-98b1-4ed4-81ad-e558aa12494b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:33.182703 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a5368-98b1-4ed4-81ad-e558aa12494b admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:33.182988 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a5368-98b1-4ed4-81ad-e558aa12494b admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:33.187934 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a5368-98b1-4ed4-81ad-e558aa12494b admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:33.187934 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39a5368-98b1-4ed4-81ad-e558aa12494b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:33.187934 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39a5368-98b1-4ed4-81ad-e558aa12494b admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:33.198682 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1119/2229] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 16:31:33.202241 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39a5368-98b1-4ed4-81ad-e558aa12494b admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:33.215226 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39a5368-98b1-4ed4-81ad-e558aa12494b admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:33.220397 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24398dc7-7e1b-4980-83de-b939b5b9a22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:33.221717 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24398dc7-7e1b-4980-83de-b939b5b9a22e admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:33.222292 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24398dc7-7e1b-4980-83de-b939b5b9a22e admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:33.222388 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24398dc7-7e1b-4980-83de-b939b5b9a22e admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:33.223070 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24398dc7-7e1b-4980-83de-b939b5b9a22e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:33.224662 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24398dc7-7e1b-4980-83de-b939b5b9a22e admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:33.234949 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1120/2230] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 16:31:33.239849 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24398dc7-7e1b-4980-83de-b939b5b9a22e admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:33.250936 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24398dc7-7e1b-4980-83de-b939b5b9a22e admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:33.259464 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a795b99f-f500-4b01-b977-a6729816df3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:33.260645 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795b99f-f500-4b01-b977-a6729816df3b admin admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:33.261098 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795b99f-f500-4b01-b977-a6729816df3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:33.261543 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795b99f-f500-4b01-b977-a6729816df3b admin admin] PATH_INFO: `/v3/projects/b91c55c7402e414e87011bedd94cdaa5/users/724db5ea47fe4665a35c6eaf4dd11ee4/roles/c8ce6d197f654598ac45f6016ecccabd` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:33.287982 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a795b99f-f500-4b01-b977-a6729816df3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b91c55c7402e414e87011bedd94cdaa5, user_id=724db5ea47fe4665a35c6eaf4dd11ee4, role_id=c8ce6d197f654598ac45f6016ecccabd)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:33.291892 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a795b99f-f500-4b01-b977-a6729816df3b admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:33.302833 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1111/2231] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:31:33 2022] POST /identity/v3/users => generated 287 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:31:33.307657 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd91cd52-c523-4059-9357-f234e8b9c844 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:33.309527 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-bd91cd52-c523-4059-9357-f234e8b9c844 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:33.323283 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd91cd52-c523-4059-9357-f234e8b9c844 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:33.328956 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccac8635-38fa-4993-af50-b236eadc4666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:33.329872 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac8635-38fa-4993-af50-b236eadc4666 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:33.330187 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac8635-38fa-4993-af50-b236eadc4666 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:33.330533 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac8635-38fa-4993-af50-b236eadc4666 admin admin] PATH_INFO: `/v3/projects/af13f9aac54b4489a1eac949f5965213` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:33.331903 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccac8635-38fa-4993-af50-b236eadc4666 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af13f9aac54b4489a1eac949f5965213)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:33.342001 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccac8635-38fa-4993-af50-b236eadc4666 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:33.465736 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1121/2232] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:31:33 2022] PUT /identity/v3/projects/b91c55c7402e414e87011bedd94cdaa5/users/724db5ea47fe4665a35c6eaf4dd11ee4/roles/c8ce6d197f654598ac45f6016ecccabd => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:31:33.466750 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a795b99f-f500-4b01-b977-a6729816df3b admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:33.503981 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-ccac8635-38fa-4993-af50-b236eadc4666 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af13f9aac54b4489a1eac949f5965213', 'request_id': 'req-ccac8635-38fa-4993-af50-b236eadc4666'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:33.510625 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-ccac8635-38fa-4993-af50-b236eadc4666 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af13f9aac54b4489a1eac949f5965213', 'request_id': 'req-ccac8635-38fa-4993-af50-b236eadc4666'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:33.535726 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a795b99f-f500-4b01-b977-a6729816df3b admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:33.593535 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b383de-743c-4030-a38c-580af5a6f0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:33.594436 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b383de-743c-4030-a38c-580af5a6f0ed admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:33.594727 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b383de-743c-4030-a38c-580af5a6f0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:33.595353 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b383de-743c-4030-a38c-580af5a6f0ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:33.596624 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b383de-743c-4030-a38c-580af5a6f0ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:33.598241 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b383de-743c-4030-a38c-580af5a6f0ed admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:33.609971 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1122/2233] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:31:33.611561 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd8af7-82e6-48b5-86f2-30220a3a0ecd None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:33.612447 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd8af7-82e6-48b5-86f2-30220a3a0ecd None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:33.612892 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd8af7-82e6-48b5-86f2-30220a3a0ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:33.640463 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-9dfd8af7-82e6-48b5-86f2-30220a3a0ecd None None] MFA Rules not processed for user `724db5ea47fe4665a35c6eaf4dd11ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:31:33.641720 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-9dfd8af7-82e6-48b5-86f2-30220a3a0ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:33.644767 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-ccac8635-38fa-4993-af50-b236eadc4666 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af13f9aac54b4489a1eac949f5965213', 'request_id': 'req-ccac8635-38fa-4993-af50-b236eadc4666'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:33.659684 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-ccac8635-38fa-4993-af50-b236eadc4666 admin admin] The token cache is being invalidate because project af13f9aac54b4489a1eac949f5965213 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:31:33.659982 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-ccac8635-38fa-4993-af50-b236eadc4666 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:33.660668 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-ccac8635-38fa-4993-af50-b236eadc4666 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:33.662274 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1112/2234] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:31:33 2022] DELETE /identity/v3/projects/af13f9aac54b4489a1eac949f5965213 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:31:33.663708 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccac8635-38fa-4993-af50-b236eadc4666 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:33.664727 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-ccac8635-38fa-4993-af50-b236eadc4666 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:33.677958 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccac8635-38fa-4993-af50-b236eadc4666 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:33.683989 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4ee647-75fc-4f0d-96c7-72ea3a8f9256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:33.684852 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ee647-75fc-4f0d-96c7-72ea3a8f9256 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:33.685139 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ee647-75fc-4f0d-96c7-72ea3a8f9256 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:33.685425 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ee647-75fc-4f0d-96c7-72ea3a8f9256 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:33.686164 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4ee647-75fc-4f0d-96c7-72ea3a8f9256 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:33.688174 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4ee647-75fc-4f0d-96c7-72ea3a8f9256 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:33.700055 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1113/2235] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:31:33.701468 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e05756a-7312-42bf-a642-59455b0f449e None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:33.701915 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e05756a-7312-42bf-a642-59455b0f449e None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:33.702410 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e05756a-7312-42bf-a642-59455b0f449e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:33.723332 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-3e05756a-7312-42bf-a642-59455b0f449e None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:31:33.725519 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-3e05756a-7312-42bf-a642-59455b0f449e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:33.732591 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1123/2236] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:31:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:31:33.732591 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfd8af7-82e6-48b5-86f2-30220a3a0ecd None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:33.746296 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:31:33.746620 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1114/2237] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:31:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:31:33.747235 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfd8af7-82e6-48b5-86f2-30220a3a0ecd None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:33.748077 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e05756a-7312-42bf-a642-59455b0f449e None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:33.749810 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-3e05756a-7312-42bf-a642-59455b0f449e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:33.754158 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7deb16-fe9f-49ff-804d-cc6cdce922c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:33.755108 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7deb16-fe9f-49ff-804d-cc6cdce922c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:33.756828 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7deb16-fe9f-49ff-804d-cc6cdce922c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:33.757118 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7deb16-fe9f-49ff-804d-cc6cdce922c7 admin admin] PATH_INFO: `/v3/projects/08916e445000497aa15ba006b0bd32d9/users/aa5703a19a494b2c86fd7c9e6a872dff/roles/c8ce6d197f654598ac45f6016ecccabd` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:33.776689 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7deb16-fe9f-49ff-804d-cc6cdce922c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08916e445000497aa15ba006b0bd32d9, user_id=aa5703a19a494b2c86fd7c9e6a872dff, role_id=c8ce6d197f654598ac45f6016ecccabd)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:33.781520 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7deb16-fe9f-49ff-804d-cc6cdce922c7 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:33.815586 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e05756a-7312-42bf-a642-59455b0f449e None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:33.819532 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c797fe71-696d-483f-b64f-663a07eba66a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8693a1e72f14fdfb383f11e96330726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:33.820217 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c797fe71-696d-483f-b64f-663a07eba66a service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:33.820499 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c797fe71-696d-483f-b64f-663a07eba66a service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:33.820779 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c797fe71-696d-483f-b64f-663a07eba66a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:33.829915 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c797fe71-696d-483f-b64f-663a07eba66a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:33.831807 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c797fe71-696d-483f-b64f-663a07eba66a service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:33.841942 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1115/2238] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:31:33 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:31:33.843756 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d3927-57f6-4741-97f7-e03ff1377150 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:33.844251 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d3927-57f6-4741-97f7-e03ff1377150 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:33.844757 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d3927-57f6-4741-97f7-e03ff1377150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:33.879467 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-b89d3927-57f6-4741-97f7-e03ff1377150 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:31:33.882686 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-b89d3927-57f6-4741-97f7-e03ff1377150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:33.894134 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1124/2239] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:31:33 2022] PUT /identity/v3/projects/08916e445000497aa15ba006b0bd32d9/users/aa5703a19a494b2c86fd7c9e6a872dff/roles/c8ce6d197f654598ac45f6016ecccabd => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:31:33.906471 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255fa7f2-cf28-402b-a5e8-3ca74578c58b None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:33.906792 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255fa7f2-cf28-402b-a5e8-3ca74578c58b None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:33.907051 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255fa7f2-cf28-402b-a5e8-3ca74578c58b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:33.961440 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-255fa7f2-cf28-402b-a5e8-3ca74578c58b None None] MFA Rules not processed for user `aa5703a19a494b2c86fd7c9e6a872dff`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:31:33.962869 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-255fa7f2-cf28-402b-a5e8-3ca74578c58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:33.966582 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1116/2240] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:31:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:31:33.970688 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89d3927-57f6-4741-97f7-e03ff1377150 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:33.981599 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89d3927-57f6-4741-97f7-e03ff1377150 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:33.992037 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3921932a-feaa-4719-85d0-05da7982d6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:33.993330 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3921932a-feaa-4719-85d0-05da7982d6d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:33.993330 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3921932a-feaa-4719-85d0-05da7982d6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:33.993525 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3921932a-feaa-4719-85d0-05da7982d6d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:33.994163 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3921932a-feaa-4719-85d0-05da7982d6d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:31:33.994509 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3921932a-feaa-4719-85d0-05da7982d6d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:33.996114 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3921932a-feaa-4719-85d0-05da7982d6d3 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:34.009121 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1117/2241] 10.222.0.62 () {58 vars in 1152 bytes} [Fri May 27 16:31:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:31:34.027143 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3921932a-feaa-4719-85d0-05da7982d6d3 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:34.048432 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3921932a-feaa-4719-85d0-05da7982d6d3 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:34.054164 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2936b345-dbe3-4860-ad62-4ee5b948604f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:34.054898 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936b345-dbe3-4860-ad62-4ee5b948604f admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:34.055188 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936b345-dbe3-4860-ad62-4ee5b948604f admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:34.055471 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936b345-dbe3-4860-ad62-4ee5b948604f admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:34.056235 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2936b345-dbe3-4860-ad62-4ee5b948604f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:34.058206 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2936b345-dbe3-4860-ad62-4ee5b948604f admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:34.066821 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1125/2242] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:31:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:31:34.100871 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255fa7f2-cf28-402b-a5e8-3ca74578c58b None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:34.111718 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255fa7f2-cf28-402b-a5e8-3ca74578c58b None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:34.116456 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa68e70-8ee9-4014-8322-00258acea155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:34.117225 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa68e70-8ee9-4014-8322-00258acea155 admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:34.117508 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa68e70-8ee9-4014-8322-00258acea155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:34.117783 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa68e70-8ee9-4014-8322-00258acea155 admin admin] PATH_INFO: `/v3/projects` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:34.118524 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa68e70-8ee9-4014-8322-00258acea155 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:34.120572 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa68e70-8ee9-4014-8322-00258acea155 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:34.284785 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1126/2243] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:31:34 2022] POST /identity/v3/projects => generated 373 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:31:34.289388 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa68e70-8ee9-4014-8322-00258acea155 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:34.290764 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1118/2244] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:31:34 2022] POST /identity/v3/projects => generated 373 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:31:34.292186 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2936b345-dbe3-4860-ad62-4ee5b948604f admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:34.426755 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa68e70-8ee9-4014-8322-00258acea155 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:34.448294 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2936b345-dbe3-4860-ad62-4ee5b948604f admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:34.456102 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c13f061-88de-47e5-95ee-72e095b5db9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:34.457920 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c13f061-88de-47e5-95ee-72e095b5db9f admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:34.458351 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c13f061-88de-47e5-95ee-72e095b5db9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:34.459058 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c13f061-88de-47e5-95ee-72e095b5db9f admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:34.459910 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c13f061-88de-47e5-95ee-72e095b5db9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:34.462237 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c13f061-88de-47e5-95ee-72e095b5db9f admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:34.507335 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897a4918-a424-4c1b-86d1-de2ecc905f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:34.518762 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a4918-a424-4c1b-86d1-de2ecc905f65 admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:34.519276 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a4918-a424-4c1b-86d1-de2ecc905f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:34.519392 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a4918-a424-4c1b-86d1-de2ecc905f65 admin admin] PATH_INFO: `/v3/users` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:34.520199 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897a4918-a424-4c1b-86d1-de2ecc905f65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:34.522409 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897a4918-a424-4c1b-86d1-de2ecc905f65 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:34.574365 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1119/2245] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:31:34 2022] POST /identity/v3/users => generated 287 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:31:34.579420 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c13f061-88de-47e5-95ee-72e095b5db9f admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:34.591162 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c13f061-88de-47e5-95ee-72e095b5db9f admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:34.598025 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a205625-daf4-4ad6-bb0a-cbacdb0f6ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:34.598768 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a205625-daf4-4ad6-bb0a-cbacdb0f6ffe admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:34.599051 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a205625-daf4-4ad6-bb0a-cbacdb0f6ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:34.599329 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a205625-daf4-4ad6-bb0a-cbacdb0f6ffe admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:34.600065 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a205625-daf4-4ad6-bb0a-cbacdb0f6ffe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:34.601676 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a205625-daf4-4ad6-bb0a-cbacdb0f6ffe admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:34.613197 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1120/2246] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:31:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 16:31:34.617290 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a205625-daf4-4ad6-bb0a-cbacdb0f6ffe admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:34.629561 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a205625-daf4-4ad6-bb0a-cbacdb0f6ffe admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:34.634472 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df72a536-6905-4e89-bca7-a384f7ecb375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:34.635457 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df72a536-6905-4e89-bca7-a384f7ecb375 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:34.635457 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df72a536-6905-4e89-bca7-a384f7ecb375 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:34.635710 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df72a536-6905-4e89-bca7-a384f7ecb375 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:34.636428 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df72a536-6905-4e89-bca7-a384f7ecb375 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:34.638012 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df72a536-6905-4e89-bca7-a384f7ecb375 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:34.648530 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1121/2247] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:31:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 16:31:34.652665 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df72a536-6905-4e89-bca7-a384f7ecb375 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:34.662411 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df72a536-6905-4e89-bca7-a384f7ecb375 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:34.675790 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65650e67-5c8f-434e-bbb8-a9f7140c93c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:34.675790 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65650e67-5c8f-434e-bbb8-a9f7140c93c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:34.675790 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65650e67-5c8f-434e-bbb8-a9f7140c93c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:34.675790 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65650e67-5c8f-434e-bbb8-a9f7140c93c7 admin admin] PATH_INFO: `/v3/projects/581db97f2f8a47dbb4f0ae722b8182a1/users/13540b5afaa746e8a56c736bed1944ca/roles/c8ce6d197f654598ac45f6016ecccabd` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:34.676435 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1127/2248] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:31:34 2022] POST /identity/v3/users => generated 293 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:31:34.679074 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897a4918-a424-4c1b-86d1-de2ecc905f65 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:34.697978 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897a4918-a424-4c1b-86d1-de2ecc905f65 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:34.702839 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17be5e10-47a4-4373-9161-c8a0d5cc14f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:34.711467 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65650e67-5c8f-434e-bbb8-a9f7140c93c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=581db97f2f8a47dbb4f0ae722b8182a1, user_id=13540b5afaa746e8a56c736bed1944ca, role_id=c8ce6d197f654598ac45f6016ecccabd)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:34.715540 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65650e67-5c8f-434e-bbb8-a9f7140c93c7 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:34.722077 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be5e10-47a4-4373-9161-c8a0d5cc14f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:34.722511 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be5e10-47a4-4373-9161-c8a0d5cc14f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:34.723119 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be5e10-47a4-4373-9161-c8a0d5cc14f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:34.724025 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17be5e10-47a4-4373-9161-c8a0d5cc14f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:34.725867 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17be5e10-47a4-4373-9161-c8a0d5cc14f8 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:34.737684 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1128/2249] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:31:34 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 16:31:34.741654 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17be5e10-47a4-4373-9161-c8a0d5cc14f8 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:34.751535 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17be5e10-47a4-4373-9161-c8a0d5cc14f8 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:34.756447 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7d4dd1-a225-44b3-bf4f-42a11d48da52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:34.757328 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d4dd1-a225-44b3-bf4f-42a11d48da52 admin admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:34.757625 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d4dd1-a225-44b3-bf4f-42a11d48da52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:34.757892 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d4dd1-a225-44b3-bf4f-42a11d48da52 admin admin] PATH_INFO: `/v3/projects/bd232c33a1bb48a49dc8270d50665900/users/428e5ab79a3343f493639297f67a22df/roles/e04fe3eb1f714d74901ac83e33ea8a16` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:34.772659 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7d4dd1-a225-44b3-bf4f-42a11d48da52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd232c33a1bb48a49dc8270d50665900, user_id=428e5ab79a3343f493639297f67a22df, role_id=e04fe3eb1f714d74901ac83e33ea8a16)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:34.775419 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7d4dd1-a225-44b3-bf4f-42a11d48da52 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:34.873794 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1122/2250] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:31:34 2022] PUT /identity/v3/projects/581db97f2f8a47dbb4f0ae722b8182a1/users/13540b5afaa746e8a56c736bed1944ca/roles/c8ce6d197f654598ac45f6016ecccabd => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:31:34.877815 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e50f606-d8be-4389-b167-9eba7698b26d None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:34.877964 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e50f606-d8be-4389-b167-9eba7698b26d None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:34.878231 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e50f606-d8be-4389-b167-9eba7698b26d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:34.892602 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1129/2251] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:31:34 2022] PUT /identity/v3/projects/bd232c33a1bb48a49dc8270d50665900/users/428e5ab79a3343f493639297f67a22df/roles/e04fe3eb1f714d74901ac83e33ea8a16 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:31:34.897643 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7d4dd1-a225-44b3-bf4f-42a11d48da52 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:34.917761 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-9e50f606-d8be-4389-b167-9eba7698b26d None None] MFA Rules not processed for user `13540b5afaa746e8a56c736bed1944ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:31:34.919038 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-9e50f606-d8be-4389-b167-9eba7698b26d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:34.992960 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7d4dd1-a225-44b3-bf4f-42a11d48da52 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:35.005598 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b868304-b4b6-4a4c-aba8-03f914b43af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:35.006357 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b868304-b4b6-4a4c-aba8-03f914b43af4 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:35.006637 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b868304-b4b6-4a4c-aba8-03f914b43af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:35.006985 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b868304-b4b6-4a4c-aba8-03f914b43af4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:35.007843 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b868304-b4b6-4a4c-aba8-03f914b43af4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:35.009591 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b868304-b4b6-4a4c-aba8-03f914b43af4 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:35.026758 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1130/2252] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:31:34 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:31:35.027384 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b868304-b4b6-4a4c-aba8-03f914b43af4 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:35.036322 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1123/2253] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:31:34 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:31:35.049975 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e50f606-d8be-4389-b167-9eba7698b26d None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:35.054984 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b868304-b4b6-4a4c-aba8-03f914b43af4 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:35.062562 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe41559-b846-4069-b63c-bde132c74ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:35.064226 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe41559-b846-4069-b63c-bde132c74ca4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:35.064840 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe41559-b846-4069-b63c-bde132c74ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:35.065510 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe41559-b846-4069-b63c-bde132c74ca4 admin admin] PATH_INFO: `/v3/projects/bd232c33a1bb48a49dc8270d50665900/users/428e5ab79a3343f493639297f67a22df/roles/e04fe3eb1f714d74901ac83e33ea8a16` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:35.069467 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe41559-b846-4069-b63c-bde132c74ca4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd232c33a1bb48a49dc8270d50665900, user_id=428e5ab79a3343f493639297f67a22df, role_id=e04fe3eb1f714d74901ac83e33ea8a16)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:35.074166 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe41559-b846-4069-b63c-bde132c74ca4 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:35.091475 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1131/2254] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:31:35 2022] PUT /identity/v3/projects/bd232c33a1bb48a49dc8270d50665900/users/428e5ab79a3343f493639297f67a22df/roles/e04fe3eb1f714d74901ac83e33ea8a16 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:31:35.103129 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd300e-d2de-4f0b-9dde-47033e6ce630 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:35.103429 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd300e-d2de-4f0b-9dde-47033e6ce630 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:35.103711 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd300e-d2de-4f0b-9dde-47033e6ce630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:35.131276 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e50f606-d8be-4389-b167-9eba7698b26d None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:35.154617 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-f7fd300e-d2de-4f0b-9dde-47033e6ce630 None None] MFA Rules not processed for user `428e5ab79a3343f493639297f67a22df`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:31:35.156174 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-f7fd300e-d2de-4f0b-9dde-47033e6ce630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:35.196454 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e7de57-385c-4c14-9050-00c31e64306e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8693a1e72f14fdfb383f11e96330726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:35.197406 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7de57-385c-4c14-9050-00c31e64306e service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:35.197882 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7de57-385c-4c14-9050-00c31e64306e service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:35.198380 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7de57-385c-4c14-9050-00c31e64306e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:35.238623 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1132/2255] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:31:35 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:31:35.292866 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e7de57-385c-4c14-9050-00c31e64306e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:35.298999 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e7de57-385c-4c14-9050-00c31e64306e service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:35.322242 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1124/2256] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:31:35 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 16:31:35.352512 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fd300e-d2de-4f0b-9dde-47033e6ce630 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:35.354339 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e7de57-385c-4c14-9050-00c31e64306e service cinder] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:35.355831 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-b3e7de57-385c-4c14-9050-00c31e64306e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:35.368840 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e7de57-385c-4c14-9050-00c31e64306e service cinder] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:35.374002 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88071a16-d38c-412f-822d-2302b53848aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8693a1e72f14fdfb383f11e96330726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:35.376342 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88071a16-d38c-412f-822d-2302b53848aa service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:35.376820 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88071a16-d38c-412f-822d-2302b53848aa service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:35.380913 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88071a16-d38c-412f-822d-2302b53848aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:35.471958 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fd300e-d2de-4f0b-9dde-47033e6ce630 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:35.476175 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88071a16-d38c-412f-822d-2302b53848aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:35.477717 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88071a16-d38c-412f-822d-2302b53848aa service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:35.488034 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fa1cee-32cf-49f7-a36d-07f38dcbbd5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:35.489174 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa1cee-32cf-49f7-a36d-07f38dcbbd5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:35.489554 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa1cee-32cf-49f7-a36d-07f38dcbbd5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:35.490100 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa1cee-32cf-49f7-a36d-07f38dcbbd5a admin admin] PATH_INFO: `/v3/users/13540b5afaa746e8a56c736bed1944ca` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:35.491105 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1125/2257] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:31:35 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 16:31:35.491832 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fa1cee-32cf-49f7-a36d-07f38dcbbd5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=13540b5afaa746e8a56c736bed1944ca)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:35.493863 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fa1cee-32cf-49f7-a36d-07f38dcbbd5a admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:35.784423 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-f3fa1cee-32cf-49f7-a36d-07f38dcbbd5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13540b5afaa746e8a56c736bed1944ca'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:35.800013 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-f3fa1cee-32cf-49f7-a36d-07f38dcbbd5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13540b5afaa746e8a56c736bed1944ca'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:35.800813 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-f3fa1cee-32cf-49f7-a36d-07f38dcbbd5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13540b5afaa746e8a56c736bed1944ca'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:35.801673 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-f3fa1cee-32cf-49f7-a36d-07f38dcbbd5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13540b5afaa746e8a56c736bed1944ca'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:35.806694 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:31:35.913293 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-f3fa1cee-32cf-49f7-a36d-07f38dcbbd5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13540b5afaa746e8a56c736bed1944ca'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:35.953244 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1133/2258] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:31:35 2022] DELETE /identity/v3/users/13540b5afaa746e8a56c736bed1944ca => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:31:35.958463 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d5f4cb-7e3a-4b85-bdaa-42207b3839ca None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:35.958763 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d5f4cb-7e3a-4b85-bdaa-42207b3839ca None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:35.959049 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d5f4cb-7e3a-4b85-bdaa-42207b3839ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:35.981392 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-67d5f4cb-7e3a-4b85-bdaa-42207b3839ca None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:31:35.982668 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-67d5f4cb-7e3a-4b85-bdaa-42207b3839ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:36.046148 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fa1cee-32cf-49f7-a36d-07f38dcbbd5a admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:36.048186 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-f3fa1cee-32cf-49f7-a36d-07f38dcbbd5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:36.072012 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1126/2259] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:31:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:31:36.117701 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d5f4cb-7e3a-4b85-bdaa-42207b3839ca None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:36.120141 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-67d5f4cb-7e3a-4b85-bdaa-42207b3839ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:36.144731 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fa1cee-32cf-49f7-a36d-07f38dcbbd5a admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:36.152092 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0724e29-75d9-45ea-ab85-523b97fb7314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:36.153759 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0724e29-75d9-45ea-ab85-523b97fb7314 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:36.154201 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0724e29-75d9-45ea-ab85-523b97fb7314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:36.154516 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0724e29-75d9-45ea-ab85-523b97fb7314 admin admin] PATH_INFO: `/v3/users/9fc5d1641d5047b89fdb6d23b053a2c5` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:36.155794 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0724e29-75d9-45ea-ab85-523b97fb7314 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fc5d1641d5047b89fdb6d23b053a2c5)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:36.159470 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0724e29-75d9-45ea-ab85-523b97fb7314 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:36.231349 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d5f4cb-7e3a-4b85-bdaa-42207b3839ca None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:36.239760 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78af7c2-b299-49b8-a01b-e06d71537a79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:36.239760 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78af7c2-b299-49b8-a01b-e06d71537a79 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:36.239760 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78af7c2-b299-49b8-a01b-e06d71537a79 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:36.239760 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78af7c2-b299-49b8-a01b-e06d71537a79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:36.247719 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78af7c2-b299-49b8-a01b-e06d71537a79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:36.249250 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78af7c2-b299-49b8-a01b-e06d71537a79 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:36.266876 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1127/2260] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:31:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 16:31:36.585548 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-c0724e29-75d9-45ea-ab85-523b97fb7314 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fc5d1641d5047b89fdb6d23b053a2c5'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:36.600494 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-c0724e29-75d9-45ea-ab85-523b97fb7314 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fc5d1641d5047b89fdb6d23b053a2c5'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:36.601373 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-c0724e29-75d9-45ea-ab85-523b97fb7314 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fc5d1641d5047b89fdb6d23b053a2c5'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:36.605914 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-c0724e29-75d9-45ea-ab85-523b97fb7314 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fc5d1641d5047b89fdb6d23b053a2c5'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:36.665007 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:31:36.735620 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-c0724e29-75d9-45ea-ab85-523b97fb7314 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fc5d1641d5047b89fdb6d23b053a2c5'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:36.761863 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1134/2261] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:31:36 2022] DELETE /identity/v3/users/9fc5d1641d5047b89fdb6d23b053a2c5 => generated 0 bytes in 716 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:31:36.766598 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65966e1f-80bf-4682-9d9c-c4bd3f810c2c None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:36.767002 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65966e1f-80bf-4682-9d9c-c4bd3f810c2c None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:36.767176 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65966e1f-80bf-4682-9d9c-c4bd3f810c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:36.795483 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-65966e1f-80bf-4682-9d9c-c4bd3f810c2c None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:31:36.796968 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-65966e1f-80bf-4682-9d9c-c4bd3f810c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:36.871447 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1128/2262] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:31:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:31:36.882318 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0724e29-75d9-45ea-ab85-523b97fb7314 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:36.884378 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-c0724e29-75d9-45ea-ab85-523b97fb7314 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:36.946045 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0724e29-75d9-45ea-ab85-523b97fb7314 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:36.949781 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54155ab0-aea6-4ca0-a1a7-8ab2ae95afbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:36.951297 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54155ab0-aea6-4ca0-a1a7-8ab2ae95afbc service neutron] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:36.951438 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54155ab0-aea6-4ca0-a1a7-8ab2ae95afbc service neutron] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:36.951618 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54155ab0-aea6-4ca0-a1a7-8ab2ae95afbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:36.961370 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54155ab0-aea6-4ca0-a1a7-8ab2ae95afbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:36.962894 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54155ab0-aea6-4ca0-a1a7-8ab2ae95afbc service neutron] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:36.974494 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1135/2263] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:31:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:31:37.117366 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65966e1f-80bf-4682-9d9c-c4bd3f810c2c None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:37.119056 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-65966e1f-80bf-4682-9d9c-c4bd3f810c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:37.137474 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65966e1f-80bf-4682-9d9c-c4bd3f810c2c None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:37.147126 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e6f37a-2fdf-4f45-a28a-7bc5abd34ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:37.148328 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e6f37a-2fdf-4f45-a28a-7bc5abd34ac6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:37.148728 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e6f37a-2fdf-4f45-a28a-7bc5abd34ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:37.149114 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e6f37a-2fdf-4f45-a28a-7bc5abd34ac6 admin admin] PATH_INFO: `/v3/projects/581db97f2f8a47dbb4f0ae722b8182a1` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:37.150531 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e6f37a-2fdf-4f45-a28a-7bc5abd34ac6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=581db97f2f8a47dbb4f0ae722b8182a1)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:37.152589 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e6f37a-2fdf-4f45-a28a-7bc5abd34ac6 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:37.320747 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-95e6f37a-2fdf-4f45-a28a-7bc5abd34ac6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '581db97f2f8a47dbb4f0ae722b8182a1', 'request_id': 'req-95e6f37a-2fdf-4f45-a28a-7bc5abd34ac6'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:37.327902 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-95e6f37a-2fdf-4f45-a28a-7bc5abd34ac6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '581db97f2f8a47dbb4f0ae722b8182a1', 'request_id': 'req-95e6f37a-2fdf-4f45-a28a-7bc5abd34ac6'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:37.403654 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-95e6f37a-2fdf-4f45-a28a-7bc5abd34ac6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '581db97f2f8a47dbb4f0ae722b8182a1', 'request_id': 'req-95e6f37a-2fdf-4f45-a28a-7bc5abd34ac6'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:37.421429 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-95e6f37a-2fdf-4f45-a28a-7bc5abd34ac6 admin admin] The token cache is being invalidate because project 581db97f2f8a47dbb4f0ae722b8182a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:31:37.423705 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-95e6f37a-2fdf-4f45-a28a-7bc5abd34ac6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:37.430137 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-95e6f37a-2fdf-4f45-a28a-7bc5abd34ac6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:37.433949 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1129/2264] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:31:37 2022] DELETE /identity/v3/projects/581db97f2f8a47dbb4f0ae722b8182a1 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:31:37.439483 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b301f-3ed2-43f4-87cd-c1107f63935c None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:37.439823 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b301f-3ed2-43f4-87cd-c1107f63935c None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:37.440145 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b301f-3ed2-43f4-87cd-c1107f63935c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:37.485803 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-332b301f-3ed2-43f4-87cd-c1107f63935c None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:31:37.489157 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-332b301f-3ed2-43f4-87cd-c1107f63935c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:37.600121 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1136/2265] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:31:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:31:37.602547 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a78580-5099-4800-b75f-d31e5a6ca0b2 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:37.602905 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a78580-5099-4800-b75f-d31e5a6ca0b2 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:37.603188 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a78580-5099-4800-b75f-d31e5a6ca0b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:37.626298 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-c4a78580-5099-4800-b75f-d31e5a6ca0b2 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:31:37.628192 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-c4a78580-5099-4800-b75f-d31e5a6ca0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:37.638864 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1130/2266] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:31:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:31:37.643068 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332b301f-3ed2-43f4-87cd-c1107f63935c None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:37.653342 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332b301f-3ed2-43f4-87cd-c1107f63935c None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:37.659406 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90194653-8bfb-448a-80cc-5206f6edeef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:37.660304 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90194653-8bfb-448a-80cc-5206f6edeef0 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:37.660304 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90194653-8bfb-448a-80cc-5206f6edeef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:37.660520 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90194653-8bfb-448a-80cc-5206f6edeef0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:37.661314 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90194653-8bfb-448a-80cc-5206f6edeef0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:31:37.661702 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90194653-8bfb-448a-80cc-5206f6edeef0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:37.663264 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90194653-8bfb-448a-80cc-5206f6edeef0 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:37.682698 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1137/2267] 10.222.0.62 () {58 vars in 1152 bytes} [Fri May 27 16:31:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:31:37.695226 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a78580-5099-4800-b75f-d31e5a6ca0b2 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:37.705541 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a78580-5099-4800-b75f-d31e5a6ca0b2 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:37.717205 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172d43f1-e04e-475c-9ce3-64dd0a5a48d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:37.718653 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d43f1-e04e-475c-9ce3-64dd0a5a48d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:37.719626 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d43f1-e04e-475c-9ce3-64dd0a5a48d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:37.719626 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d43f1-e04e-475c-9ce3-64dd0a5a48d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:37.733853 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172d43f1-e04e-475c-9ce3-64dd0a5a48d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:37.741235 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172d43f1-e04e-475c-9ce3-64dd0a5a48d7 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:37.937589 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90194653-8bfb-448a-80cc-5206f6edeef0 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:37.938795 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1131/2268] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:31:37 2022] POST /identity/v3/projects => generated 385 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:31:37.939461 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-90194653-8bfb-448a-80cc-5206f6edeef0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:37.940726 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172d43f1-e04e-475c-9ce3-64dd0a5a48d7 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:37.985906 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90194653-8bfb-448a-80cc-5206f6edeef0 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:38.032466 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172d43f1-e04e-475c-9ce3-64dd0a5a48d7 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:38.038656 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b861351a-9cbf-4ac0-bcc6-6c79070f20d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:38.039338 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861351a-9cbf-4ac0-bcc6-6c79070f20d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:38.039620 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861351a-9cbf-4ac0-bcc6-6c79070f20d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:38.039918 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861351a-9cbf-4ac0-bcc6-6c79070f20d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:38.040598 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b861351a-9cbf-4ac0-bcc6-6c79070f20d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:38.042651 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b861351a-9cbf-4ac0-bcc6-6c79070f20d1 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:38.068093 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54488783-6506-40e5-a901-1edc4ccc77ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:38.069082 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54488783-6506-40e5-a901-1edc4ccc77ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:38.069442 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54488783-6506-40e5-a901-1edc4ccc77ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:38.069791 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54488783-6506-40e5-a901-1edc4ccc77ac admin admin] PATH_INFO: `/v3/projects/84b4b0f9a9334a248352f9462e575223` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:38.071168 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54488783-6506-40e5-a901-1edc4ccc77ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=84b4b0f9a9334a248352f9462e575223)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:38.073150 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54488783-6506-40e5-a901-1edc4ccc77ac admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:38.215317 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1132/2269] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:31:37 2022] POST /identity/v3/users => generated 293 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:31:38.219556 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b861351a-9cbf-4ac0-bcc6-6c79070f20d1 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:38.228218 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-54488783-6506-40e5-a901-1edc4ccc77ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84b4b0f9a9334a248352f9462e575223', 'request_id': 'req-54488783-6506-40e5-a901-1edc4ccc77ac'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:38.231541 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b861351a-9cbf-4ac0-bcc6-6c79070f20d1 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:38.235376 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-54488783-6506-40e5-a901-1edc4ccc77ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84b4b0f9a9334a248352f9462e575223', 'request_id': 'req-54488783-6506-40e5-a901-1edc4ccc77ac'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:38.242006 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-54488783-6506-40e5-a901-1edc4ccc77ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84b4b0f9a9334a248352f9462e575223', 'request_id': 'req-54488783-6506-40e5-a901-1edc4ccc77ac'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:38.291040 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931d1650-cca9-4ff8-a88b-62937f42c042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:38.291767 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d1650-cca9-4ff8-a88b-62937f42c042 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:38.292056 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d1650-cca9-4ff8-a88b-62937f42c042 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:38.292340 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d1650-cca9-4ff8-a88b-62937f42c042 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:38.293073 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931d1650-cca9-4ff8-a88b-62937f42c042 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:38.294783 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931d1650-cca9-4ff8-a88b-62937f42c042 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:38.305105 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1133/2270] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:31:38 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 16:31:38.309198 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931d1650-cca9-4ff8-a88b-62937f42c042 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:38.319104 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931d1650-cca9-4ff8-a88b-62937f42c042 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:38.323840 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac30b316-f0ce-4815-8fba-d39f4090d4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:38.324506 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30b316-f0ce-4815-8fba-d39f4090d4ca admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:38.324793 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30b316-f0ce-4815-8fba-d39f4090d4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:38.325070 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30b316-f0ce-4815-8fba-d39f4090d4ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:38.325861 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac30b316-f0ce-4815-8fba-d39f4090d4ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:38.327511 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac30b316-f0ce-4815-8fba-d39f4090d4ca admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:38.338080 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:31:38.344038 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-54488783-6506-40e5-a901-1edc4ccc77ac admin admin] The token cache is being invalidate because project 84b4b0f9a9334a248352f9462e575223 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80288) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:31:38.344393 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-54488783-6506-40e5-a901-1edc4ccc77ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:38.345257 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-54488783-6506-40e5-a901-1edc4ccc77ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:38.348225 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1138/2271] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:31:37 2022] DELETE /identity/v3/projects/84b4b0f9a9334a248352f9462e575223 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:31:38.356627 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46375ab7-e622-483d-99f7-951e975e9491 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:38.356627 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46375ab7-e622-483d-99f7-951e975e9491 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:38.356627 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46375ab7-e622-483d-99f7-951e975e9491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:38.360478 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1134/2272] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:31:38 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 16:31:38.361219 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac30b316-f0ce-4815-8fba-d39f4090d4ca admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:38.363408 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-ac30b316-f0ce-4815-8fba-d39f4090d4ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:38.374400 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-46375ab7-e622-483d-99f7-951e975e9491 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:31:38.375768 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-46375ab7-e622-483d-99f7-951e975e9491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:38.379699 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac30b316-f0ce-4815-8fba-d39f4090d4ca admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:38.384861 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ebd369-9e85-434c-895f-b463efb4fcf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:38.386712 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ebd369-9e85-434c-895f-b463efb4fcf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:38.387000 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ebd369-9e85-434c-895f-b463efb4fcf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:38.387284 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ebd369-9e85-434c-895f-b463efb4fcf8 admin admin] PATH_INFO: `/v3/projects/201aabad0757499e8e31377653214db3/users/2e22815be7b4416a8bdd118c2037b01d/roles/c8ce6d197f654598ac45f6016ecccabd` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:38.392655 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1139/2273] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:31:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:31:38.394747 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ee97f-7610-4212-adba-7ee09c249cf8 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:38.395133 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ee97f-7610-4212-adba-7ee09c249cf8 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:38.395514 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ee97f-7610-4212-adba-7ee09c249cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:38.404128 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ebd369-9e85-434c-895f-b463efb4fcf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=201aabad0757499e8e31377653214db3, user_id=2e22815be7b4416a8bdd118c2037b01d, role_id=c8ce6d197f654598ac45f6016ecccabd)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:38.406862 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ebd369-9e85-434c-895f-b463efb4fcf8 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:38.415314 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-e47ee97f-7610-4212-adba-7ee09c249cf8 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:31:38.416576 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-e47ee97f-7610-4212-adba-7ee09c249cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:38.429742 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1140/2274] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:31:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:31:38.434593 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47ee97f-7610-4212-adba-7ee09c249cf8 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:38.445735 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47ee97f-7610-4212-adba-7ee09c249cf8 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:38.452064 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f445565-2739-4876-9de9-c70fbe53e757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:38.452732 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f445565-2739-4876-9de9-c70fbe53e757 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:38.453029 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f445565-2739-4876-9de9-c70fbe53e757 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:38.453307 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f445565-2739-4876-9de9-c70fbe53e757 admin admin] PATH_INFO: `/v3/domains` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:38.454054 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f445565-2739-4876-9de9-c70fbe53e757 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:31:38.454379 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f445565-2739-4876-9de9-c70fbe53e757 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:38.456153 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f445565-2739-4876-9de9-c70fbe53e757 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:38.472074 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1141/2275] 10.222.0.62 () {58 vars in 1152 bytes} [Fri May 27 16:31:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:31:38.473713 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f445565-2739-4876-9de9-c70fbe53e757 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:38.484818 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f445565-2739-4876-9de9-c70fbe53e757 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:38.614972 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523eb610-bd7e-4dd5-b166-f345f3b2a49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:38.614972 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523eb610-bd7e-4dd5-b166-f345f3b2a49b admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:38.614972 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523eb610-bd7e-4dd5-b166-f345f3b2a49b admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:38.614972 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523eb610-bd7e-4dd5-b166-f345f3b2a49b admin admin] PATH_INFO: `/v3/projects` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:38.617062 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523eb610-bd7e-4dd5-b166-f345f3b2a49b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:38.617062 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523eb610-bd7e-4dd5-b166-f345f3b2a49b admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:38.781619 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1135/2276] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:31:38 2022] PUT /identity/v3/projects/201aabad0757499e8e31377653214db3/users/2e22815be7b4416a8bdd118c2037b01d/roles/c8ce6d197f654598ac45f6016ecccabd => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:31:38.792867 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f27061-5a16-47f3-a313-c1e7b98f883f None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:38.793274 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f27061-5a16-47f3-a313-c1e7b98f883f None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:38.793709 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f27061-5a16-47f3-a313-c1e7b98f883f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:38.828184 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-64f27061-5a16-47f3-a313-c1e7b98f883f None None] MFA Rules not processed for user `2e22815be7b4416a8bdd118c2037b01d`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:31:38.829944 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-64f27061-5a16-47f3-a313-c1e7b98f883f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:38.849950 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1142/2277] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:31:38 2022] POST /identity/v3/projects => generated 375 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:31:38.854056 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523eb610-bd7e-4dd5-b166-f345f3b2a49b admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:38.916359 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1136/2278] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:31:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:31:38.948858 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f27061-5a16-47f3-a313-c1e7b98f883f None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:38.954788 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-64f27061-5a16-47f3-a313-c1e7b98f883f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:38.979174 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523eb610-bd7e-4dd5-b166-f345f3b2a49b admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:38.984095 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffdb22d-9ab7-41ac-8691-4d95e0b57721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:38.984827 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffdb22d-9ab7-41ac-8691-4d95e0b57721 admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:38.985425 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffdb22d-9ab7-41ac-8691-4d95e0b57721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:38.985733 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffdb22d-9ab7-41ac-8691-4d95e0b57721 admin admin] PATH_INFO: `/v3/users` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:38.986487 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffdb22d-9ab7-41ac-8691-4d95e0b57721 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:38.988547 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffdb22d-9ab7-41ac-8691-4d95e0b57721 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:39.058705 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f27061-5a16-47f3-a313-c1e7b98f883f None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:39.110435 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a0cf69-e6e7-4955-b823-1fe6b43a7a40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8693a1e72f14fdfb383f11e96330726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:39.111134 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0cf69-e6e7-4955-b823-1fe6b43a7a40 service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:39.111371 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0cf69-e6e7-4955-b823-1fe6b43a7a40 service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:39.111682 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0cf69-e6e7-4955-b823-1fe6b43a7a40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:39.153101 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1143/2279] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:31:38 2022] POST /identity/v3/users => generated 288 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:31:39.156778 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffdb22d-9ab7-41ac-8691-4d95e0b57721 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:39.166894 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffdb22d-9ab7-41ac-8691-4d95e0b57721 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:39.171809 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91838f37-8b9c-4dbb-a758-7248b28479ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:39.177926 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91838f37-8b9c-4dbb-a758-7248b28479ee admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:39.177926 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91838f37-8b9c-4dbb-a758-7248b28479ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:39.177926 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91838f37-8b9c-4dbb-a758-7248b28479ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:39.177926 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91838f37-8b9c-4dbb-a758-7248b28479ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:39.178287 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a0cf69-e6e7-4955-b823-1fe6b43a7a40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:39.178425 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91838f37-8b9c-4dbb-a758-7248b28479ee admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:39.178533 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a0cf69-e6e7-4955-b823-1fe6b43a7a40 service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:39.185087 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1137/2280] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:31:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 16:31:39.188714 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1144/2281] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:31:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 16:31:39.191311 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a0cf69-e6e7-4955-b823-1fe6b43a7a40 service cinder] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:39.202093 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a0cf69-e6e7-4955-b823-1fe6b43a7a40 service cinder] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:39.204592 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:31:39.212226 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03783fe-6255-45be-855a-f9b2d9f58097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:39.212226 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03783fe-6255-45be-855a-f9b2d9f58097 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:39.212226 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03783fe-6255-45be-855a-f9b2d9f58097 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:39.212566 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03783fe-6255-45be-855a-f9b2d9f58097 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:39.213148 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03783fe-6255-45be-855a-f9b2d9f58097 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:39.214797 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03783fe-6255-45be-855a-f9b2d9f58097 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:39.236702 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1138/2282] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:31:39 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:31:39.241226 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91838f37-8b9c-4dbb-a758-7248b28479ee admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:39.251773 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91838f37-8b9c-4dbb-a758-7248b28479ee admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:39.257805 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4770df-ea95-47d5-99cf-2c3d567d5a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:39.259260 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4770df-ea95-47d5-99cf-2c3d567d5a52 admin admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:39.259885 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4770df-ea95-47d5-99cf-2c3d567d5a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:39.260327 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4770df-ea95-47d5-99cf-2c3d567d5a52 admin admin] PATH_INFO: `/v3/projects/c91a21c5b48948c2b9b1f28457427577/users/1f6ba581006346278f679ac4083d233b/roles/c8ce6d197f654598ac45f6016ecccabd` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:39.280162 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4770df-ea95-47d5-99cf-2c3d567d5a52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c91a21c5b48948c2b9b1f28457427577, user_id=1f6ba581006346278f679ac4083d233b, role_id=c8ce6d197f654598ac45f6016ecccabd)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:39.284683 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4770df-ea95-47d5-99cf-2c3d567d5a52 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:39.300442 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03783fe-6255-45be-855a-f9b2d9f58097 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:39.302814 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-f03783fe-6255-45be-855a-f9b2d9f58097 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:39.317265 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03783fe-6255-45be-855a-f9b2d9f58097 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:39.323515 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e017a02f-f061-46ae-ba9d-595f1dc620b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:39.324608 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e017a02f-f061-46ae-ba9d-595f1dc620b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:39.327162 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e017a02f-f061-46ae-ba9d-595f1dc620b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:39.327162 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e017a02f-f061-46ae-ba9d-595f1dc620b9 admin admin] PATH_INFO: `/v3/users/aa5703a19a494b2c86fd7c9e6a872dff` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:39.327162 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e017a02f-f061-46ae-ba9d-595f1dc620b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa5703a19a494b2c86fd7c9e6a872dff)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:39.329880 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e017a02f-f061-46ae-ba9d-595f1dc620b9 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:39.465151 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1145/2283] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:31:39 2022] PUT /identity/v3/projects/c91a21c5b48948c2b9b1f28457427577/users/1f6ba581006346278f679ac4083d233b/roles/c8ce6d197f654598ac45f6016ecccabd => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:31:39.475594 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896caa2e-b6a6-4eee-be7b-bd52f7116625 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:39.476283 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896caa2e-b6a6-4eee-be7b-bd52f7116625 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:39.476283 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896caa2e-b6a6-4eee-be7b-bd52f7116625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:39.511828 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-896caa2e-b6a6-4eee-be7b-bd52f7116625 None None] MFA Rules not processed for user `1f6ba581006346278f679ac4083d233b`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:31:39.513497 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-896caa2e-b6a6-4eee-be7b-bd52f7116625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:39.581572 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1146/2284] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:31:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:31:39.592279 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896caa2e-b6a6-4eee-be7b-bd52f7116625 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:39.593634 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-896caa2e-b6a6-4eee-be7b-bd52f7116625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:39.641909 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-e017a02f-f061-46ae-ba9d-595f1dc620b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa5703a19a494b2c86fd7c9e6a872dff'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:39.651059 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-e017a02f-f061-46ae-ba9d-595f1dc620b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa5703a19a494b2c86fd7c9e6a872dff'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:39.651920 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-e017a02f-f061-46ae-ba9d-595f1dc620b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa5703a19a494b2c86fd7c9e6a872dff'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:39.652588 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-e017a02f-f061-46ae-ba9d-595f1dc620b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa5703a19a494b2c86fd7c9e6a872dff'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:39.665946 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896caa2e-b6a6-4eee-be7b-bd52f7116625 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:39.669720 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9289f3d1-216e-4efc-a171-551f36156984 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8693a1e72f14fdfb383f11e96330726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:39.670399 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9289f3d1-216e-4efc-a171-551f36156984 service cinder] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:39.670687 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9289f3d1-216e-4efc-a171-551f36156984 service cinder] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:39.670966 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9289f3d1-216e-4efc-a171-551f36156984 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:39.672752 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-9289f3d1-216e-4efc-a171-551f36156984 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:39.684102 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9289f3d1-216e-4efc-a171-551f36156984 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:39.685529 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9289f3d1-216e-4efc-a171-551f36156984 service cinder] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:39.694787 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1147/2285] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:31:39 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 16:31:39.761834 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-e017a02f-f061-46ae-ba9d-595f1dc620b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa5703a19a494b2c86fd7c9e6a872dff'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:39.780611 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1139/2286] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:31:39 2022] DELETE /identity/v3/users/aa5703a19a494b2c86fd7c9e6a872dff => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:31:39.785230 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b53530-b4a4-4def-b7da-67bf5a0bfbbc None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:39.785528 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b53530-b4a4-4def-b7da-67bf5a0bfbbc None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:39.785810 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b53530-b4a4-4def-b7da-67bf5a0bfbbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:39.803794 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-15b53530-b4a4-4def-b7da-67bf5a0bfbbc None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:31:39.805090 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-15b53530-b4a4-4def-b7da-67bf5a0bfbbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:39.867311 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1148/2287] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:31:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:31:39.877160 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e017a02f-f061-46ae-ba9d-595f1dc620b9 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:39.879159 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-e017a02f-f061-46ae-ba9d-595f1dc620b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:39.956986 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e017a02f-f061-46ae-ba9d-595f1dc620b9 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:39.972394 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b5845a-1068-40f9-a886-4b1ead117394 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:39.974157 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5845a-1068-40f9-a886-4b1ead117394 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:39.974157 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5845a-1068-40f9-a886-4b1ead117394 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:39.974157 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5845a-1068-40f9-a886-4b1ead117394 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:39.995821 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b5845a-1068-40f9-a886-4b1ead117394 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:39.997913 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b5845a-1068-40f9-a886-4b1ead117394 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:40.020187 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1140/2288] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:31:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:31:40.890662 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:31:40.946318 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b53530-b4a4-4def-b7da-67bf5a0bfbbc None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:40.948457 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-15b53530-b4a4-4def-b7da-67bf5a0bfbbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:40.964687 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b53530-b4a4-4def-b7da-67bf5a0bfbbc None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:40.976554 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6001e136-795d-48c3-addf-c8a79d365580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:40.978819 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6001e136-795d-48c3-addf-c8a79d365580 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:40.979199 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6001e136-795d-48c3-addf-c8a79d365580 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:40.979492 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6001e136-795d-48c3-addf-c8a79d365580 admin admin] PATH_INFO: `/v3/projects/08916e445000497aa15ba006b0bd32d9` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:40.981466 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6001e136-795d-48c3-addf-c8a79d365580 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08916e445000497aa15ba006b0bd32d9)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:40.983525 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6001e136-795d-48c3-addf-c8a79d365580 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:41.192768 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-6001e136-795d-48c3-addf-c8a79d365580 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08916e445000497aa15ba006b0bd32d9', 'request_id': 'req-6001e136-795d-48c3-addf-c8a79d365580'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:41.198918 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-6001e136-795d-48c3-addf-c8a79d365580 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08916e445000497aa15ba006b0bd32d9', 'request_id': 'req-6001e136-795d-48c3-addf-c8a79d365580'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:41.204406 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-6001e136-795d-48c3-addf-c8a79d365580 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08916e445000497aa15ba006b0bd32d9', 'request_id': 'req-6001e136-795d-48c3-addf-c8a79d365580'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:41.338931 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-6001e136-795d-48c3-addf-c8a79d365580 admin admin] The token cache is being invalidate because project 08916e445000497aa15ba006b0bd32d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80288) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:31:41.339282 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-6001e136-795d-48c3-addf-c8a79d365580 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:41.346699 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-6001e136-795d-48c3-addf-c8a79d365580 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:41.346699 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1149/2289] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:31:40 2022] DELETE /identity/v3/projects/08916e445000497aa15ba006b0bd32d9 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:31:41.348535 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b5845a-1068-40f9-a886-4b1ead117394 service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:41.362332 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b5845a-1068-40f9-a886-4b1ead117394 service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:41.427660 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac2a737-ca6e-40d3-a5df-5ecfa98b015c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:41.428713 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac2a737-ca6e-40d3-a5df-5ecfa98b015c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:41.429075 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac2a737-ca6e-40d3-a5df-5ecfa98b015c admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:41.429425 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac2a737-ca6e-40d3-a5df-5ecfa98b015c admin admin] PATH_INFO: `/v3/users/428e5ab79a3343f493639297f67a22df` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:41.430815 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac2a737-ca6e-40d3-a5df-5ecfa98b015c admin admin] RBAC: Authorizing `identity:delete_user(user_id=428e5ab79a3343f493639297f67a22df)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:41.438423 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac2a737-ca6e-40d3-a5df-5ecfa98b015c admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:41.621443 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:31:41.737388 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-fac2a737-ca6e-40d3-a5df-5ecfa98b015c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '428e5ab79a3343f493639297f67a22df'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:41.744501 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-fac2a737-ca6e-40d3-a5df-5ecfa98b015c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '428e5ab79a3343f493639297f67a22df'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:41.745176 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-fac2a737-ca6e-40d3-a5df-5ecfa98b015c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '428e5ab79a3343f493639297f67a22df'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:41.745796 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-fac2a737-ca6e-40d3-a5df-5ecfa98b015c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '428e5ab79a3343f493639297f67a22df'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:41.915687 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-fac2a737-ca6e-40d3-a5df-5ecfa98b015c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '428e5ab79a3343f493639297f67a22df'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:41.933944 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1141/2290] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:31:41 2022] DELETE /identity/v3/users/428e5ab79a3343f493639297f67a22df => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:31:42.254233 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:31:42.590181 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6001e136-795d-48c3-addf-c8a79d365580 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:42.591941 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-6001e136-795d-48c3-addf-c8a79d365580 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:42.605920 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6001e136-795d-48c3-addf-c8a79d365580 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:42.664306 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2607201c-9ff0-46b4-8d18-0088ed470dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:42.665167 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2607201c-9ff0-46b4-8d18-0088ed470dc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:42.665455 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2607201c-9ff0-46b4-8d18-0088ed470dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:42.665737 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2607201c-9ff0-46b4-8d18-0088ed470dc1 admin admin] PATH_INFO: `/v3/projects/bd232c33a1bb48a49dc8270d50665900` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:42.667098 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2607201c-9ff0-46b4-8d18-0088ed470dc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd232c33a1bb48a49dc8270d50665900)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:42.669033 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2607201c-9ff0-46b4-8d18-0088ed470dc1 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:42.933181 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-2607201c-9ff0-46b4-8d18-0088ed470dc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd232c33a1bb48a49dc8270d50665900', 'request_id': 'req-2607201c-9ff0-46b4-8d18-0088ed470dc1'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:42.940047 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-2607201c-9ff0-46b4-8d18-0088ed470dc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd232c33a1bb48a49dc8270d50665900', 'request_id': 'req-2607201c-9ff0-46b4-8d18-0088ed470dc1'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:42.945464 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-2607201c-9ff0-46b4-8d18-0088ed470dc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd232c33a1bb48a49dc8270d50665900', 'request_id': 'req-2607201c-9ff0-46b4-8d18-0088ed470dc1'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:43.106665 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-2607201c-9ff0-46b4-8d18-0088ed470dc1 admin admin] The token cache is being invalidate because project bd232c33a1bb48a49dc8270d50665900 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80288) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:31:43.107429 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-2607201c-9ff0-46b4-8d18-0088ed470dc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:43.108126 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-2607201c-9ff0-46b4-8d18-0088ed470dc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:43.109996 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1150/2291] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:31:42 2022] DELETE /identity/v3/projects/bd232c33a1bb48a49dc8270d50665900 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:31:43.115261 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e3c06-a1f4-459f-b201-14daf4763223 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:43.115766 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e3c06-a1f4-459f-b201-14daf4763223 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:43.115870 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e3c06-a1f4-459f-b201-14daf4763223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:43.162624 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-e17e3c06-a1f4-459f-b201-14daf4763223 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:31:43.162624 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-e17e3c06-a1f4-459f-b201-14daf4763223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:43.234370 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1142/2292] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:31:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:31:43.242679 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c30a8a-92ee-4fc0-954a-4c02cd5fc9fc None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:43.242877 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c30a8a-92ee-4fc0-954a-4c02cd5fc9fc None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:43.243118 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c30a8a-92ee-4fc0-954a-4c02cd5fc9fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:43.275664 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-b2c30a8a-92ee-4fc0-954a-4c02cd5fc9fc None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:31:43.276888 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-b2c30a8a-92ee-4fc0-954a-4c02cd5fc9fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:43.286503 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1151/2293] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:31:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:31:43.308429 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17e3c06-a1f4-459f-b201-14daf4763223 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:43.318331 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17e3c06-a1f4-459f-b201-14daf4763223 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:43.323516 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa8223c-fc33-495b-995d-03c9ba39000d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:43.324229 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8223c-fc33-495b-995d-03c9ba39000d admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:43.324514 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8223c-fc33-495b-995d-03c9ba39000d admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:43.324794 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8223c-fc33-495b-995d-03c9ba39000d admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:43.325526 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa8223c-fc33-495b-995d-03c9ba39000d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:31:43.325836 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa8223c-fc33-495b-995d-03c9ba39000d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:43.327502 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa8223c-fc33-495b-995d-03c9ba39000d admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:43.339709 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1143/2294] 10.222.0.62 () {58 vars in 1152 bytes} [Fri May 27 16:31:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:31:43.343809 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c30a8a-92ee-4fc0-954a-4c02cd5fc9fc None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:43.353835 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c30a8a-92ee-4fc0-954a-4c02cd5fc9fc None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:43.358590 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d7ae8e-dde3-47a4-a694-15594a5e0286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:43.359280 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7ae8e-dde3-47a4-a694-15594a5e0286 admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:43.359570 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7ae8e-dde3-47a4-a694-15594a5e0286 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:43.359847 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7ae8e-dde3-47a4-a694-15594a5e0286 admin admin] PATH_INFO: `/v3/projects` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:43.360578 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d7ae8e-dde3-47a4-a694-15594a5e0286 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:43.363128 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d7ae8e-dde3-47a4-a694-15594a5e0286 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:43.487593 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1152/2295] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:31:43 2022] POST /identity/v3/projects => generated 375 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:31:43.489102 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa8223c-fc33-495b-995d-03c9ba39000d admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:43.499282 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa8223c-fc33-495b-995d-03c9ba39000d admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:43.554870 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ea19e7-2c8b-4d4a-9715-ff61efbd9b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:43.555542 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea19e7-2c8b-4d4a-9715-ff61efbd9b45 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:43.555832 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea19e7-2c8b-4d4a-9715-ff61efbd9b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:43.556255 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea19e7-2c8b-4d4a-9715-ff61efbd9b45 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:43.556965 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ea19e7-2c8b-4d4a-9715-ff61efbd9b45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:43.558929 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ea19e7-2c8b-4d4a-9715-ff61efbd9b45 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:43.742474 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1144/2296] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:31:43 2022] POST /identity/v3/users => generated 288 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:31:43.748459 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d7ae8e-dde3-47a4-a694-15594a5e0286 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:43.759815 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d7ae8e-dde3-47a4-a694-15594a5e0286 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:43.764428 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f8e60-4594-4904-a777-2bff3c8f3db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:43.765084 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f8e60-4594-4904-a777-2bff3c8f3db3 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:43.765372 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f8e60-4594-4904-a777-2bff3c8f3db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:43.765653 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f8e60-4594-4904-a777-2bff3c8f3db3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:43.766421 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98f8e60-4594-4904-a777-2bff3c8f3db3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:43.768081 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98f8e60-4594-4904-a777-2bff3c8f3db3 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:43.789120 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1153/2297] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:31:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:31:43.790814 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ea19e7-2c8b-4d4a-9715-ff61efbd9b45 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:43.805137 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ea19e7-2c8b-4d4a-9715-ff61efbd9b45 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:43.819993 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ebc6b5-2322-4592-b4b6-c41d0fa69b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:43.833495 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ebc6b5-2322-4592-b4b6-c41d0fa69b09 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:43.833495 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ebc6b5-2322-4592-b4b6-c41d0fa69b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:43.833495 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ebc6b5-2322-4592-b4b6-c41d0fa69b09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:43.833495 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ebc6b5-2322-4592-b4b6-c41d0fa69b09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:43.833495 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ebc6b5-2322-4592-b4b6-c41d0fa69b09 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:43.834791 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1145/2298] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:31:43 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 16:31:43.838863 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f8e60-4594-4904-a777-2bff3c8f3db3 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:43.854387 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f8e60-4594-4904-a777-2bff3c8f3db3 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:43.859009 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e0db5-ba43-4705-96b2-fdc80338abcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:43.859991 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e0db5-ba43-4705-96b2-fdc80338abcc admin admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:43.860271 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e0db5-ba43-4705-96b2-fdc80338abcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:43.860553 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e0db5-ba43-4705-96b2-fdc80338abcc admin admin] PATH_INFO: `/v3/projects/099020eb70e04bee83c49902bf12342b/users/4d13c5d5b4a54eaeb1bc4aa2a8f45580/roles/c8ce6d197f654598ac45f6016ecccabd` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:43.875848 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055e0db5-ba43-4705-96b2-fdc80338abcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=099020eb70e04bee83c49902bf12342b, user_id=4d13c5d5b4a54eaeb1bc4aa2a8f45580, role_id=c8ce6d197f654598ac45f6016ecccabd)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:43.879143 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055e0db5-ba43-4705-96b2-fdc80338abcc admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:44.022750 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1154/2299] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:31:43 2022] PUT /identity/v3/projects/099020eb70e04bee83c49902bf12342b/users/4d13c5d5b4a54eaeb1bc4aa2a8f45580/roles/c8ce6d197f654598ac45f6016ecccabd => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:31:44.034290 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afcfb3f-25d7-486f-9a32-3be574939ffd None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:44.034690 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afcfb3f-25d7-486f-9a32-3be574939ffd None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:44.035073 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afcfb3f-25d7-486f-9a32-3be574939ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:44.071949 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-2afcfb3f-25d7-486f-9a32-3be574939ffd None None] MFA Rules not processed for user `4d13c5d5b4a54eaeb1bc4aa2a8f45580`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:31:44.073316 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-2afcfb3f-25d7-486f-9a32-3be574939ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:44.175877 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1146/2300] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:31:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:31:44.190370 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e0db5-ba43-4705-96b2-fdc80338abcc admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:44.190370 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-055e0db5-ba43-4705-96b2-fdc80338abcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:44.247120 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e0db5-ba43-4705-96b2-fdc80338abcc admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:44.250684 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b443f-a43c-42bd-af27-db13b68b7541 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8693a1e72f14fdfb383f11e96330726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:44.251366 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b443f-a43c-42bd-af27-db13b68b7541 service cinder] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:44.251664 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b443f-a43c-42bd-af27-db13b68b7541 service cinder] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:44.251947 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b443f-a43c-42bd-af27-db13b68b7541 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:44.261098 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8b443f-a43c-42bd-af27-db13b68b7541 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:44.262568 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8b443f-a43c-42bd-af27-db13b68b7541 service cinder] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:44.271382 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1155/2301] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:31:44 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:31:44.976112 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:31:46.580650 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33593c46-8b7c-4044-83a6-b208fb893efe None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:46.581202 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33593c46-8b7c-4044-83a6-b208fb893efe None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:46.581300 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33593c46-8b7c-4044-83a6-b208fb893efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:46.602356 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-33593c46-8b7c-4044-83a6-b208fb893efe None None] MFA Rules not processed for user `d2aced0927994e97bac1ce1a63f4a911`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:31:46.603560 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-33593c46-8b7c-4044-83a6-b208fb893efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:46.661665 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1147/2302] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:31:46 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:31:46.758732 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:31:47.307341 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:31:49.885047 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b443f-a43c-42bd-af27-db13b68b7541 service cinder] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:49.886633 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-8c8b443f-a43c-42bd-af27-db13b68b7541 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:49.968428 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b443f-a43c-42bd-af27-db13b68b7541 service cinder] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:49.975906 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afffb8e-ea77-46f1-99bb-3ea0e8f60da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:49.976968 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afffb8e-ea77-46f1-99bb-3ea0e8f60da8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:49.977244 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afffb8e-ea77-46f1-99bb-3ea0e8f60da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:49.977526 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afffb8e-ea77-46f1-99bb-3ea0e8f60da8 admin admin] PATH_INFO: `/v3/users/2e22815be7b4416a8bdd118c2037b01d` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:49.978827 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afffb8e-ea77-46f1-99bb-3ea0e8f60da8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e22815be7b4416a8bdd118c2037b01d)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:49.980875 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afffb8e-ea77-46f1-99bb-3ea0e8f60da8 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:50.374291 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-8afffb8e-ea77-46f1-99bb-3ea0e8f60da8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e22815be7b4416a8bdd118c2037b01d'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:50.389937 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-8afffb8e-ea77-46f1-99bb-3ea0e8f60da8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e22815be7b4416a8bdd118c2037b01d'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:50.391023 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-8afffb8e-ea77-46f1-99bb-3ea0e8f60da8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e22815be7b4416a8bdd118c2037b01d'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:50.391859 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-8afffb8e-ea77-46f1-99bb-3ea0e8f60da8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e22815be7b4416a8bdd118c2037b01d'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:50.413648 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33593c46-8b7c-4044-83a6-b208fb893efe None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:50.426043 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33593c46-8b7c-4044-83a6-b208fb893efe None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:50.435911 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5675d37-98dc-48ac-b99f-09ed26a4fdac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:50.436792 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5675d37-98dc-48ac-b99f-09ed26a4fdac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:50.437075 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5675d37-98dc-48ac-b99f-09ed26a4fdac admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:50.437521 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5675d37-98dc-48ac-b99f-09ed26a4fdac admin admin] PATH_INFO: `/v3/users/4d13c5d5b4a54eaeb1bc4aa2a8f45580` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:50.438775 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5675d37-98dc-48ac-b99f-09ed26a4fdac admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d13c5d5b4a54eaeb1bc4aa2a8f45580)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:50.441219 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5675d37-98dc-48ac-b99f-09ed26a4fdac admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:50.552642 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-8afffb8e-ea77-46f1-99bb-3ea0e8f60da8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e22815be7b4416a8bdd118c2037b01d'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:50.567330 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1156/2303] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:31:49 2022] DELETE /identity/v3/users/2e22815be7b4416a8bdd118c2037b01d => generated 0 bytes in 683 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:31:50.572428 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7dfecc-7c99-47e5-ad2d-5a9feec4b013 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:50.572961 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7dfecc-7c99-47e5-ad2d-5a9feec4b013 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:50.573246 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7dfecc-7c99-47e5-ad2d-5a9feec4b013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:50.591658 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-2c7dfecc-7c99-47e5-ad2d-5a9feec4b013 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:31:50.592865 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-2c7dfecc-7c99-47e5-ad2d-5a9feec4b013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:50.660684 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1157/2304] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:31:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:31:50.670598 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7dfecc-7c99-47e5-ad2d-5a9feec4b013 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:50.672488 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-2c7dfecc-7c99-47e5-ad2d-5a9feec4b013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:50.756602 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-c5675d37-98dc-48ac-b99f-09ed26a4fdac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d13c5d5b4a54eaeb1bc4aa2a8f45580'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:50.767390 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-c5675d37-98dc-48ac-b99f-09ed26a4fdac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d13c5d5b4a54eaeb1bc4aa2a8f45580'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:50.768374 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-c5675d37-98dc-48ac-b99f-09ed26a4fdac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d13c5d5b4a54eaeb1bc4aa2a8f45580'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:50.769156 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-c5675d37-98dc-48ac-b99f-09ed26a4fdac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d13c5d5b4a54eaeb1bc4aa2a8f45580'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:50.790174 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7dfecc-7c99-47e5-ad2d-5a9feec4b013 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:50.794083 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b2b939-0660-464b-beef-c4e0a4a66289 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:50.794819 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2b939-0660-464b-beef-c4e0a4a66289 service neutron] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:50.795112 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2b939-0660-464b-beef-c4e0a4a66289 service neutron] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:50.797316 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2b939-0660-464b-beef-c4e0a4a66289 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:50.800205 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-38b2b939-0660-464b-beef-c4e0a4a66289 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:50.813018 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b2b939-0660-464b-beef-c4e0a4a66289 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:50.814564 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b2b939-0660-464b-beef-c4e0a4a66289 service neutron] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:50.825477 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1158/2305] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:31:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 16:31:50.914026 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-c5675d37-98dc-48ac-b99f-09ed26a4fdac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d13c5d5b4a54eaeb1bc4aa2a8f45580'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:50.944756 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1148/2306] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:31:50 2022] DELETE /identity/v3/users/4d13c5d5b4a54eaeb1bc4aa2a8f45580 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:31:50.951799 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9143d31f-8395-45d1-8150-14dc09e9a8f7 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:50.952250 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9143d31f-8395-45d1-8150-14dc09e9a8f7 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:50.952361 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9143d31f-8395-45d1-8150-14dc09e9a8f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:50.987598 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-9143d31f-8395-45d1-8150-14dc09e9a8f7 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:31:50.989424 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-9143d31f-8395-45d1-8150-14dc09e9a8f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:51.099958 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1159/2307] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:31:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:31:51.110852 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5675d37-98dc-48ac-b99f-09ed26a4fdac admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:51.113050 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-c5675d37-98dc-48ac-b99f-09ed26a4fdac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:51.192515 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5675d37-98dc-48ac-b99f-09ed26a4fdac admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:51.200045 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffce5bd-013a-4c7c-bd54-3d2e82b04278 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:51.201329 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffce5bd-013a-4c7c-bd54-3d2e82b04278 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:51.205810 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffce5bd-013a-4c7c-bd54-3d2e82b04278 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:51.205810 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffce5bd-013a-4c7c-bd54-3d2e82b04278 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:51.216327 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffce5bd-013a-4c7c-bd54-3d2e82b04278 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:51.217967 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffce5bd-013a-4c7c-bd54-3d2e82b04278 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:51.232411 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1149/2308] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:31:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:31:51.633188 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9143d31f-8395-45d1-8150-14dc09e9a8f7 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:51.635435 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-9143d31f-8395-45d1-8150-14dc09e9a8f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:51.664088 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9143d31f-8395-45d1-8150-14dc09e9a8f7 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:51.675415 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6dde3c-c0bb-4a96-b361-05a221abf5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:51.676319 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6dde3c-c0bb-4a96-b361-05a221abf5c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:51.676666 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6dde3c-c0bb-4a96-b361-05a221abf5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:51.677043 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6dde3c-c0bb-4a96-b361-05a221abf5c6 admin admin] PATH_INFO: `/v3/projects/201aabad0757499e8e31377653214db3` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:51.679005 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6dde3c-c0bb-4a96-b361-05a221abf5c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=201aabad0757499e8e31377653214db3)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:51.681383 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6dde3c-c0bb-4a96-b361-05a221abf5c6 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:51.869128 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-af6dde3c-c0bb-4a96-b361-05a221abf5c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '201aabad0757499e8e31377653214db3', 'request_id': 'req-af6dde3c-c0bb-4a96-b361-05a221abf5c6'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:51.878775 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-af6dde3c-c0bb-4a96-b361-05a221abf5c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '201aabad0757499e8e31377653214db3', 'request_id': 'req-af6dde3c-c0bb-4a96-b361-05a221abf5c6'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:51.910950 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-af6dde3c-c0bb-4a96-b361-05a221abf5c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '201aabad0757499e8e31377653214db3', 'request_id': 'req-af6dde3c-c0bb-4a96-b361-05a221abf5c6'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:51.996296 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffce5bd-013a-4c7c-bd54-3d2e82b04278 service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:51.997888 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-4ffce5bd-013a-4c7c-bd54-3d2e82b04278 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:52.011512 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffce5bd-013a-4c7c-bd54-3d2e82b04278 service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:52.037817 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-af6dde3c-c0bb-4a96-b361-05a221abf5c6 admin admin] The token cache is being invalidate because project 201aabad0757499e8e31377653214db3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80288) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:31:52.042297 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-af6dde3c-c0bb-4a96-b361-05a221abf5c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:52.042297 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-af6dde3c-c0bb-4a96-b361-05a221abf5c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:52.049029 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1160/2309] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:31:51 2022] DELETE /identity/v3/projects/201aabad0757499e8e31377653214db3 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:31:52.053589 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220869ec-ef60-40fd-aa45-a5995215dcc9 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:52.053935 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220869ec-ef60-40fd-aa45-a5995215dcc9 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:52.054224 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220869ec-ef60-40fd-aa45-a5995215dcc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:52.123002 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-220869ec-ef60-40fd-aa45-a5995215dcc9 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:31:52.124873 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-220869ec-ef60-40fd-aa45-a5995215dcc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:52.149169 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9bb9a6-57d7-4f0f-8c65-6f71b88a2a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:52.150092 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9bb9a6-57d7-4f0f-8c65-6f71b88a2a00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:52.150416 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9bb9a6-57d7-4f0f-8c65-6f71b88a2a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:52.150696 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9bb9a6-57d7-4f0f-8c65-6f71b88a2a00 admin admin] PATH_INFO: `/v3/projects/099020eb70e04bee83c49902bf12342b` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:52.152172 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9bb9a6-57d7-4f0f-8c65-6f71b88a2a00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=099020eb70e04bee83c49902bf12342b)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:52.159915 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9bb9a6-57d7-4f0f-8c65-6f71b88a2a00 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:52.218449 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1161/2310] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:31:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:31:52.219508 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=84,keystone:INSERT=2,keystone:DELETE=14 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:31:52.222870 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2206e974-4733-4773-b7df-38e00783e4a1 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:52.223332 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2206e974-4733-4773-b7df-38e00783e4a1 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:52.223757 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2206e974-4733-4773-b7df-38e00783e4a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:52.259294 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-2206e974-4733-4773-b7df-38e00783e4a1 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:31:52.260508 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-2206e974-4733-4773-b7df-38e00783e4a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:52.269081 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1162/2311] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:31:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:31:52.273145 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2206e974-4733-4773-b7df-38e00783e4a1 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:52.282066 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2206e974-4733-4773-b7df-38e00783e4a1 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:52.286601 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7845d47-9d9d-4269-b923-7261c306b1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:52.287239 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7845d47-9d9d-4269-b923-7261c306b1fa admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:52.287604 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7845d47-9d9d-4269-b923-7261c306b1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:52.287855 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7845d47-9d9d-4269-b923-7261c306b1fa admin admin] PATH_INFO: `/v3/domains` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:52.288606 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7845d47-9d9d-4269-b923-7261c306b1fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:31:52.288912 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7845d47-9d9d-4269-b923-7261c306b1fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:52.290558 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7845d47-9d9d-4269-b923-7261c306b1fa admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:52.302870 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1163/2312] 10.222.0.62 () {58 vars in 1152 bytes} [Fri May 27 16:31:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:31:52.307136 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7845d47-9d9d-4269-b923-7261c306b1fa admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:52.317755 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7845d47-9d9d-4269-b923-7261c306b1fa admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:52.322387 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71551287-38db-4254-926a-e7a427624109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:52.323045 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71551287-38db-4254-926a-e7a427624109 admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:52.323441 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71551287-38db-4254-926a-e7a427624109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:52.323590 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71551287-38db-4254-926a-e7a427624109 admin admin] PATH_INFO: `/v3/projects` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:52.324277 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71551287-38db-4254-926a-e7a427624109 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:52.326198 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71551287-38db-4254-926a-e7a427624109 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:52.388651 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-4d9bb9a6-57d7-4f0f-8c65-6f71b88a2a00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '099020eb70e04bee83c49902bf12342b', 'request_id': 'req-4d9bb9a6-57d7-4f0f-8c65-6f71b88a2a00'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:52.394820 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-4d9bb9a6-57d7-4f0f-8c65-6f71b88a2a00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '099020eb70e04bee83c49902bf12342b', 'request_id': 'req-4d9bb9a6-57d7-4f0f-8c65-6f71b88a2a00'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:52.441106 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1164/2313] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:31:52 2022] POST /identity/v3/projects => generated 363 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:31:52.442174 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71551287-38db-4254-926a-e7a427624109 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:52.501746 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-4d9bb9a6-57d7-4f0f-8c65-6f71b88a2a00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '099020eb70e04bee83c49902bf12342b', 'request_id': 'req-4d9bb9a6-57d7-4f0f-8c65-6f71b88a2a00'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:52.514855 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-4d9bb9a6-57d7-4f0f-8c65-6f71b88a2a00 admin admin] The token cache is being invalidate because project 099020eb70e04bee83c49902bf12342b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:31:52.515145 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-4d9bb9a6-57d7-4f0f-8c65-6f71b88a2a00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:52.515794 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-4d9bb9a6-57d7-4f0f-8c65-6f71b88a2a00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:52.516538 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71551287-38db-4254-926a-e7a427624109 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:52.517834 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1150/2314] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:31:51 2022] DELETE /identity/v3/projects/099020eb70e04bee83c49902bf12342b => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:31:52.521750 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f492cf54-5940-4e38-a1ee-52872b49c539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:52.522505 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492cf54-5940-4e38-a1ee-52872b49c539 admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:52.522798 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492cf54-5940-4e38-a1ee-52872b49c539 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:52.523087 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492cf54-5940-4e38-a1ee-52872b49c539 admin admin] PATH_INFO: `/v3/users` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:52.523794 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f492cf54-5940-4e38-a1ee-52872b49c539 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:52.525004 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088fca77-94db-464d-b985-0fbd5ab2a25e None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:52.525370 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088fca77-94db-464d-b985-0fbd5ab2a25e None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:52.525719 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088fca77-94db-464d-b985-0fbd5ab2a25e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:52.525858 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f492cf54-5940-4e38-a1ee-52872b49c539 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:52.546500 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-088fca77-94db-464d-b985-0fbd5ab2a25e None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:31:52.547998 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-088fca77-94db-464d-b985-0fbd5ab2a25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:52.556928 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1151/2315] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:31:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:31:52.565673 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3736e0ea-0ddb-4f52-91ba-6686404a9d80 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:52.566094 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3736e0ea-0ddb-4f52-91ba-6686404a9d80 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:52.566410 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3736e0ea-0ddb-4f52-91ba-6686404a9d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:52.586831 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-3736e0ea-0ddb-4f52-91ba-6686404a9d80 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:31:52.588073 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-3736e0ea-0ddb-4f52-91ba-6686404a9d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:52.596686 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1152/2316] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:31:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:31:52.600474 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3736e0ea-0ddb-4f52-91ba-6686404a9d80 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:52.611009 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3736e0ea-0ddb-4f52-91ba-6686404a9d80 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:52.616651 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd1dd17-33f7-4fc6-bc47-68170bc76a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:52.617342 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd1dd17-33f7-4fc6-bc47-68170bc76a6d admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:52.617635 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd1dd17-33f7-4fc6-bc47-68170bc76a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:52.618192 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd1dd17-33f7-4fc6-bc47-68170bc76a6d admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:52.618692 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd1dd17-33f7-4fc6-bc47-68170bc76a6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:31:52.619001 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd1dd17-33f7-4fc6-bc47-68170bc76a6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:52.620596 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd1dd17-33f7-4fc6-bc47-68170bc76a6d admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:52.637179 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1153/2317] 10.222.0.62 () {58 vars in 1152 bytes} [Fri May 27 16:31:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:31:52.639338 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd1dd17-33f7-4fc6-bc47-68170bc76a6d admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:52.645402 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1165/2318] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:31:52 2022] POST /identity/v3/users => generated 282 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:31:52.650281 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f492cf54-5940-4e38-a1ee-52872b49c539 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:52.654220 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-f492cf54-5940-4e38-a1ee-52872b49c539 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:52.654497 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd1dd17-33f7-4fc6-bc47-68170bc76a6d admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:52.660134 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dde11bb-7096-47e1-920c-ad468171970d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:52.660337 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde11bb-7096-47e1-920c-ad468171970d admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:52.660559 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde11bb-7096-47e1-920c-ad468171970d admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:52.660851 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde11bb-7096-47e1-920c-ad468171970d admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:52.669488 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dde11bb-7096-47e1-920c-ad468171970d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:52.669488 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dde11bb-7096-47e1-920c-ad468171970d admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:52.674932 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f492cf54-5940-4e38-a1ee-52872b49c539 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:52.680277 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c776e7-412f-405a-b1e8-a921b1570034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:52.681100 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c776e7-412f-405a-b1e8-a921b1570034 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:52.681406 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c776e7-412f-405a-b1e8-a921b1570034 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:52.681685 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c776e7-412f-405a-b1e8-a921b1570034 admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:52.682467 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c776e7-412f-405a-b1e8-a921b1570034 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:52.684158 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c776e7-412f-405a-b1e8-a921b1570034 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:52.697961 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1166/2319] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:31:52 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 16:31:52.699051 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c776e7-412f-405a-b1e8-a921b1570034 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:52.709545 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c776e7-412f-405a-b1e8-a921b1570034 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:52.718846 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c9f2c8-b602-472c-a047-0f5bd09a5ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:52.719617 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c9f2c8-b602-472c-a047-0f5bd09a5ab2 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:52.719979 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c9f2c8-b602-472c-a047-0f5bd09a5ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:52.720334 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c9f2c8-b602-472c-a047-0f5bd09a5ab2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:52.721668 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c9f2c8-b602-472c-a047-0f5bd09a5ab2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:52.723560 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c9f2c8-b602-472c-a047-0f5bd09a5ab2 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:52.738697 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1167/2320] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:31:52 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 16:31:52.740212 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c9f2c8-b602-472c-a047-0f5bd09a5ab2 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:52.752559 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c9f2c8-b602-472c-a047-0f5bd09a5ab2 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:52.758797 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e395e9c-d867-470d-8ac6-5097c979b662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:52.761495 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e395e9c-d867-470d-8ac6-5097c979b662 admin admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:52.761495 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e395e9c-d867-470d-8ac6-5097c979b662 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:52.761495 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e395e9c-d867-470d-8ac6-5097c979b662 admin admin] PATH_INFO: `/v3/projects/1d499e788aac42c198827fbd99ae778e/users/8cd2f9f848764a22b916ae7a27a02bf4/roles/c8ce6d197f654598ac45f6016ecccabd` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:52.767476 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1154/2321] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:31:52 2022] POST /identity/v3/projects => generated 383 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:31:52.772268 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dde11bb-7096-47e1-920c-ad468171970d admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:52.777353 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e395e9c-d867-470d-8ac6-5097c979b662 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d499e788aac42c198827fbd99ae778e, user_id=8cd2f9f848764a22b916ae7a27a02bf4, role_id=c8ce6d197f654598ac45f6016ecccabd)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:52.780807 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e395e9c-d867-470d-8ac6-5097c979b662 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:52.786271 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:DELETE=19,keystone:SELECT=78,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:31:52.842357 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dde11bb-7096-47e1-920c-ad468171970d admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:52.848431 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc719365-c63e-4b80-9852-e5bcae30cf86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:52.849123 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc719365-c63e-4b80-9852-e5bcae30cf86 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:52.849409 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc719365-c63e-4b80-9852-e5bcae30cf86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:52.849691 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc719365-c63e-4b80-9852-e5bcae30cf86 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:52.850452 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc719365-c63e-4b80-9852-e5bcae30cf86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:52.852407 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc719365-c63e-4b80-9852-e5bcae30cf86 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:52.897896 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1168/2322] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:31:52 2022] PUT /identity/v3/projects/1d499e788aac42c198827fbd99ae778e/users/8cd2f9f848764a22b916ae7a27a02bf4/roles/c8ce6d197f654598ac45f6016ecccabd => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:31:52.910419 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c154af2-bc9b-4f0e-aaf7-57f4a376d7e3 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:52.911223 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c154af2-bc9b-4f0e-aaf7-57f4a376d7e3 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:52.911686 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c154af2-bc9b-4f0e-aaf7-57f4a376d7e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:52.946716 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-7c154af2-bc9b-4f0e-aaf7-57f4a376d7e3 None None] MFA Rules not processed for user `8cd2f9f848764a22b916ae7a27a02bf4`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:31:52.948981 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-7c154af2-bc9b-4f0e-aaf7-57f4a376d7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:53.007286 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1155/2323] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:31:52 2022] POST /identity/v3/users => generated 292 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:31:53.012722 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc719365-c63e-4b80-9852-e5bcae30cf86 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:53.033761 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc719365-c63e-4b80-9852-e5bcae30cf86 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:53.054567 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1169/2324] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:31:52 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:31:53.071496 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c154af2-bc9b-4f0e-aaf7-57f4a376d7e3 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:53.073002 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-7c154af2-bc9b-4f0e-aaf7-57f4a376d7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:53.105853 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e0ea41-dee9-4182-8948-f177d6d11388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:53.107158 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e0ea41-dee9-4182-8948-f177d6d11388 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:53.107158 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e0ea41-dee9-4182-8948-f177d6d11388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:53.107556 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e0ea41-dee9-4182-8948-f177d6d11388 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:53.108413 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e0ea41-dee9-4182-8948-f177d6d11388 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:53.110139 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e0ea41-dee9-4182-8948-f177d6d11388 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:53.121178 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1156/2325] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:31:53 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:31:53.126740 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e0ea41-dee9-4182-8948-f177d6d11388 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:53.136328 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c154af2-bc9b-4f0e-aaf7-57f4a376d7e3 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:53.137360 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e0ea41-dee9-4182-8948-f177d6d11388 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:53.140006 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880bb18d-179c-4553-a81a-eab449af2343 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8693a1e72f14fdfb383f11e96330726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:53.140660 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880bb18d-179c-4553-a81a-eab449af2343 service cinder] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:53.140949 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880bb18d-179c-4553-a81a-eab449af2343 service cinder] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:53.141230 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880bb18d-179c-4553-a81a-eab449af2343 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:53.142120 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc36afa8-93fb-48bb-832b-2ff5b6d7a2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:53.142963 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc36afa8-93fb-48bb-832b-2ff5b6d7a2fc admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:53.143249 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc36afa8-93fb-48bb-832b-2ff5b6d7a2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:53.143531 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc36afa8-93fb-48bb-832b-2ff5b6d7a2fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:53.144289 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc36afa8-93fb-48bb-832b-2ff5b6d7a2fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:53.145888 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc36afa8-93fb-48bb-832b-2ff5b6d7a2fc admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:53.149718 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880bb18d-179c-4553-a81a-eab449af2343 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:53.151257 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880bb18d-179c-4553-a81a-eab449af2343 service cinder] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:53.155919 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1157/2326] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:31:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:31:53.160674 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1170/2327] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:31:53 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 16:31:53.161483 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc36afa8-93fb-48bb-832b-2ff5b6d7a2fc admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:53.171464 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc36afa8-93fb-48bb-832b-2ff5b6d7a2fc admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:53.176679 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a511ff0-b4cb-42d8-b071-dcc5cbd0194e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:53.177592 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a511ff0-b4cb-42d8-b071-dcc5cbd0194e admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:53.177878 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a511ff0-b4cb-42d8-b071-dcc5cbd0194e admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:53.178158 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a511ff0-b4cb-42d8-b071-dcc5cbd0194e admin admin] PATH_INFO: `/v3/projects/950926111a2946daaf7a21d6a6f079f8/users/87089f81f6d44b83bb20ef3f01bca18c/roles/c8ce6d197f654598ac45f6016ecccabd` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:53.194609 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a511ff0-b4cb-42d8-b071-dcc5cbd0194e admin admin] RBAC: Authorizing `identity:create_grant(project_id=950926111a2946daaf7a21d6a6f079f8, user_id=87089f81f6d44b83bb20ef3f01bca18c, role_id=c8ce6d197f654598ac45f6016ecccabd)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:53.197418 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a511ff0-b4cb-42d8-b071-dcc5cbd0194e admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:53.311842 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb003a-7b30-46d0-9612-4ee58a318b63 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:53.312353 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb003a-7b30-46d0-9612-4ee58a318b63 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:53.312751 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb003a-7b30-46d0-9612-4ee58a318b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:53.316409 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1158/2328] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:31:53 2022] PUT /identity/v3/projects/950926111a2946daaf7a21d6a6f079f8/users/87089f81f6d44b83bb20ef3f01bca18c/roles/c8ce6d197f654598ac45f6016ecccabd => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:31:53.339828 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-0eeb003a-7b30-46d0-9612-4ee58a318b63 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:31:53.341297 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-0eeb003a-7b30-46d0-9612-4ee58a318b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:53.416835 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1171/2329] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:31:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:31:53.428709 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a511ff0-b4cb-42d8-b071-dcc5cbd0194e admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:53.430581 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-5a511ff0-b4cb-42d8-b071-dcc5cbd0194e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:53.511174 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a511ff0-b4cb-42d8-b071-dcc5cbd0194e admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:53.516363 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038299f2-a1d7-4336-906d-b27438b86055 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:53.516363 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038299f2-a1d7-4336-906d-b27438b86055 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:53.516363 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038299f2-a1d7-4336-906d-b27438b86055 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:53.516591 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038299f2-a1d7-4336-906d-b27438b86055 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:53.526950 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038299f2-a1d7-4336-906d-b27438b86055 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:53.528514 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038299f2-a1d7-4336-906d-b27438b86055 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:53.540399 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1159/2330] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:31:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:31:54.082215 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeb003a-7b30-46d0-9612-4ee58a318b63 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:54.145049 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeb003a-7b30-46d0-9612-4ee58a318b63 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:54.151101 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1323e6-3964-4155-9846-2519308cc31b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8693a1e72f14fdfb383f11e96330726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:54.154455 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1323e6-3964-4155-9846-2519308cc31b service cinder] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:54.154455 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1323e6-3964-4155-9846-2519308cc31b service cinder] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:54.154455 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1323e6-3964-4155-9846-2519308cc31b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:54.157304 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-fd1323e6-3964-4155-9846-2519308cc31b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:54.271587 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1323e6-3964-4155-9846-2519308cc31b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:54.274205 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1323e6-3964-4155-9846-2519308cc31b service cinder] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:54.285700 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1172/2331] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:31:54 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:31:55.448489 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b31205b-443f-45c0-9ab8-c9bf51379df5 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:55.449306 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b31205b-443f-45c0-9ab8-c9bf51379df5 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:55.449736 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b31205b-443f-45c0-9ab8-c9bf51379df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:55.483549 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-9b31205b-443f-45c0-9ab8-c9bf51379df5 None None] MFA Rules not processed for user `87089f81f6d44b83bb20ef3f01bca18c`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:31:55.484827 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-9b31205b-443f-45c0-9ab8-c9bf51379df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:55.560490 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1160/2332] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:31:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:31:55.607382 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1323e6-3964-4155-9846-2519308cc31b service cinder] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:55.608956 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-fd1323e6-3964-4155-9846-2519308cc31b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:55.619663 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1323e6-3964-4155-9846-2519308cc31b service cinder] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:55.623670 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9037f7-4581-4a4c-a947-32985673a7ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8693a1e72f14fdfb383f11e96330726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:55.624315 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9037f7-4581-4a4c-a947-32985673a7ef service cinder] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:55.624605 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9037f7-4581-4a4c-a947-32985673a7ef service cinder] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:55.624887 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9037f7-4581-4a4c-a947-32985673a7ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:55.633834 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9037f7-4581-4a4c-a947-32985673a7ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:55.635295 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9037f7-4581-4a4c-a947-32985673a7ef service cinder] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:55.644771 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1173/2333] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:31:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:31:56.327568 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:31:56.652432 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b31205b-443f-45c0-9ab8-c9bf51379df5 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:56.653913 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-9b31205b-443f-45c0-9ab8-c9bf51379df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:56.679601 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b31205b-443f-45c0-9ab8-c9bf51379df5 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:56.684879 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c87809-76b7-4175-a88a-209efbb30e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:56.686025 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c87809-76b7-4175-a88a-209efbb30e5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:56.686566 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c87809-76b7-4175-a88a-209efbb30e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:56.687056 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c87809-76b7-4175-a88a-209efbb30e5a admin admin] PATH_INFO: `/v3/users/1f6ba581006346278f679ac4083d233b` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:56.689090 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c87809-76b7-4175-a88a-209efbb30e5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f6ba581006346278f679ac4083d233b)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:56.692163 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c87809-76b7-4175-a88a-209efbb30e5a admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:56.775677 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:31:57.007194 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-e2c87809-76b7-4175-a88a-209efbb30e5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f6ba581006346278f679ac4083d233b'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:57.017682 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-e2c87809-76b7-4175-a88a-209efbb30e5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f6ba581006346278f679ac4083d233b'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:57.018454 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-e2c87809-76b7-4175-a88a-209efbb30e5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f6ba581006346278f679ac4083d233b'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:57.019085 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-e2c87809-76b7-4175-a88a-209efbb30e5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f6ba581006346278f679ac4083d233b'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:57.129923 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-e2c87809-76b7-4175-a88a-209efbb30e5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f6ba581006346278f679ac4083d233b'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:57.149547 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1161/2334] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:31:56 2022] DELETE /identity/v3/users/1f6ba581006346278f679ac4083d233b => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:31:57.154205 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd5b77-437e-429e-9f94-59a8c012bebc None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:57.154676 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd5b77-437e-429e-9f94-59a8c012bebc None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:57.154803 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd5b77-437e-429e-9f94-59a8c012bebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:57.172231 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-ecbd5b77-437e-429e-9f94-59a8c012bebc None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:31:57.173432 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-ecbd5b77-437e-429e-9f94-59a8c012bebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:57.231256 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1174/2335] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:31:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:31:57.241556 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c87809-76b7-4175-a88a-209efbb30e5a admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:57.245925 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-e2c87809-76b7-4175-a88a-209efbb30e5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:57.303117 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c87809-76b7-4175-a88a-209efbb30e5a admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:57.308098 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc5e4b6-93b1-4d9e-be87-b2fe15a730b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:57.308767 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5e4b6-93b1-4d9e-be87-b2fe15a730b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:57.314924 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5e4b6-93b1-4d9e-be87-b2fe15a730b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:57.314924 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5e4b6-93b1-4d9e-be87-b2fe15a730b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:57.319064 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc5e4b6-93b1-4d9e-be87-b2fe15a730b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:57.320518 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc5e4b6-93b1-4d9e-be87-b2fe15a730b5 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:57.332070 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1162/2336] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:31:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:31:57.807408 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4d556-32a1-49ef-b254-44625407bdc3 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:57.807713 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4d556-32a1-49ef-b254-44625407bdc3 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:57.808035 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4d556-32a1-49ef-b254-44625407bdc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:57.825677 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-11f4d556-32a1-49ef-b254-44625407bdc3 None None] MFA Rules not processed for user `87089f81f6d44b83bb20ef3f01bca18c`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:31:57.826915 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-11f4d556-32a1-49ef-b254-44625407bdc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:57.887028 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc5e4b6-93b1-4d9e-be87-b2fe15a730b5 service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:57.887565 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1175/2337] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:31:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:31:57.889488 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-5fc5e4b6-93b1-4d9e-be87-b2fe15a730b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:57.905059 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc5e4b6-93b1-4d9e-be87-b2fe15a730b5 service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:57.911495 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded19434-c759-49c8-8091-f533d5e530e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:57.912573 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded19434-c759-49c8-8091-f533d5e530e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:57.913123 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded19434-c759-49c8-8091-f533d5e530e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:57.913569 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded19434-c759-49c8-8091-f533d5e530e0 admin admin] PATH_INFO: `/v3/projects/c91a21c5b48948c2b9b1f28457427577` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:57.914835 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded19434-c759-49c8-8091-f533d5e530e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c91a21c5b48948c2b9b1f28457427577)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:57.916873 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded19434-c759-49c8-8091-f533d5e530e0 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:58.123832 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-ded19434-c759-49c8-8091-f533d5e530e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c91a21c5b48948c2b9b1f28457427577', 'request_id': 'req-ded19434-c759-49c8-8091-f533d5e530e0'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:58.132333 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-ded19434-c759-49c8-8091-f533d5e530e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c91a21c5b48948c2b9b1f28457427577', 'request_id': 'req-ded19434-c759-49c8-8091-f533d5e530e0'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:58.254465 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-ded19434-c759-49c8-8091-f533d5e530e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c91a21c5b48948c2b9b1f28457427577', 'request_id': 'req-ded19434-c759-49c8-8091-f533d5e530e0'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:58.272411 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-ded19434-c759-49c8-8091-f533d5e530e0 admin admin] The token cache is being invalidate because project c91a21c5b48948c2b9b1f28457427577 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:31:58.272785 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-ded19434-c759-49c8-8091-f533d5e530e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:58.273506 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-ded19434-c759-49c8-8091-f533d5e530e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:58.275193 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1163/2338] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:31:57 2022] DELETE /identity/v3/projects/c91a21c5b48948c2b9b1f28457427577 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:31:58.582498 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4d556-32a1-49ef-b254-44625407bdc3 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:58.584557 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-11f4d556-32a1-49ef-b254-44625407bdc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:58.600676 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4d556-32a1-49ef-b254-44625407bdc3 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:58.667201 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7620d945-be48-433a-a8e9-8357df3a5567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:58.668403 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7620d945-be48-433a-a8e9-8357df3a5567 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:58.668833 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7620d945-be48-433a-a8e9-8357df3a5567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:58.669253 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7620d945-be48-433a-a8e9-8357df3a5567 admin admin] PATH_INFO: `/v3/users/724db5ea47fe4665a35c6eaf4dd11ee4` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:58.671622 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7620d945-be48-433a-a8e9-8357df3a5567 admin admin] RBAC: Authorizing `identity:delete_user(user_id=724db5ea47fe4665a35c6eaf4dd11ee4)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:58.673222 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7620d945-be48-433a-a8e9-8357df3a5567 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:58.964213 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-7620d945-be48-433a-a8e9-8357df3a5567 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '724db5ea47fe4665a35c6eaf4dd11ee4'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:58.980390 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-7620d945-be48-433a-a8e9-8357df3a5567 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '724db5ea47fe4665a35c6eaf4dd11ee4'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:58.981249 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-7620d945-be48-433a-a8e9-8357df3a5567 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '724db5ea47fe4665a35c6eaf4dd11ee4'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:58.982165 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-7620d945-be48-433a-a8e9-8357df3a5567 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '724db5ea47fe4665a35c6eaf4dd11ee4'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:59.105807 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-7620d945-be48-433a-a8e9-8357df3a5567 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '724db5ea47fe4665a35c6eaf4dd11ee4'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:31:59.108077 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1176/2339] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:31:58 2022] DELETE /identity/v3/users/724db5ea47fe4665a35c6eaf4dd11ee4 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:31:59.113061 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e9f131-4b04-44cb-91a0-a36cedc9f7bc None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:59.113572 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e9f131-4b04-44cb-91a0-a36cedc9f7bc None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:59.113840 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e9f131-4b04-44cb-91a0-a36cedc9f7bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:59.132810 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-e9e9f131-4b04-44cb-91a0-a36cedc9f7bc None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:31:59.134130 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-e9e9f131-4b04-44cb-91a0-a36cedc9f7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:59.195602 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1164/2340] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:31:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:31:59.205245 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7620d945-be48-433a-a8e9-8357df3a5567 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:59.206719 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-7620d945-be48-433a-a8e9-8357df3a5567 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:59.269678 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7620d945-be48-433a-a8e9-8357df3a5567 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:59.273668 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0809ea-eb99-4b56-aab8-ef1b2babd2a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:59.274421 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0809ea-eb99-4b56-aab8-ef1b2babd2a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:59.274712 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0809ea-eb99-4b56-aab8-ef1b2babd2a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:59.274992 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0809ea-eb99-4b56-aab8-ef1b2babd2a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:59.284593 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0809ea-eb99-4b56-aab8-ef1b2babd2a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:59.286028 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0809ea-eb99-4b56-aab8-ef1b2babd2a7 service neutron] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:31:59.296249 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1177/2341] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:31:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:31:59.855769 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e9f131-4b04-44cb-91a0-a36cedc9f7bc None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:31:59.858159 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-e9e9f131-4b04-44cb-91a0-a36cedc9f7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:31:59.878489 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e9f131-4b04-44cb-91a0-a36cedc9f7bc None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:31:59.884901 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ebd479-1340-4f13-be94-e781e8774b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:31:59.887677 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ebd479-1340-4f13-be94-e781e8774b1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:31:59.888547 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ebd479-1340-4f13-be94-e781e8774b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:31:59.889034 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ebd479-1340-4f13-be94-e781e8774b1d admin admin] PATH_INFO: `/v3/projects/b91c55c7402e414e87011bedd94cdaa5` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:31:59.890544 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ebd479-1340-4f13-be94-e781e8774b1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b91c55c7402e414e87011bedd94cdaa5)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:31:59.893943 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ebd479-1340-4f13-be94-e781e8774b1d admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:32:00.031804 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-f2ebd479-1340-4f13-be94-e781e8774b1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b91c55c7402e414e87011bedd94cdaa5', 'request_id': 'req-f2ebd479-1340-4f13-be94-e781e8774b1d'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:32:00.039058 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-f2ebd479-1340-4f13-be94-e781e8774b1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b91c55c7402e414e87011bedd94cdaa5', 'request_id': 'req-f2ebd479-1340-4f13-be94-e781e8774b1d'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:32:00.127059 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-f2ebd479-1340-4f13-be94-e781e8774b1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b91c55c7402e414e87011bedd94cdaa5', 'request_id': 'req-f2ebd479-1340-4f13-be94-e781e8774b1d'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:32:00.139388 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-f2ebd479-1340-4f13-be94-e781e8774b1d admin admin] The token cache is being invalidate because project b91c55c7402e414e87011bedd94cdaa5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:32:00.139687 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-f2ebd479-1340-4f13-be94-e781e8774b1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:32:00.140525 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-f2ebd479-1340-4f13-be94-e781e8774b1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:32:00.142114 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1165/2342] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:31:59 2022] DELETE /identity/v3/projects/b91c55c7402e414e87011bedd94cdaa5 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:32:00.147184 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e7aa5-32f0-4d92-937f-361dfe42a549 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:00.147640 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e7aa5-32f0-4d92-937f-361dfe42a549 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:00.147775 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e7aa5-32f0-4d92-937f-361dfe42a549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:00.172677 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-c24e7aa5-32f0-4d92-937f-361dfe42a549 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:32:00.174909 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-c24e7aa5-32f0-4d92-937f-361dfe42a549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:32:00.246666 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1178/2343] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:32:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:32:00.264846 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa320e79-74ee-4179-81da-75b66c246980 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:00.265145 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa320e79-74ee-4179-81da-75b66c246980 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:00.265456 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa320e79-74ee-4179-81da-75b66c246980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:00.284769 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-fa320e79-74ee-4179-81da-75b66c246980 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:32:00.285921 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-fa320e79-74ee-4179-81da-75b66c246980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:32:00.294186 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1166/2344] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:32:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:32:00.302022 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24e7aa5-32f0-4d92-937f-361dfe42a549 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:32:00.311760 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24e7aa5-32f0-4d92-937f-361dfe42a549 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:32:00.316382 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afded5fe-72df-4907-9c55-59d9ee0e2a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:32:00.317035 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afded5fe-72df-4907-9c55-59d9ee0e2a83 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:00.317322 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afded5fe-72df-4907-9c55-59d9ee0e2a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:00.317598 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afded5fe-72df-4907-9c55-59d9ee0e2a83 admin admin] PATH_INFO: `/v3/domains` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:00.318358 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afded5fe-72df-4907-9c55-59d9ee0e2a83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:32:00.318669 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afded5fe-72df-4907-9c55-59d9ee0e2a83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:32:00.320278 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afded5fe-72df-4907-9c55-59d9ee0e2a83 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:32:00.335502 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1179/2345] 10.222.0.62 () {58 vars in 1152 bytes} [Fri May 27 16:32:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:32:00.336688 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa320e79-74ee-4179-81da-75b66c246980 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:32:00.350028 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa320e79-74ee-4179-81da-75b66c246980 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:32:00.353305 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df9fa9f-5546-4947-b4cc-b535ae16b80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:32:00.354015 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df9fa9f-5546-4947-b4cc-b535ae16b80d admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:00.354368 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df9fa9f-5546-4947-b4cc-b535ae16b80d admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:00.354669 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df9fa9f-5546-4947-b4cc-b535ae16b80d admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:00.355341 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df9fa9f-5546-4947-b4cc-b535ae16b80d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:32:00.357298 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df9fa9f-5546-4947-b4cc-b535ae16b80d admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:32:00.554801 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1167/2346] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:32:00 2022] POST /identity/v3/projects => generated 367 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:32:00.556727 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afded5fe-72df-4907-9c55-59d9ee0e2a83 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:32:00.568562 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afded5fe-72df-4907-9c55-59d9ee0e2a83 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:32:00.638803 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2946b7b5-dfa5-49d0-aafc-4e07497af7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:32:00.639756 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2946b7b5-dfa5-49d0-aafc-4e07497af7ff admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:00.640244 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2946b7b5-dfa5-49d0-aafc-4e07497af7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:00.640721 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2946b7b5-dfa5-49d0-aafc-4e07497af7ff admin admin] PATH_INFO: `/v3/users` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:00.641630 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2946b7b5-dfa5-49d0-aafc-4e07497af7ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:32:00.644417 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2946b7b5-dfa5-49d0-aafc-4e07497af7ff admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:32:00.805282 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1180/2347] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:32:00 2022] POST /identity/v3/users => generated 284 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:32:00.809376 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df9fa9f-5546-4947-b4cc-b535ae16b80d admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:32:00.819924 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df9fa9f-5546-4947-b4cc-b535ae16b80d admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:32:00.824430 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3937db89-edf8-44a4-8585-53c7cd30f4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:32:00.825081 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937db89-edf8-44a4-8585-53c7cd30f4fa admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:00.827586 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937db89-edf8-44a4-8585-53c7cd30f4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:00.827586 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937db89-edf8-44a4-8585-53c7cd30f4fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:00.827586 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3937db89-edf8-44a4-8585-53c7cd30f4fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:32:00.827926 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3937db89-edf8-44a4-8585-53c7cd30f4fa admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:32:00.841121 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1168/2348] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:32:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:32:00.842468 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2946b7b5-dfa5-49d0-aafc-4e07497af7ff admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:32:00.852874 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2946b7b5-dfa5-49d0-aafc-4e07497af7ff admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:32:00.857988 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2b4788-433d-4fc1-bd9d-f3e9dfca96b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:32:00.858781 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b4788-433d-4fc1-bd9d-f3e9dfca96b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:00.859069 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b4788-433d-4fc1-bd9d-f3e9dfca96b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:00.861048 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b4788-433d-4fc1-bd9d-f3e9dfca96b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:00.861048 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2b4788-433d-4fc1-bd9d-f3e9dfca96b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:32:00.862724 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2b4788-433d-4fc1-bd9d-f3e9dfca96b1 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:32:00.874358 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1181/2349] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:32:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:32:00.878849 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3937db89-edf8-44a4-8585-53c7cd30f4fa admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:32:00.889038 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3937db89-edf8-44a4-8585-53c7cd30f4fa admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:32:00.893673 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bc170c-1a59-41f4-8fb3-920588845446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:32:00.894588 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc170c-1a59-41f4-8fb3-920588845446 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:00.894873 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc170c-1a59-41f4-8fb3-920588845446 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:00.895448 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc170c-1a59-41f4-8fb3-920588845446 admin admin] PATH_INFO: `/v3/projects/a0931cd4d96e43af8f6f24f5fec64342/users/eb0106e06cb642b0b8ed99c4a26078e1/roles/c8ce6d197f654598ac45f6016ecccabd` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:00.911157 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bc170c-1a59-41f4-8fb3-920588845446 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0931cd4d96e43af8f6f24f5fec64342, user_id=eb0106e06cb642b0b8ed99c4a26078e1, role_id=c8ce6d197f654598ac45f6016ecccabd)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:32:00.913894 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bc170c-1a59-41f4-8fb3-920588845446 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:32:01.084713 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1169/2350] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:32:00 2022] PUT /identity/v3/projects/a0931cd4d96e43af8f6f24f5fec64342/users/eb0106e06cb642b0b8ed99c4a26078e1/roles/c8ce6d197f654598ac45f6016ecccabd => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:32:01.096694 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61bc7b-9a2d-42ff-a268-e28ab080ad8b None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:01.096986 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61bc7b-9a2d-42ff-a268-e28ab080ad8b None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:01.097268 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61bc7b-9a2d-42ff-a268-e28ab080ad8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:01.126686 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-9a61bc7b-9a2d-42ff-a268-e28ab080ad8b None None] MFA Rules not processed for user `eb0106e06cb642b0b8ed99c4a26078e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:32:01.127924 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-9a61bc7b-9a2d-42ff-a268-e28ab080ad8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:32:01.197239 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1182/2351] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:32:01 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:32:01.209369 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bc170c-1a59-41f4-8fb3-920588845446 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:32:01.212600 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-a9bc170c-1a59-41f4-8fb3-920588845446 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:32:01.278829 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:01.281525 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bc170c-1a59-41f4-8fb3-920588845446 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:32:01.285744 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faf7267-1726-47eb-b20a-d8c6374e5248 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b072079733049e8ac204ebe5cc635ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:32:01.286424 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf7267-1726-47eb-b20a-d8c6374e5248 service glance] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:01.286712 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf7267-1726-47eb-b20a-d8c6374e5248 service glance] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:01.287002 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf7267-1726-47eb-b20a-d8c6374e5248 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:01.295811 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faf7267-1726-47eb-b20a-d8c6374e5248 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:32:01.297311 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faf7267-1726-47eb-b20a-d8c6374e5248 service glance] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:32:01.306456 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1170/2352] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:32:01 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:32:02.233159 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:04.603913 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:06.467044 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:07.612608 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:09.067894 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:11.051516 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:11.872873 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:13.869896 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:14.646684 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:16.276937 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:INSERT=7,keystone:SELECT=84,keystone:DELETE=9 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:16.527089 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:17.704020 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:18.144269 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:19.307989 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:19.543638 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:21.250040 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:21.623574 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:22.735312 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:INSERT=7,keystone:SELECT=83,keystone:DELETE=10 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:23.107042 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:24.104043 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:24.373182 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a61bc7b-9a2d-42ff-a268-e28ab080ad8b None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:32:24.374893 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-9a61bc7b-9a2d-42ff-a268-e28ab080ad8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:32:24.441734 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a61bc7b-9a2d-42ff-a268-e28ab080ad8b None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:32:24.447589 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:24.448442 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e879748-0574-4e79-8adf-4bad029f4c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:32:24.449433 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e879748-0574-4e79-8adf-4bad029f4c23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:24.449791 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e879748-0574-4e79-8adf-4bad029f4c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:24.450068 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e879748-0574-4e79-8adf-4bad029f4c23 admin admin] PATH_INFO: `/v3/users/4025e748e7674fd3b92dc6c80ae94740` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:24.451458 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e879748-0574-4e79-8adf-4bad029f4c23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4025e748e7674fd3b92dc6c80ae94740)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:32:24.453450 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e879748-0574-4e79-8adf-4bad029f4c23 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:32:24.712815 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-2e879748-0574-4e79-8adf-4bad029f4c23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4025e748e7674fd3b92dc6c80ae94740'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:32:24.725823 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-2e879748-0574-4e79-8adf-4bad029f4c23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4025e748e7674fd3b92dc6c80ae94740'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:32:24.726559 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-2e879748-0574-4e79-8adf-4bad029f4c23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4025e748e7674fd3b92dc6c80ae94740'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:32:24.727169 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-2e879748-0574-4e79-8adf-4bad029f4c23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4025e748e7674fd3b92dc6c80ae94740'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:32:24.823739 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-2e879748-0574-4e79-8adf-4bad029f4c23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4025e748e7674fd3b92dc6c80ae94740'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:32:24.836953 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1183/2353] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:32:24 2022] DELETE /identity/v3/users/4025e748e7674fd3b92dc6c80ae94740 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:32:25.108806 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faf7267-1726-47eb-b20a-d8c6374e5248 service glance] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:32:25.120215 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faf7267-1726-47eb-b20a-d8c6374e5248 service glance] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:32:25.177228 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a59d846-4ede-4336-a3e5-b4036d82b8ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:32:25.178117 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a59d846-4ede-4336-a3e5-b4036d82b8ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:25.178477 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a59d846-4ede-4336-a3e5-b4036d82b8ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:25.179179 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a59d846-4ede-4336-a3e5-b4036d82b8ee admin admin] PATH_INFO: `/v3/projects/eacf7ad63d954bb3891473308346e548` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:25.180445 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a59d846-4ede-4336-a3e5-b4036d82b8ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=eacf7ad63d954bb3891473308346e548)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:32:25.182543 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a59d846-4ede-4336-a3e5-b4036d82b8ee admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:32:25.301085 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-9a59d846-4ede-4336-a3e5-b4036d82b8ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eacf7ad63d954bb3891473308346e548', 'request_id': 'req-9a59d846-4ede-4336-a3e5-b4036d82b8ee'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:32:25.307282 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-9a59d846-4ede-4336-a3e5-b4036d82b8ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eacf7ad63d954bb3891473308346e548', 'request_id': 'req-9a59d846-4ede-4336-a3e5-b4036d82b8ee'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:32:25.395007 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-9a59d846-4ede-4336-a3e5-b4036d82b8ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eacf7ad63d954bb3891473308346e548', 'request_id': 'req-9a59d846-4ede-4336-a3e5-b4036d82b8ee'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:32:25.406161 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-9a59d846-4ede-4336-a3e5-b4036d82b8ee admin admin] The token cache is being invalidate because project eacf7ad63d954bb3891473308346e548 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:32:25.406517 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-9a59d846-4ede-4336-a3e5-b4036d82b8ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:32:25.407121 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-9a59d846-4ede-4336-a3e5-b4036d82b8ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:32:25.409380 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1171/2354] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:32:25 2022] DELETE /identity/v3/projects/eacf7ad63d954bb3891473308346e548 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:32:25.413336 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e879748-0574-4e79-8adf-4bad029f4c23 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:32:25.414765 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-2e879748-0574-4e79-8adf-4bad029f4c23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:32:25.418021 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:25.430897 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e879748-0574-4e79-8adf-4bad029f4c23 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:32:25.494945 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818b4dab-5e49-4363-af02-a86b67bfcc62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:32:25.495820 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b4dab-5e49-4363-af02-a86b67bfcc62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:25.496132 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b4dab-5e49-4363-af02-a86b67bfcc62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:25.496406 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b4dab-5e49-4363-af02-a86b67bfcc62 admin admin] PATH_INFO: `/v3/users/a9e89eb14e1e4eeb99b5c925fa5a3582` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:25.497582 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818b4dab-5e49-4363-af02-a86b67bfcc62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9e89eb14e1e4eeb99b5c925fa5a3582)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:32:25.499514 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818b4dab-5e49-4363-af02-a86b67bfcc62 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:32:25.615930 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:25.704290 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-818b4dab-5e49-4363-af02-a86b67bfcc62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9e89eb14e1e4eeb99b5c925fa5a3582'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:32:25.716533 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-818b4dab-5e49-4363-af02-a86b67bfcc62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9e89eb14e1e4eeb99b5c925fa5a3582'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:32:25.717194 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-818b4dab-5e49-4363-af02-a86b67bfcc62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9e89eb14e1e4eeb99b5c925fa5a3582'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:32:25.717790 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-818b4dab-5e49-4363-af02-a86b67bfcc62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9e89eb14e1e4eeb99b5c925fa5a3582'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:32:25.792627 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-818b4dab-5e49-4363-af02-a86b67bfcc62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9e89eb14e1e4eeb99b5c925fa5a3582'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:32:25.805768 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1184/2355] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:32:25 2022] DELETE /identity/v3/users/a9e89eb14e1e4eeb99b5c925fa5a3582 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:32:26.102704 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a59d846-4ede-4336-a3e5-b4036d82b8ee admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:32:26.104206 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-9a59d846-4ede-4336-a3e5-b4036d82b8ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:32:26.118624 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a59d846-4ede-4336-a3e5-b4036d82b8ee admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:32:26.178941 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a046453-d7dc-4445-9570-eecb8c980296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:32:26.179798 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a046453-d7dc-4445-9570-eecb8c980296 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:26.180109 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a046453-d7dc-4445-9570-eecb8c980296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:26.180413 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a046453-d7dc-4445-9570-eecb8c980296 admin admin] PATH_INFO: `/v3/projects/f2583b2d74f4436a8a9acae11b868c24` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:26.181879 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a046453-d7dc-4445-9570-eecb8c980296 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2583b2d74f4436a8a9acae11b868c24)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:32:26.183857 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a046453-d7dc-4445-9570-eecb8c980296 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:32:26.337968 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-6a046453-d7dc-4445-9570-eecb8c980296 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2583b2d74f4436a8a9acae11b868c24', 'request_id': 'req-6a046453-d7dc-4445-9570-eecb8c980296'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:32:26.344464 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-6a046453-d7dc-4445-9570-eecb8c980296 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2583b2d74f4436a8a9acae11b868c24', 'request_id': 'req-6a046453-d7dc-4445-9570-eecb8c980296'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:32:26.463738 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-6a046453-d7dc-4445-9570-eecb8c980296 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2583b2d74f4436a8a9acae11b868c24', 'request_id': 'req-6a046453-d7dc-4445-9570-eecb8c980296'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:32:26.475995 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-6a046453-d7dc-4445-9570-eecb8c980296 admin admin] The token cache is being invalidate because project f2583b2d74f4436a8a9acae11b868c24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:32:26.476313 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-6a046453-d7dc-4445-9570-eecb8c980296 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:32:26.476977 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-6a046453-d7dc-4445-9570-eecb8c980296 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:32:26.478670 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1172/2356] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:32:26 2022] DELETE /identity/v3/projects/f2583b2d74f4436a8a9acae11b868c24 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:32:26.483676 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d11cfd6-793e-4094-9f44-98555cec55b4 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:26.484676 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d11cfd6-793e-4094-9f44-98555cec55b4 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:26.484963 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d11cfd6-793e-4094-9f44-98555cec55b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:26.507436 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-9d11cfd6-793e-4094-9f44-98555cec55b4 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:32:26.520247 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-9d11cfd6-793e-4094-9f44-98555cec55b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:32:26.526613 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:26.584598 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1185/2357] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:32:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:32:26.592433 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845b989-095a-40c6-bac4-fe9922850bea None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:26.592977 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845b989-095a-40c6-bac4-fe9922850bea None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:26.594359 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:26.594853 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845b989-095a-40c6-bac4-fe9922850bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:26.613787 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-8845b989-095a-40c6-bac4-fe9922850bea None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:32:26.615050 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-8845b989-095a-40c6-bac4-fe9922850bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:32:26.623130 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1173/2358] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:32:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:32:26.627587 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d11cfd6-793e-4094-9f44-98555cec55b4 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:32:26.637479 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d11cfd6-793e-4094-9f44-98555cec55b4 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:32:26.642159 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097e9b93-b41e-4384-a94c-ac66d8563624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:32:26.642877 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e9b93-b41e-4384-a94c-ac66d8563624 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:26.643165 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e9b93-b41e-4384-a94c-ac66d8563624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:26.643445 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e9b93-b41e-4384-a94c-ac66d8563624 admin admin] PATH_INFO: `/v3/domains` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:26.644169 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097e9b93-b41e-4384-a94c-ac66d8563624 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:32:26.644477 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097e9b93-b41e-4384-a94c-ac66d8563624 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:32:26.646072 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097e9b93-b41e-4384-a94c-ac66d8563624 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:32:26.657869 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1186/2359] 10.222.0.62 () {58 vars in 1152 bytes} [Fri May 27 16:32:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:32:26.662659 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8845b989-095a-40c6-bac4-fe9922850bea None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:32:26.671781 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8845b989-095a-40c6-bac4-fe9922850bea None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:32:26.677076 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1ef235-eae8-4edc-860c-5027f77af385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:32:26.677723 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ef235-eae8-4edc-860c-5027f77af385 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:26.678009 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ef235-eae8-4edc-860c-5027f77af385 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:26.678317 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ef235-eae8-4edc-860c-5027f77af385 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:26.679014 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1ef235-eae8-4edc-860c-5027f77af385 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:32:26.680919 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1ef235-eae8-4edc-860c-5027f77af385 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:32:26.757271 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1174/2360] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:32:26 2022] POST /identity/v3/projects => generated 389 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:32:26.763844 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097e9b93-b41e-4384-a94c-ac66d8563624 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:32:26.773859 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097e9b93-b41e-4384-a94c-ac66d8563624 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:32:26.830482 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac86d55-6656-41a1-8f84-aa2c7d613d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:32:26.831159 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac86d55-6656-41a1-8f84-aa2c7d613d96 admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:26.831450 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac86d55-6656-41a1-8f84-aa2c7d613d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:26.831726 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac86d55-6656-41a1-8f84-aa2c7d613d96 admin admin] PATH_INFO: `/v3/users` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:26.832411 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac86d55-6656-41a1-8f84-aa2c7d613d96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:32:26.834406 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac86d55-6656-41a1-8f84-aa2c7d613d96 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:32:26.952622 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1187/2361] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:32:26 2022] POST /identity/v3/users => generated 295 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:32:26.957321 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1ef235-eae8-4edc-860c-5027f77af385 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:32:26.967422 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1ef235-eae8-4edc-860c-5027f77af385 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:32:26.972738 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bb8738-7658-4aec-b6a8-294468aa7efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:32:26.973322 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb8738-7658-4aec-b6a8-294468aa7efd admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:26.973699 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb8738-7658-4aec-b6a8-294468aa7efd admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:26.973983 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb8738-7658-4aec-b6a8-294468aa7efd admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:26.974751 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bb8738-7658-4aec-b6a8-294468aa7efd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:32:26.976343 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bb8738-7658-4aec-b6a8-294468aa7efd admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:32:26.986576 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1175/2362] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:32:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:32:26.990735 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac86d55-6656-41a1-8f84-aa2c7d613d96 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:32:27.000913 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac86d55-6656-41a1-8f84-aa2c7d613d96 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:32:27.006354 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae20a08f-a1f8-45dd-9553-969bf7bd3fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:32:27.007017 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae20a08f-a1f8-45dd-9553-969bf7bd3fb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:27.014047 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae20a08f-a1f8-45dd-9553-969bf7bd3fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:27.014047 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae20a08f-a1f8-45dd-9553-969bf7bd3fb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:27.014047 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae20a08f-a1f8-45dd-9553-969bf7bd3fb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:32:27.014047 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae20a08f-a1f8-45dd-9553-969bf7bd3fb4 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:32:27.020458 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1188/2363] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:32:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:32:27.024723 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bb8738-7658-4aec-b6a8-294468aa7efd admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:32:27.032480 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:27.038136 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bb8738-7658-4aec-b6a8-294468aa7efd admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:32:27.043922 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a2c708-5cd2-42f6-83c2-35415a750fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:32:27.044870 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a2c708-5cd2-42f6-83c2-35415a750fc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:27.045199 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a2c708-5cd2-42f6-83c2-35415a750fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:27.045514 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a2c708-5cd2-42f6-83c2-35415a750fc0 admin admin] PATH_INFO: `/v3/projects/6c2438adf8b84e6aafcaec94eb502a64/users/cf4c188db5134174a292f1b36ae294d8/roles/c8ce6d197f654598ac45f6016ecccabd` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:27.066270 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a2c708-5cd2-42f6-83c2-35415a750fc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c2438adf8b84e6aafcaec94eb502a64, user_id=cf4c188db5134174a292f1b36ae294d8, role_id=c8ce6d197f654598ac45f6016ecccabd)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:32:27.069049 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a2c708-5cd2-42f6-83c2-35415a750fc0 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:32:27.089633 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:27.137415 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1176/2364] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:32:27 2022] PUT /identity/v3/projects/6c2438adf8b84e6aafcaec94eb502a64/users/cf4c188db5134174a292f1b36ae294d8/roles/c8ce6d197f654598ac45f6016ecccabd => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:32:27.148421 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d3e5be-e673-42ae-a468-846b819e840a None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:27.148717 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d3e5be-e673-42ae-a468-846b819e840a None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:27.149000 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d3e5be-e673-42ae-a468-846b819e840a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:27.175664 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-e6d3e5be-e673-42ae-a468-846b819e840a None None] MFA Rules not processed for user `cf4c188db5134174a292f1b36ae294d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:32:27.176880 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-e6d3e5be-e673-42ae-a468-846b819e840a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:32:27.247336 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1189/2365] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:32:27 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:32:27.259348 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a2c708-5cd2-42f6-83c2-35415a750fc0 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:32:27.261038 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-39a2c708-5cd2-42f6-83c2-35415a750fc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:32:27.344449 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a2c708-5cd2-42f6-83c2-35415a750fc0 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:32:27.348126 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6f042f-3e19-4b48-8856-2ec22ebf6d04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8693a1e72f14fdfb383f11e96330726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:32:27.348775 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f042f-3e19-4b48-8856-2ec22ebf6d04 service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:27.349062 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f042f-3e19-4b48-8856-2ec22ebf6d04 service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:27.349341 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f042f-3e19-4b48-8856-2ec22ebf6d04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:27.357542 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6f042f-3e19-4b48-8856-2ec22ebf6d04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:32:27.359007 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6f042f-3e19-4b48-8856-2ec22ebf6d04 service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:32:27.368722 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1177/2366] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:32:27 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:32:27.435814 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:27.490055 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:28.007042 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:28.143883 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:28.884300 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:28.992769 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:30.130103 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:30.272482 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:31.206718 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:31.358617 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:32.021589 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:32.152633 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:33.743622 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:33.921584 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:34.099111 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:34.983877 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:35.246602 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:36.809618 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:37.029300 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:37.989195 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:38.232693 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:38.592381 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:38.644254 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:39.049592 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:39.229542 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:39.289271 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d3e5be-e673-42ae-a468-846b819e840a None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:32:39.360007 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d3e5be-e673-42ae-a468-846b819e840a None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:32:39.365583 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d604c2e-1685-4eb2-8a1f-647c2c85cac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:32:39.366105 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d604c2e-1685-4eb2-8a1f-647c2c85cac9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:39.366428 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d604c2e-1685-4eb2-8a1f-647c2c85cac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:39.366714 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d604c2e-1685-4eb2-8a1f-647c2c85cac9 admin admin] PATH_INFO: `/v3/users/cf4c188db5134174a292f1b36ae294d8` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:39.367924 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d604c2e-1685-4eb2-8a1f-647c2c85cac9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf4c188db5134174a292f1b36ae294d8)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:32:39.369926 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d604c2e-1685-4eb2-8a1f-647c2c85cac9 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:32:39.372271 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:39.617756 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-5d604c2e-1685-4eb2-8a1f-647c2c85cac9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf4c188db5134174a292f1b36ae294d8'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:32:39.630535 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-5d604c2e-1685-4eb2-8a1f-647c2c85cac9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf4c188db5134174a292f1b36ae294d8'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:32:39.631298 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-5d604c2e-1685-4eb2-8a1f-647c2c85cac9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf4c188db5134174a292f1b36ae294d8'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:32:39.631915 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-5d604c2e-1685-4eb2-8a1f-647c2c85cac9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf4c188db5134174a292f1b36ae294d8'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:32:39.737611 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-5d604c2e-1685-4eb2-8a1f-647c2c85cac9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf4c188db5134174a292f1b36ae294d8'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:32:39.751721 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1190/2367] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:32:39 2022] DELETE /identity/v3/users/cf4c188db5134174a292f1b36ae294d8 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:32:39.757090 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f27f0f-700f-4128-9ee6-e1445f9b1157 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:39.757581 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f27f0f-700f-4128-9ee6-e1445f9b1157 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:39.757915 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f27f0f-700f-4128-9ee6-e1445f9b1157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:39.775599 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-d3f27f0f-700f-4128-9ee6-e1445f9b1157 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:32:39.780040 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-d3f27f0f-700f-4128-9ee6-e1445f9b1157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:32:39.834052 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1178/2368] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:32:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:32:39.843701 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d604c2e-1685-4eb2-8a1f-647c2c85cac9 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:32:39.845157 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-5d604c2e-1685-4eb2-8a1f-647c2c85cac9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:32:39.882826 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:39.905047 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d604c2e-1685-4eb2-8a1f-647c2c85cac9 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:32:39.908779 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f2078-cded-4a63-a358-2f4e15c8a8cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:32:39.912982 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f2078-cded-4a63-a358-2f4e15c8a8cc service neutron] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:39.912982 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f2078-cded-4a63-a358-2f4e15c8a8cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:39.912982 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f2078-cded-4a63-a358-2f4e15c8a8cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:39.919815 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3f2078-cded-4a63-a358-2f4e15c8a8cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:32:39.921247 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3f2078-cded-4a63-a358-2f4e15c8a8cc service neutron] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:32:39.931463 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1191/2369] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:32:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:32:40.306826 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:40.441635 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f27f0f-700f-4128-9ee6-e1445f9b1157 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:32:40.443196 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-d3f27f0f-700f-4128-9ee6-e1445f9b1157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:32:40.457263 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f27f0f-700f-4128-9ee6-e1445f9b1157 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:32:40.464556 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed04e20-c259-4631-857a-8be3cd05ba1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:32:40.465510 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed04e20-c259-4631-857a-8be3cd05ba1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:40.465800 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed04e20-c259-4631-857a-8be3cd05ba1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:40.466120 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed04e20-c259-4631-857a-8be3cd05ba1b admin admin] PATH_INFO: `/v3/projects/6c2438adf8b84e6aafcaec94eb502a64` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:40.467307 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed04e20-c259-4631-857a-8be3cd05ba1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c2438adf8b84e6aafcaec94eb502a64)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:32:40.469220 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed04e20-c259-4631-857a-8be3cd05ba1b admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:32:40.512662 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:40.583648 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-0ed04e20-c259-4631-857a-8be3cd05ba1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c2438adf8b84e6aafcaec94eb502a64', 'request_id': 'req-0ed04e20-c259-4631-857a-8be3cd05ba1b'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:32:40.589938 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-0ed04e20-c259-4631-857a-8be3cd05ba1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c2438adf8b84e6aafcaec94eb502a64', 'request_id': 'req-0ed04e20-c259-4631-857a-8be3cd05ba1b'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:32:40.592640 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:40.686108 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-0ed04e20-c259-4631-857a-8be3cd05ba1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c2438adf8b84e6aafcaec94eb502a64', 'request_id': 'req-0ed04e20-c259-4631-857a-8be3cd05ba1b'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:32:40.697838 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-0ed04e20-c259-4631-857a-8be3cd05ba1b admin admin] The token cache is being invalidate because project 6c2438adf8b84e6aafcaec94eb502a64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:32:40.698128 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-0ed04e20-c259-4631-857a-8be3cd05ba1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:32:40.698779 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-0ed04e20-c259-4631-857a-8be3cd05ba1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:32:40.700315 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1179/2370] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:32:40 2022] DELETE /identity/v3/projects/6c2438adf8b84e6aafcaec94eb502a64 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:32:40.706632 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2bec9b-e133-4613-bb75-2a4a84d80185 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:40.708613 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2bec9b-e133-4613-bb75-2a4a84d80185 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:40.708613 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2bec9b-e133-4613-bb75-2a4a84d80185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:40.726006 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-5e2bec9b-e133-4613-bb75-2a4a84d80185 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:32:40.727247 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-5e2bec9b-e133-4613-bb75-2a4a84d80185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:32:40.792093 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1192/2371] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:32:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:32:40.802066 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a84eb96-7152-436a-bc18-3ef83c876faf None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:40.802679 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a84eb96-7152-436a-bc18-3ef83c876faf None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:40.802679 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a84eb96-7152-436a-bc18-3ef83c876faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:40.822209 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-0a84eb96-7152-436a-bc18-3ef83c876faf None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:32:40.823710 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-0a84eb96-7152-436a-bc18-3ef83c876faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:32:40.831828 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1180/2372] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:32:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:32:40.836973 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2bec9b-e133-4613-bb75-2a4a84d80185 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:32:40.846687 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2bec9b-e133-4613-bb75-2a4a84d80185 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:32:40.851281 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6c8615-fdeb-4ba7-a959-14898332c731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:32:40.851937 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c8615-fdeb-4ba7-a959-14898332c731 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:40.852217 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c8615-fdeb-4ba7-a959-14898332c731 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:40.852492 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c8615-fdeb-4ba7-a959-14898332c731 admin admin] PATH_INFO: `/v3/domains` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:40.853246 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6c8615-fdeb-4ba7-a959-14898332c731 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:32:40.853654 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6c8615-fdeb-4ba7-a959-14898332c731 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:32:40.855283 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6c8615-fdeb-4ba7-a959-14898332c731 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:32:40.870515 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1193/2373] 10.222.0.62 () {58 vars in 1152 bytes} [Fri May 27 16:32:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:32:40.872518 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a84eb96-7152-436a-bc18-3ef83c876faf None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:32:40.883198 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a84eb96-7152-436a-bc18-3ef83c876faf None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:32:40.888951 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9666414-8fe0-445e-a3b2-484874a28b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:32:40.889628 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9666414-8fe0-445e-a3b2-484874a28b37 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:40.889910 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9666414-8fe0-445e-a3b2-484874a28b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:40.890183 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9666414-8fe0-445e-a3b2-484874a28b37 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:40.890913 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9666414-8fe0-445e-a3b2-484874a28b37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:32:40.892892 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9666414-8fe0-445e-a3b2-484874a28b37 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:32:40.938168 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:41.006487 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1181/2374] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:32:40 2022] POST /identity/v3/projects => generated 371 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:32:41.010855 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6c8615-fdeb-4ba7-a959-14898332c731 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:32:41.015396 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:41.022089 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6c8615-fdeb-4ba7-a959-14898332c731 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:32:41.081137 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1143272-bf31-4038-9055-ba240589a835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:32:41.081816 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1143272-bf31-4038-9055-ba240589a835 admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:41.082161 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1143272-bf31-4038-9055-ba240589a835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:41.082428 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1143272-bf31-4038-9055-ba240589a835 admin admin] PATH_INFO: `/v3/users` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:41.083201 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1143272-bf31-4038-9055-ba240589a835 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:32:41.085145 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1143272-bf31-4038-9055-ba240589a835 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:32:41.109340 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:41.198976 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1194/2375] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:32:41 2022] POST /identity/v3/users => generated 286 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:32:41.202698 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9666414-8fe0-445e-a3b2-484874a28b37 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:32:41.213929 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9666414-8fe0-445e-a3b2-484874a28b37 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:32:41.218491 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f1c5fd-f594-4400-a13d-c5b07462b629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:32:41.219188 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f1c5fd-f594-4400-a13d-c5b07462b629 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:41.219474 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f1c5fd-f594-4400-a13d-c5b07462b629 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:41.219758 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f1c5fd-f594-4400-a13d-c5b07462b629 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:41.220480 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f1c5fd-f594-4400-a13d-c5b07462b629 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:32:41.222068 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f1c5fd-f594-4400-a13d-c5b07462b629 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:32:41.233650 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1182/2376] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:32:41.238550 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1143272-bf31-4038-9055-ba240589a835 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:32:41.251457 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1143272-bf31-4038-9055-ba240589a835 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:32:41.258770 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b31d71-276e-402e-87ac-24b8cea974f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:32:41.259511 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b31d71-276e-402e-87ac-24b8cea974f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:41.259807 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b31d71-276e-402e-87ac-24b8cea974f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:41.260094 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b31d71-276e-402e-87ac-24b8cea974f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:41.260836 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b31d71-276e-402e-87ac-24b8cea974f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:32:41.262544 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b31d71-276e-402e-87ac-24b8cea974f7 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:32:41.273716 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1195/2377] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:32:41.277959 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f1c5fd-f594-4400-a13d-c5b07462b629 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:32:41.289251 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f1c5fd-f594-4400-a13d-c5b07462b629 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:32:41.293968 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b099bed1-df4f-48e5-841f-181b362a36ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:32:41.294907 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b099bed1-df4f-48e5-841f-181b362a36ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:41.295194 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b099bed1-df4f-48e5-841f-181b362a36ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:41.295478 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b099bed1-df4f-48e5-841f-181b362a36ac admin admin] PATH_INFO: `/v3/projects/6747dc5934974552927a9d9098e83048/users/20c8836936334236b2f889c0d322ffb3/roles/c8ce6d197f654598ac45f6016ecccabd` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:41.310710 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b099bed1-df4f-48e5-841f-181b362a36ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=6747dc5934974552927a9d9098e83048, user_id=20c8836936334236b2f889c0d322ffb3, role_id=c8ce6d197f654598ac45f6016ecccabd)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:32:41.314486 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b099bed1-df4f-48e5-841f-181b362a36ac admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:32:41.435425 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1183/2378] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:32:41 2022] PUT /identity/v3/projects/6747dc5934974552927a9d9098e83048/users/20c8836936334236b2f889c0d322ffb3/roles/c8ce6d197f654598ac45f6016ecccabd => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:32:41.441105 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656f91d-87b0-4dcf-9eff-b7ad30a39394 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:41.441499 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656f91d-87b0-4dcf-9eff-b7ad30a39394 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:41.442126 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656f91d-87b0-4dcf-9eff-b7ad30a39394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:41.462364 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-2656f91d-87b0-4dcf-9eff-b7ad30a39394 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:32:41.464517 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-2656f91d-87b0-4dcf-9eff-b7ad30a39394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:32:41.521103 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:41.541829 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1196/2379] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:32:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:32:41.559350 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b099bed1-df4f-48e5-841f-181b362a36ac admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:32:41.562798 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-b099bed1-df4f-48e5-841f-181b362a36ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:32:41.630362 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b099bed1-df4f-48e5-841f-181b362a36ac admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:32:41.634091 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8861b833-6777-4758-8bdc-36c3918629af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:32:41.634962 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861b833-6777-4758-8bdc-36c3918629af service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:41.635432 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861b833-6777-4758-8bdc-36c3918629af service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:41.635764 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861b833-6777-4758-8bdc-36c3918629af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:41.645664 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8861b833-6777-4758-8bdc-36c3918629af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:32:41.647699 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8861b833-6777-4758-8bdc-36c3918629af service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:32:41.657527 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1184/2380] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:32:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:32:41.792460 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:43.152839 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:43.601423 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:44.938214 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:45.389321 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:INSERT=5,keystone:DELETE=1,keystone:SELECT=94 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:46.187143 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:46.641087 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:47.506868 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:48.200910 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:48.452485 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d246aea-9296-41d4-8267-eb0326333ed8 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:48.453020 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d246aea-9296-41d4-8267-eb0326333ed8 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:48.453463 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d246aea-9296-41d4-8267-eb0326333ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:48.493582 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-6d246aea-9296-41d4-8267-eb0326333ed8 None None] MFA Rules not processed for user `20c8836936334236b2f889c0d322ffb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:32:48.494945 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-6d246aea-9296-41d4-8267-eb0326333ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:32:48.564427 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1197/2381] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:32:48 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:32:48.569724 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8861b833-6777-4758-8bdc-36c3918629af service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:32:48.580793 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8861b833-6777-4758-8bdc-36c3918629af service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:32:48.585510 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101d7632-bdfe-4be7-af6e-41e451ed3e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:32:48.586339 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d7632-bdfe-4be7-af6e-41e451ed3e80 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:48.589575 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d7632-bdfe-4be7-af6e-41e451ed3e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:48.589904 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d7632-bdfe-4be7-af6e-41e451ed3e80 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:48.590679 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101d7632-bdfe-4be7-af6e-41e451ed3e80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:32:48.592645 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101d7632-bdfe-4be7-af6e-41e451ed3e80 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:32:48.713884 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1185/2382] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:32:48 2022] POST /identity/v3/projects => generated 371 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:32:48.715571 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d246aea-9296-41d4-8267-eb0326333ed8 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:32:48.726770 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d246aea-9296-41d4-8267-eb0326333ed8 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:32:48.783620 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14e5652-2652-4a1b-b185-91f8e4e65a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:32:48.784194 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e5652-2652-4a1b-b185-91f8e4e65a05 admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:48.784482 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e5652-2652-4a1b-b185-91f8e4e65a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:48.784763 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e5652-2652-4a1b-b185-91f8e4e65a05 admin admin] PATH_INFO: `/v3/users` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:48.785446 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14e5652-2652-4a1b-b185-91f8e4e65a05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:32:48.787601 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14e5652-2652-4a1b-b185-91f8e4e65a05 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:32:48.938176 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1198/2383] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:32:48 2022] POST /identity/v3/users => generated 292 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:32:48.942784 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101d7632-bdfe-4be7-af6e-41e451ed3e80 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:32:48.953984 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101d7632-bdfe-4be7-af6e-41e451ed3e80 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:32:48.962876 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9df568f-13cb-482d-bcd3-39042a38c20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:32:48.963860 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df568f-13cb-482d-bcd3-39042a38c20d admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:48.964443 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df568f-13cb-482d-bcd3-39042a38c20d admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:48.964951 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df568f-13cb-482d-bcd3-39042a38c20d admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:48.966092 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9df568f-13cb-482d-bcd3-39042a38c20d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:32:48.967989 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9df568f-13cb-482d-bcd3-39042a38c20d admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:32:48.979529 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1186/2384] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:32:48 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:32:48.983726 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14e5652-2652-4a1b-b185-91f8e4e65a05 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:32:48.994033 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14e5652-2652-4a1b-b185-91f8e4e65a05 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:32:48.998892 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94961c94-23f0-4d2d-a8b2-666ac6cddf29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:32:48.999785 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94961c94-23f0-4d2d-a8b2-666ac6cddf29 admin admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:49.000073 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94961c94-23f0-4d2d-a8b2-666ac6cddf29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:49.000343 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94961c94-23f0-4d2d-a8b2-666ac6cddf29 admin admin] PATH_INFO: `/v3/projects/656050d58806482184a6d637ac8381d2/users/ec615a366b004bbba3128c6f18cdaac4/roles/e04fe3eb1f714d74901ac83e33ea8a16` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:49.019080 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94961c94-23f0-4d2d-a8b2-666ac6cddf29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=656050d58806482184a6d637ac8381d2, user_id=ec615a366b004bbba3128c6f18cdaac4, role_id=e04fe3eb1f714d74901ac83e33ea8a16)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:32:49.022371 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94961c94-23f0-4d2d-a8b2-666ac6cddf29 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:32:49.109379 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1199/2385] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:32:48 2022] PUT /identity/v3/projects/656050d58806482184a6d637ac8381d2/users/ec615a366b004bbba3128c6f18cdaac4/roles/e04fe3eb1f714d74901ac83e33ea8a16 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:32:49.113923 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9df568f-13cb-482d-bcd3-39042a38c20d admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:32:49.123464 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9df568f-13cb-482d-bcd3-39042a38c20d admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:32:49.182958 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9ed37b-d536-4e36-b8f9-1229d8a2c47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:32:49.183641 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ed37b-d536-4e36-b8f9-1229d8a2c47b admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:49.183930 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ed37b-d536-4e36-b8f9-1229d8a2c47b admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:49.184212 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ed37b-d536-4e36-b8f9-1229d8a2c47b admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:49.184943 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9ed37b-d536-4e36-b8f9-1229d8a2c47b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:32:49.186571 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9ed37b-d536-4e36-b8f9-1229d8a2c47b admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:32:49.203066 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1187/2386] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:32:49 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:32:49.203256 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94961c94-23f0-4d2d-a8b2-666ac6cddf29 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:32:49.216643 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94961c94-23f0-4d2d-a8b2-666ac6cddf29 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:32:49.222119 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc220727-dd84-478a-a5f1-1b98e8ca77c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:32:49.223383 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc220727-dd84-478a-a5f1-1b98e8ca77c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:49.223844 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc220727-dd84-478a-a5f1-1b98e8ca77c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:49.224415 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc220727-dd84-478a-a5f1-1b98e8ca77c7 admin admin] PATH_INFO: `/v3/projects/656050d58806482184a6d637ac8381d2/users/ec615a366b004bbba3128c6f18cdaac4/roles/e04fe3eb1f714d74901ac83e33ea8a16` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:49.227850 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc220727-dd84-478a-a5f1-1b98e8ca77c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=656050d58806482184a6d637ac8381d2, user_id=ec615a366b004bbba3128c6f18cdaac4, role_id=e04fe3eb1f714d74901ac83e33ea8a16)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:32:49.262536 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc220727-dd84-478a-a5f1-1b98e8ca77c7 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:32:49.262536 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1200/2387] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:32:49 2022] PUT /identity/v3/projects/656050d58806482184a6d637ac8381d2/users/ec615a366b004bbba3128c6f18cdaac4/roles/e04fe3eb1f714d74901ac83e33ea8a16 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:32:49.430738 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:49.525305 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:51.320422 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:51.363694 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9ed37b-d536-4e36-b8f9-1229d8a2c47b admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:32:51.369000 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-cb9ed37b-d536-4e36-b8f9-1229d8a2c47b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:32:51.401650 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9ed37b-d536-4e36-b8f9-1229d8a2c47b admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:32:51.475789 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:51.487478 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f021e46a-c5c1-44bc-86dc-caea002fc7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:32:51.488632 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f021e46a-c5c1-44bc-86dc-caea002fc7cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:51.489051 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f021e46a-c5c1-44bc-86dc-caea002fc7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:51.489824 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f021e46a-c5c1-44bc-86dc-caea002fc7cd admin admin] PATH_INFO: `/v3/users/8cd2f9f848764a22b916ae7a27a02bf4` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:51.491202 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f021e46a-c5c1-44bc-86dc-caea002fc7cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cd2f9f848764a22b916ae7a27a02bf4)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:32:51.495093 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f021e46a-c5c1-44bc-86dc-caea002fc7cd admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:32:51.746762 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-f021e46a-c5c1-44bc-86dc-caea002fc7cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cd2f9f848764a22b916ae7a27a02bf4'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:32:51.762792 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-f021e46a-c5c1-44bc-86dc-caea002fc7cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cd2f9f848764a22b916ae7a27a02bf4'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:32:51.763952 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-f021e46a-c5c1-44bc-86dc-caea002fc7cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cd2f9f848764a22b916ae7a27a02bf4'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:32:51.765471 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-f021e46a-c5c1-44bc-86dc-caea002fc7cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cd2f9f848764a22b916ae7a27a02bf4'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:32:51.881349 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-f021e46a-c5c1-44bc-86dc-caea002fc7cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cd2f9f848764a22b916ae7a27a02bf4'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:32:51.945819 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1188/2388] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:32:51 2022] DELETE /identity/v3/users/8cd2f9f848764a22b916ae7a27a02bf4 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:32:51.954489 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac78dcec-1866-4d97-b812-aff031bb4325 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:51.954863 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac78dcec-1866-4d97-b812-aff031bb4325 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:51.955403 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac78dcec-1866-4d97-b812-aff031bb4325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:52.002774 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-ac78dcec-1866-4d97-b812-aff031bb4325 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:32:52.008505 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-ac78dcec-1866-4d97-b812-aff031bb4325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:32:52.137910 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1201/2389] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:32:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:32:52.155036 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f021e46a-c5c1-44bc-86dc-caea002fc7cd admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:32:52.162728 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-f021e46a-c5c1-44bc-86dc-caea002fc7cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:32:52.308001 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f021e46a-c5c1-44bc-86dc-caea002fc7cd admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:32:52.317423 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a7ecb5-891c-46eb-a680-a74985265304 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:32:52.318536 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a7ecb5-891c-46eb-a680-a74985265304 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:52.319005 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a7ecb5-891c-46eb-a680-a74985265304 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:52.319413 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a7ecb5-891c-46eb-a680-a74985265304 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:52.332263 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a7ecb5-891c-46eb-a680-a74985265304 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:32:52.337132 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a7ecb5-891c-46eb-a680-a74985265304 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:32:52.352449 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1189/2390] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:32:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:32:52.702174 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c7de5-8b05-4f68-b677-59e7ad8ffd5f None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:52.702791 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c7de5-8b05-4f68-b677-59e7ad8ffd5f None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:52.704753 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c7de5-8b05-4f68-b677-59e7ad8ffd5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:52.740657 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-101c7de5-8b05-4f68-b677-59e7ad8ffd5f None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:32:52.741994 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-101c7de5-8b05-4f68-b677-59e7ad8ffd5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:32:52.751330 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1202/2391] 10.222.0.79 () {58 vars in 1016 bytes} [Fri May 27 16:32:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:32:52.786116 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a7ecb5-891c-46eb-a680-a74985265304 service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:32:52.787729 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-42a7ecb5-891c-46eb-a680-a74985265304 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:32:52.978949 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a7ecb5-891c-46eb-a680-a74985265304 service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:32:52.984863 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1721ead9-1628-4596-ad84-759791d39109 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb13ad6d8b1e46029262556bff398796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:32:52.985576 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721ead9-1628-4596-ad84-759791d39109 service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:52.985863 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721ead9-1628-4596-ad84-759791d39109 service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:52.986171 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721ead9-1628-4596-ad84-759791d39109 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:52.995780 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1721ead9-1628-4596-ad84-759791d39109 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:32:52.997502 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1721ead9-1628-4596-ad84-759791d39109 service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:32:53.005723 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:53.011302 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1190/2392] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:32:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:32:53.042511 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101c7de5-8b05-4f68-b677-59e7ad8ffd5f None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:32:53.044011 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-101c7de5-8b05-4f68-b677-59e7ad8ffd5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:32:53.062721 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101c7de5-8b05-4f68-b677-59e7ad8ffd5f None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:32:53.073729 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49df5847-b430-467a-a3fc-9e44ef649b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:32:53.074715 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49df5847-b430-467a-a3fc-9e44ef649b15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:53.075301 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49df5847-b430-467a-a3fc-9e44ef649b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:53.075855 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49df5847-b430-467a-a3fc-9e44ef649b15 admin admin] PATH_INFO: `/v3/projects/1d499e788aac42c198827fbd99ae778e` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:53.077830 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49df5847-b430-467a-a3fc-9e44ef649b15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d499e788aac42c198827fbd99ae778e)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:32:53.080024 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49df5847-b430-467a-a3fc-9e44ef649b15 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:32:53.110910 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1721ead9-1628-4596-ad84-759791d39109 service nova] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:32:53.112870 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-1721ead9-1628-4596-ad84-759791d39109 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:32:53.130332 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1721ead9-1628-4596-ad84-759791d39109 service nova] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:32:53.135215 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e4b704-ce0a-4d3b-9a75-1b0d4ca027f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:32:53.136113 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e4b704-ce0a-4d3b-9a75-1b0d4ca027f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:53.136442 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e4b704-ce0a-4d3b-9a75-1b0d4ca027f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:53.136744 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e4b704-ce0a-4d3b-9a75-1b0d4ca027f9 admin admin] PATH_INFO: `/v3/users/eb0106e06cb642b0b8ed99c4a26078e1` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:53.138055 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e4b704-ce0a-4d3b-9a75-1b0d4ca027f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb0106e06cb642b0b8ed99c4a26078e1)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:32:53.140096 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e4b704-ce0a-4d3b-9a75-1b0d4ca027f9 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:32:53.334803 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-49df5847-b430-467a-a3fc-9e44ef649b15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d499e788aac42c198827fbd99ae778e', 'request_id': 'req-49df5847-b430-467a-a3fc-9e44ef649b15'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:32:53.342496 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-49df5847-b430-467a-a3fc-9e44ef649b15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d499e788aac42c198827fbd99ae778e', 'request_id': 'req-49df5847-b430-467a-a3fc-9e44ef649b15'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:32:53.350719 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-49df5847-b430-467a-a3fc-9e44ef649b15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d499e788aac42c198827fbd99ae778e', 'request_id': 'req-49df5847-b430-467a-a3fc-9e44ef649b15'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:32:53.487147 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-49df5847-b430-467a-a3fc-9e44ef649b15 admin admin] The token cache is being invalidate because project 1d499e788aac42c198827fbd99ae778e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80288) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:32:53.487449 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-49df5847-b430-467a-a3fc-9e44ef649b15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:32:53.488136 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-49df5847-b430-467a-a3fc-9e44ef649b15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:32:53.489782 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1203/2393] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:32:53 2022] DELETE /identity/v3/projects/1d499e788aac42c198827fbd99ae778e => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:32:53.495418 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f0dd9-9eb3-4cac-a8a8-73c35c0433c3 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:53.495883 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f0dd9-9eb3-4cac-a8a8-73c35c0433c3 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:53.496243 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f0dd9-9eb3-4cac-a8a8-73c35c0433c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:53.501125 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-d6e4b704-ce0a-4d3b-9a75-1b0d4ca027f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb0106e06cb642b0b8ed99c4a26078e1'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:32:53.517337 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-d6e4b704-ce0a-4d3b-9a75-1b0d4ca027f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb0106e06cb642b0b8ed99c4a26078e1'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:32:53.518513 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-d6e4b704-ce0a-4d3b-9a75-1b0d4ca027f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb0106e06cb642b0b8ed99c4a26078e1'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:32:53.519475 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-d6e4b704-ce0a-4d3b-9a75-1b0d4ca027f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb0106e06cb642b0b8ed99c4a26078e1'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:32:53.532912 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-771f0dd9-9eb3-4cac-a8a8-73c35c0433c3 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:32:53.534164 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-771f0dd9-9eb3-4cac-a8a8-73c35c0433c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:32:53.619020 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1204/2394] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:32:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:32:53.634062 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4125ff70-45e0-49be-9ea1-85cacc365bee None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:53.634371 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4125ff70-45e0-49be-9ea1-85cacc365bee None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:53.634661 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4125ff70-45e0-49be-9ea1-85cacc365bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:53.645889 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-d6e4b704-ce0a-4d3b-9a75-1b0d4ca027f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb0106e06cb642b0b8ed99c4a26078e1'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:32:53.660047 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-4125ff70-45e0-49be-9ea1-85cacc365bee None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:32:53.664250 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:53.666016 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-4125ff70-45e0-49be-9ea1-85cacc365bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:32:53.670474 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1191/2395] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:32:53 2022] DELETE /identity/v3/users/eb0106e06cb642b0b8ed99c4a26078e1 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:32:53.674981 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc2ea3-eb81-4f9c-b0a2-18293a0a590f None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:53.675627 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc2ea3-eb81-4f9c-b0a2-18293a0a590f None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:53.676214 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc2ea3-eb81-4f9c-b0a2-18293a0a590f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:53.679001 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1205/2396] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:32:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:32:53.682724 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4125ff70-45e0-49be-9ea1-85cacc365bee None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:32:53.693677 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4125ff70-45e0-49be-9ea1-85cacc365bee None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:32:53.697809 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-06bc2ea3-eb81-4f9c-b0a2-18293a0a590f None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:32:53.702099 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-06bc2ea3-eb81-4f9c-b0a2-18293a0a590f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:32:53.782546 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58386c5e-b27e-4d5a-99ad-5c0b1fb55e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:32:53.783226 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58386c5e-b27e-4d5a-99ad-5c0b1fb55e13 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:53.783514 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58386c5e-b27e-4d5a-99ad-5c0b1fb55e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:53.783795 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58386c5e-b27e-4d5a-99ad-5c0b1fb55e13 admin admin] PATH_INFO: `/v3/domains` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:53.784539 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58386c5e-b27e-4d5a-99ad-5c0b1fb55e13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:32:53.784852 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58386c5e-b27e-4d5a-99ad-5c0b1fb55e13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:32:53.786739 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58386c5e-b27e-4d5a-99ad-5c0b1fb55e13 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:32:53.808431 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1206/2397] 10.222.0.62 () {58 vars in 1152 bytes} [Fri May 27 16:32:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:32:53.809852 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58386c5e-b27e-4d5a-99ad-5c0b1fb55e13 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:32:53.814860 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1192/2398] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:32:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:32:53.821754 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc2ea3-eb81-4f9c-b0a2-18293a0a590f None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:32:53.826791 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-06bc2ea3-eb81-4f9c-b0a2-18293a0a590f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:32:53.828025 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58386c5e-b27e-4d5a-99ad-5c0b1fb55e13 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:32:53.836057 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3248a6e5-2cda-421c-b04f-122ad532877b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:32:53.836710 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248a6e5-2cda-421c-b04f-122ad532877b admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:53.836999 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248a6e5-2cda-421c-b04f-122ad532877b admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:53.837666 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248a6e5-2cda-421c-b04f-122ad532877b admin admin] PATH_INFO: `/v3/projects` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:53.838426 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3248a6e5-2cda-421c-b04f-122ad532877b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:32:53.844845 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3248a6e5-2cda-421c-b04f-122ad532877b admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:32:53.951815 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc2ea3-eb81-4f9c-b0a2-18293a0a590f None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:32:53.964296 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a640c58-e44e-46dc-9bb6-cf030a0aab4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:32:53.965167 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a640c58-e44e-46dc-9bb6-cf030a0aab4d service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:53.965639 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a640c58-e44e-46dc-9bb6-cf030a0aab4d service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:53.966093 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a640c58-e44e-46dc-9bb6-cf030a0aab4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:53.991116 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a640c58-e44e-46dc-9bb6-cf030a0aab4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:32:53.993814 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1207/2399] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:32:53 2022] POST /identity/v3/projects => generated 385 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:32:53.995857 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a640c58-e44e-46dc-9bb6-cf030a0aab4d service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:32:53.997946 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3248a6e5-2cda-421c-b04f-122ad532877b admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:32:54.021408 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1193/2400] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:32:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:32:54.170699 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3248a6e5-2cda-421c-b04f-122ad532877b admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:32:54.180566 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be47a541-4a14-423f-b954-45df7bff9825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:32:54.182647 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be47a541-4a14-423f-b954-45df7bff9825 admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:54.183179 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be47a541-4a14-423f-b954-45df7bff9825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:54.183694 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be47a541-4a14-423f-b954-45df7bff9825 admin admin] PATH_INFO: `/v3/users` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:54.185031 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be47a541-4a14-423f-b954-45df7bff9825 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:32:54.188311 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be47a541-4a14-423f-b954-45df7bff9825 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:32:54.315260 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1208/2401] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:32:53 2022] POST /identity/v3/users => generated 293 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:32:54.315800 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a640c58-e44e-46dc-9bb6-cf030a0aab4d service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:32:54.339684 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a640c58-e44e-46dc-9bb6-cf030a0aab4d service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:32:54.363515 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f73dfb-1ccf-467a-890c-6a6a54dc737c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:32:54.367452 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f73dfb-1ccf-467a-890c-6a6a54dc737c admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:54.367827 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f73dfb-1ccf-467a-890c-6a6a54dc737c admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:54.368153 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f73dfb-1ccf-467a-890c-6a6a54dc737c admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:54.375216 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f73dfb-1ccf-467a-890c-6a6a54dc737c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:32:54.377583 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f73dfb-1ccf-467a-890c-6a6a54dc737c admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:32:54.409554 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be47a541-4a14-423f-b954-45df7bff9825 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:32:54.425913 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be47a541-4a14-423f-b954-45df7bff9825 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:32:54.427641 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1194/2402] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:32:54 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 16:32:54.443240 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d732a16-e1b6-4630-a835-16ebf6de353c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:32:54.443966 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d732a16-e1b6-4630-a835-16ebf6de353c admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:54.444305 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d732a16-e1b6-4630-a835-16ebf6de353c admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:54.444584 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d732a16-e1b6-4630-a835-16ebf6de353c admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:54.445532 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d732a16-e1b6-4630-a835-16ebf6de353c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:32:54.450541 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d732a16-e1b6-4630-a835-16ebf6de353c admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:32:54.473991 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1209/2403] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:32:54 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:32:54.479122 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f73dfb-1ccf-467a-890c-6a6a54dc737c admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:32:54.493355 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f73dfb-1ccf-467a-890c-6a6a54dc737c admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:32:54.513903 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131a0c80-6b18-4e83-accd-76b607feabe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:32:54.514883 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a0c80-6b18-4e83-accd-76b607feabe8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:54.515164 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a0c80-6b18-4e83-accd-76b607feabe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:54.515484 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a0c80-6b18-4e83-accd-76b607feabe8 admin admin] PATH_INFO: `/v3/projects/8162d445bdab4e14abeaae6242eece45/users/4203b914b8bd40249d70dc77fb7c56f1/roles/c8ce6d197f654598ac45f6016ecccabd` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:54.534308 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131a0c80-6b18-4e83-accd-76b607feabe8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8162d445bdab4e14abeaae6242eece45, user_id=4203b914b8bd40249d70dc77fb7c56f1, role_id=c8ce6d197f654598ac45f6016ecccabd)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:32:54.538508 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131a0c80-6b18-4e83-accd-76b607feabe8 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:32:54.658294 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1195/2404] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:32:54 2022] PUT /identity/v3/projects/8162d445bdab4e14abeaae6242eece45/users/4203b914b8bd40249d70dc77fb7c56f1/roles/c8ce6d197f654598ac45f6016ecccabd => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:32:54.664402 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a649f37-6cf4-4018-bdaa-8e6e530daf6f None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:54.664699 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a649f37-6cf4-4018-bdaa-8e6e530daf6f None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:54.664977 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a649f37-6cf4-4018-bdaa-8e6e530daf6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:54.686584 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-2a649f37-6cf4-4018-bdaa-8e6e530daf6f None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:32:54.688159 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-2a649f37-6cf4-4018-bdaa-8e6e530daf6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:32:54.735680 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131a0c80-6b18-4e83-accd-76b607feabe8 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:32:54.739602 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-131a0c80-6b18-4e83-accd-76b607feabe8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:32:54.820436 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1210/2405] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:32:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:32:54.829748 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a649f37-6cf4-4018-bdaa-8e6e530daf6f None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:32:54.904043 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131a0c80-6b18-4e83-accd-76b607feabe8 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:32:54.923256 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2c0a8c-0c9d-4039-81fc-3339c0e54bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:32:54.924176 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c0a8c-0c9d-4039-81fc-3339c0e54bec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:54.924656 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c0a8c-0c9d-4039-81fc-3339c0e54bec admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:54.924970 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c0a8c-0c9d-4039-81fc-3339c0e54bec admin admin] PATH_INFO: `/v3/projects/a0931cd4d96e43af8f6f24f5fec64342` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:54.927771 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2c0a8c-0c9d-4039-81fc-3339c0e54bec admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0931cd4d96e43af8f6f24f5fec64342)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:32:54.929779 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2c0a8c-0c9d-4039-81fc-3339c0e54bec admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:32:54.961070 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a649f37-6cf4-4018-bdaa-8e6e530daf6f None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:32:54.972550 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cc34b6-2d91-4423-bd01-855074036294 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:32:54.973443 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc34b6-2d91-4423-bd01-855074036294 service neutron] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:54.973732 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc34b6-2d91-4423-bd01-855074036294 service neutron] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:54.974007 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc34b6-2d91-4423-bd01-855074036294 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:54.999046 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cc34b6-2d91-4423-bd01-855074036294 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:32:55.000515 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cc34b6-2d91-4423-bd01-855074036294 service neutron] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:32:55.020554 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1211/2406] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:32:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 16:32:55.207628 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-6f2c0a8c-0c9d-4039-81fc-3339c0e54bec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0931cd4d96e43af8f6f24f5fec64342', 'request_id': 'req-6f2c0a8c-0c9d-4039-81fc-3339c0e54bec'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:32:55.215458 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-6f2c0a8c-0c9d-4039-81fc-3339c0e54bec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0931cd4d96e43af8f6f24f5fec64342', 'request_id': 'req-6f2c0a8c-0c9d-4039-81fc-3339c0e54bec'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:32:55.291307 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-6f2c0a8c-0c9d-4039-81fc-3339c0e54bec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0931cd4d96e43af8f6f24f5fec64342', 'request_id': 'req-6f2c0a8c-0c9d-4039-81fc-3339c0e54bec'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:32:55.304381 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-6f2c0a8c-0c9d-4039-81fc-3339c0e54bec admin admin] The token cache is being invalidate because project a0931cd4d96e43af8f6f24f5fec64342 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:32:55.304676 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-6f2c0a8c-0c9d-4039-81fc-3339c0e54bec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:32:55.305365 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-6f2c0a8c-0c9d-4039-81fc-3339c0e54bec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:32:55.306977 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1196/2407] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:32:54 2022] DELETE /identity/v3/projects/a0931cd4d96e43af8f6f24f5fec64342 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:32:55.462427 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:56.101242 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:57.549901 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c52402-c1e0-4d96-a518-d1e02009ed21 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:57.550488 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c52402-c1e0-4d96-a518-d1e02009ed21 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:57.550667 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c52402-c1e0-4d96-a518-d1e02009ed21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:57.600015 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-a1c52402-c1e0-4d96-a518-d1e02009ed21 None None] MFA Rules not processed for user `ec615a366b004bbba3128c6f18cdaac4`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:32:57.601778 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-a1c52402-c1e0-4d96-a518-d1e02009ed21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:32:57.685543 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1212/2408] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:32:57 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:32:57.698397 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2c0a8c-0c9d-4039-81fc-3339c0e54bec admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:32:57.699989 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-6f2c0a8c-0c9d-4039-81fc-3339c0e54bec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:32:57.793619 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2c0a8c-0c9d-4039-81fc-3339c0e54bec admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:32:57.799508 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9bb9ef-e77c-4f35-916e-ed4509008f8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb13ad6d8b1e46029262556bff398796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:32:57.800200 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9bb9ef-e77c-4f35-916e-ed4509008f8d service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:57.800536 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9bb9ef-e77c-4f35-916e-ed4509008f8d service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:57.800852 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9bb9ef-e77c-4f35-916e-ed4509008f8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:57.803336 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-3c9bb9ef-e77c-4f35-916e-ed4509008f8d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:32:57.916371 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9bb9ef-e77c-4f35-916e-ed4509008f8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:32:57.918013 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9bb9ef-e77c-4f35-916e-ed4509008f8d service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:32:57.931104 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1197/2409] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:32:57 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 16:32:58.288568 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ff748-b688-4f84-969d-57845d60bed3 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:58.289283 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ff748-b688-4f84-969d-57845d60bed3 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:58.290068 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ff748-b688-4f84-969d-57845d60bed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:58.316602 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-5d3ff748-b688-4f84-969d-57845d60bed3 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:32:58.318902 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-5d3ff748-b688-4f84-969d-57845d60bed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:32:58.372798 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:58.409317 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1213/2410] 10.222.0.79 () {58 vars in 1016 bytes} [Fri May 27 16:32:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:32:58.437524 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9bb9ef-e77c-4f35-916e-ed4509008f8d service nova] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:32:58.439731 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-3c9bb9ef-e77c-4f35-916e-ed4509008f8d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:32:58.480490 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9bb9ef-e77c-4f35-916e-ed4509008f8d service nova] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:32:58.490571 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb587e-beae-4e55-8820-78cf0e8e7005 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb13ad6d8b1e46029262556bff398796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:32:58.491373 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb587e-beae-4e55-8820-78cf0e8e7005 service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:58.491773 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb587e-beae-4e55-8820-78cf0e8e7005 service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:58.492155 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb587e-beae-4e55-8820-78cf0e8e7005 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:58.518826 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cb587e-beae-4e55-8820-78cf0e8e7005 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:32:58.526159 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cb587e-beae-4e55-8820-78cf0e8e7005 service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:32:58.559335 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1198/2411] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:32:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:32:58.898093 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=81,keystone:DELETE=14,keystone:INSERT=5 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:33:01.476144 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:33:02.061977 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:33:02.139881 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e5668-596f-4bbd-b3df-ec45a70e373c None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:33:02.140213 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e5668-596f-4bbd-b3df-ec45a70e373c None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:33:02.140672 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e5668-596f-4bbd-b3df-ec45a70e373c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:33:02.227128 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c6c20-9dc3-4885-b0f4-0997150bc365 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:33:02.227454 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c6c20-9dc3-4885-b0f4-0997150bc365 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:33:02.227937 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c6c20-9dc3-4885-b0f4-0997150bc365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:33:02.279855 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-907e5668-596f-4bbd-b3df-ec45a70e373c None None] MFA Rules not processed for user `eb50bf5f39b04ab689b55f46d3dd2640`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:33:02.281179 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-907e5668-596f-4bbd-b3df-ec45a70e373c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:33:02.287737 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-7e9c6c20-9dc3-4885-b0f4-0997150bc365 None None] MFA Rules not processed for user `20c8836936334236b2f889c0d322ffb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:33:02.290944 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-7e9c6c20-9dc3-4885-b0f4-0997150bc365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:33:02.320671 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1199/2412] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:33:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:33:02.496778 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1214/2413] 10.222.0.62 () {58 vars in 1009 bytes} [Fri May 27 16:33:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:33:02.562225 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9c6c20-9dc3-4885-b0f4-0997150bc365 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:33:02.569662 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-7e9c6c20-9dc3-4885-b0f4-0997150bc365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:33:02.809298 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9c6c20-9dc3-4885-b0f4-0997150bc365 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:33:02.827613 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b44a15-54b2-4186-b595-e9c3fc8d176a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8e6ec55445045fcac5623b9b6ffa9ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:33:02.828500 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b44a15-54b2-4186-b595-e9c3fc8d176a service swift] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:33:02.828964 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b44a15-54b2-4186-b595-e9c3fc8d176a service swift] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:33:02.829390 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b44a15-54b2-4186-b595-e9c3fc8d176a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:33:02.845745 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b44a15-54b2-4186-b595-e9c3fc8d176a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:33:02.852250 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b44a15-54b2-4186-b595-e9c3fc8d176a service swift] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:33:02.884804 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1200/2414] 10.222.0.62 () {60 vars in 1384 bytes} [Fri May 27 16:33:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 16:33:03.483252 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:33:04.063092 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:33:04.920494 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b71ab-fffe-44ca-8197-9ad926f06f2f None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:33:04.920801 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b71ab-fffe-44ca-8197-9ad926f06f2f None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:33:04.921094 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b71ab-fffe-44ca-8197-9ad926f06f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:33:04.989511 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-aa5b71ab-fffe-44ca-8197-9ad926f06f2f None None] MFA Rules not processed for user `4203b914b8bd40249d70dc77fb7c56f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:33:04.989511 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-aa5b71ab-fffe-44ca-8197-9ad926f06f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:33:05.119935 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1215/2415] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:33:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:33:05.126720 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b44a15-54b2-4186-b595-e9c3fc8d176a service swift] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:33:05.130030 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-a0b44a15-54b2-4186-b595-e9c3fc8d176a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:33:05.148713 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b44a15-54b2-4186-b595-e9c3fc8d176a service swift] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:33:05.155029 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a86ebf5-9a71-4e83-b301-8139fc280555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:33:05.155708 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86ebf5-9a71-4e83-b301-8139fc280555 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:33:05.157098 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86ebf5-9a71-4e83-b301-8139fc280555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:33:05.157436 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86ebf5-9a71-4e83-b301-8139fc280555 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:33:05.158514 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a86ebf5-9a71-4e83-b301-8139fc280555 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:33:05.171346 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a86ebf5-9a71-4e83-b301-8139fc280555 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:33:05.201311 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f91dd-d429-4be5-adfc-75ad08881c5e None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:33:05.201611 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f91dd-d429-4be5-adfc-75ad08881c5e None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:33:05.202518 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f91dd-d429-4be5-adfc-75ad08881c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:33:05.243369 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-231f91dd-d429-4be5-adfc-75ad08881c5e None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:33:05.243369 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-231f91dd-d429-4be5-adfc-75ad08881c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:33:05.258565 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1216/2416] 10.222.0.79 () {58 vars in 1016 bytes} [Fri May 27 16:33:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:33:05.280317 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1201/2417] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:33:05 2022] POST /identity/v3/projects => generated 381 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:33:05.293159 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231f91dd-d429-4be5-adfc-75ad08881c5e None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:33:05.294910 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a86ebf5-9a71-4e83-b301-8139fc280555 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:33:05.328189 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231f91dd-d429-4be5-adfc-75ad08881c5e None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:33:05.437851 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a86ebf5-9a71-4e83-b301-8139fc280555 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:33:05.446456 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f25e662-4680-4d30-a5f6-72636e157f02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb13ad6d8b1e46029262556bff398796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:33:05.447299 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f25e662-4680-4d30-a5f6-72636e157f02 service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:33:05.447727 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f25e662-4680-4d30-a5f6-72636e157f02 service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:33:05.448143 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f25e662-4680-4d30-a5f6-72636e157f02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:33:05.498880 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e428d-940a-4f5e-b8f5-51b28a5268c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:33:05.499486 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e428d-940a-4f5e-b8f5-51b28a5268c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:33:05.499775 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e428d-940a-4f5e-b8f5-51b28a5268c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:33:05.500050 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e428d-940a-4f5e-b8f5-51b28a5268c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:33:05.500749 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162e428d-940a-4f5e-b8f5-51b28a5268c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:33:05.502832 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162e428d-940a-4f5e-b8f5-51b28a5268c6 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:33:05.532894 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f25e662-4680-4d30-a5f6-72636e157f02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:33:05.534928 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f25e662-4680-4d30-a5f6-72636e157f02 service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:33:05.564428 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1202/2418] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:33:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:33:05.635074 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f25e662-4680-4d30-a5f6-72636e157f02 service nova] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:33:05.644089 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1217/2419] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:33:05 2022] POST /identity/v3/users => generated 297 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:33:05.648154 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f25e662-4680-4d30-a5f6-72636e157f02 service nova] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:33:05.656372 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2166b3-37ed-498f-8f6f-602e222e4fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:33:05.657214 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2166b3-37ed-498f-8f6f-602e222e4fa3 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:33:05.657604 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2166b3-37ed-498f-8f6f-602e222e4fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:33:05.661489 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2166b3-37ed-498f-8f6f-602e222e4fa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:33:05.661489 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2166b3-37ed-498f-8f6f-602e222e4fa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:33:05.664858 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2166b3-37ed-498f-8f6f-602e222e4fa3 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:33:05.677960 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1203/2420] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:33:05 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:33:05.683979 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e428d-940a-4f5e-b8f5-51b28a5268c6 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:33:05.699573 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e428d-940a-4f5e-b8f5-51b28a5268c6 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:33:05.710430 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb809667-4dc0-4f39-afe7-c91d3cd58b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:33:05.711348 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb809667-4dc0-4f39-afe7-c91d3cd58b1d admin admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:33:05.711637 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb809667-4dc0-4f39-afe7-c91d3cd58b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:33:05.711918 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb809667-4dc0-4f39-afe7-c91d3cd58b1d admin admin] PATH_INFO: `/v3/projects/588ffca2fc234f978ed9c7a49380a3a3/users/9c61e98233b54b87b35317dda4d78510/roles/e04fe3eb1f714d74901ac83e33ea8a16` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:33:05.736708 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb809667-4dc0-4f39-afe7-c91d3cd58b1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=588ffca2fc234f978ed9c7a49380a3a3, user_id=9c61e98233b54b87b35317dda4d78510, role_id=e04fe3eb1f714d74901ac83e33ea8a16)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:33:05.739650 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb809667-4dc0-4f39-afe7-c91d3cd58b1d admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:33:05.860224 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2166b3-37ed-498f-8f6f-602e222e4fa3 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:33:05.871989 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1218/2421] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:33:05 2022] PUT /identity/v3/projects/588ffca2fc234f978ed9c7a49380a3a3/users/9c61e98233b54b87b35317dda4d78510/roles/e04fe3eb1f714d74901ac83e33ea8a16 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:33:05.877287 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2166b3-37ed-498f-8f6f-602e222e4fa3 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:33:05.948754 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c87c7e-30b4-4a70-ab7a-cc9c2c04fd3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:33:05.949484 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c87c7e-30b4-4a70-ab7a-cc9c2c04fd3b admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:33:05.949815 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c87c7e-30b4-4a70-ab7a-cc9c2c04fd3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:33:05.950126 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c87c7e-30b4-4a70-ab7a-cc9c2c04fd3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:33:05.950929 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c87c7e-30b4-4a70-ab7a-cc9c2c04fd3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:33:05.952749 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c87c7e-30b4-4a70-ab7a-cc9c2c04fd3b admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:33:05.969980 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb809667-4dc0-4f39-afe7-c91d3cd58b1d admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:33:05.981453 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb809667-4dc0-4f39-afe7-c91d3cd58b1d admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:33:05.982960 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1204/2422] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:33:05 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:33:05.988879 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162425e9-8443-4006-a039-3d6ffcb21790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:33:05.990349 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162425e9-8443-4006-a039-3d6ffcb21790 admin admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:33:05.990632 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162425e9-8443-4006-a039-3d6ffcb21790 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:33:05.991075 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162425e9-8443-4006-a039-3d6ffcb21790 admin admin] PATH_INFO: `/v3/projects/588ffca2fc234f978ed9c7a49380a3a3/users/9c61e98233b54b87b35317dda4d78510/roles/e04fe3eb1f714d74901ac83e33ea8a16` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:33:05.993583 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162425e9-8443-4006-a039-3d6ffcb21790 admin admin] RBAC: Authorizing `identity:create_grant(project_id=588ffca2fc234f978ed9c7a49380a3a3, user_id=9c61e98233b54b87b35317dda4d78510, role_id=e04fe3eb1f714d74901ac83e33ea8a16)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:33:05.998137 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162425e9-8443-4006-a039-3d6ffcb21790 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:33:06.012604 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1219/2423] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:33:05 2022] PUT /identity/v3/projects/588ffca2fc234f978ed9c7a49380a3a3/users/9c61e98233b54b87b35317dda4d78510/roles/e04fe3eb1f714d74901ac83e33ea8a16 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:33:06.354844 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:33:06.763976 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:33:08.842275 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:33:09.364039 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:33:09.999176 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:33:10.155323 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:33:10.537983 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026022d3-3dda-4ef6-83e4-a9858430fead None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:33:10.537983 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026022d3-3dda-4ef6-83e4-a9858430fead None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:33:10.537983 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026022d3-3dda-4ef6-83e4-a9858430fead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:33:10.578313 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-026022d3-3dda-4ef6-83e4-a9858430fead None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:33:10.591654 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-026022d3-3dda-4ef6-83e4-a9858430fead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:33:10.705046 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1205/2424] 10.222.0.79 () {58 vars in 1016 bytes} [Fri May 27 16:33:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:33:10.729288 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162425e9-8443-4006-a039-3d6ffcb21790 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:33:10.786548 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:33:10.866891 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162425e9-8443-4006-a039-3d6ffcb21790 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:33:10.880039 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a51479-6be9-4a96-a634-2a52438105e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb13ad6d8b1e46029262556bff398796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:33:10.881082 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a51479-6be9-4a96-a634-2a52438105e1 service nova] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:33:10.881266 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a51479-6be9-4a96-a634-2a52438105e1 service nova] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:33:10.881554 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a51479-6be9-4a96-a634-2a52438105e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:33:10.899195 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a51479-6be9-4a96-a634-2a52438105e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:33:10.901166 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a51479-6be9-4a96-a634-2a52438105e1 service nova] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:33:10.921425 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1220/2425] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:33:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:33:11.411377 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:33:11.846839 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:33:11.948596 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:33:13.792667 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:33:13.906901 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:33:15.668907 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:33:15.828555 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:DELETE=6,keystone:SELECT=88,keystone:INSERT=6 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:33:16.019042 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a3a61-caf7-427f-9dbb-71b5836b2e0f None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:33:16.019327 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a3a61-caf7-427f-9dbb-71b5836b2e0f None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:33:16.022400 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a3a61-caf7-427f-9dbb-71b5836b2e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:33:16.055449 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-579a3a61-caf7-427f-9dbb-71b5836b2e0f None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:33:16.056981 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-579a3a61-caf7-427f-9dbb-71b5836b2e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:33:16.071734 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1206/2426] 10.222.0.79 () {58 vars in 1016 bytes} [Fri May 27 16:33:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:33:16.097218 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a51479-6be9-4a96-a634-2a52438105e1 service nova] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:33:16.110573 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a51479-6be9-4a96-a634-2a52438105e1 service nova] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:33:16.137251 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849ae2aa-a737-4293-8504-f40199beff6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb13ad6d8b1e46029262556bff398796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:33:16.137925 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ae2aa-a737-4293-8504-f40199beff6b service nova] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:33:16.138217 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ae2aa-a737-4293-8504-f40199beff6b service nova] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:33:16.138535 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ae2aa-a737-4293-8504-f40199beff6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:33:16.175077 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849ae2aa-a737-4293-8504-f40199beff6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:33:16.176722 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849ae2aa-a737-4293-8504-f40199beff6b service nova] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:33:16.215479 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1221/2427] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:33:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:33:16.521701 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa209b6-b34c-420c-8e6c-46957d08333f None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:33:16.521963 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa209b6-b34c-420c-8e6c-46957d08333f None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:33:16.522309 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa209b6-b34c-420c-8e6c-46957d08333f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:33:16.572023 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-cfa209b6-b34c-420c-8e6c-46957d08333f None None] MFA Rules not processed for user `9c61e98233b54b87b35317dda4d78510`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:33:16.573453 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-cfa209b6-b34c-420c-8e6c-46957d08333f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:33:16.652161 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:33:16.724933 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:33:16.742305 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1207/2428] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:33:16 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:33:16.755765 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849ae2aa-a737-4293-8504-f40199beff6b service nova] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:33:16.757205 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-849ae2aa-a737-4293-8504-f40199beff6b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:33:16.913313 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849ae2aa-a737-4293-8504-f40199beff6b service nova] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:33:16.919977 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c4d00-6d5a-438b-ac2f-eb47e79b73bb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b072079733049e8ac204ebe5cc635ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:33:16.919977 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c4d00-6d5a-438b-ac2f-eb47e79b73bb service glance] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:33:16.919977 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c4d00-6d5a-438b-ac2f-eb47e79b73bb service glance] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:33:16.920353 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c4d00-6d5a-438b-ac2f-eb47e79b73bb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:33:17.011875 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723c4d00-6d5a-438b-ac2f-eb47e79b73bb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:33:17.013716 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723c4d00-6d5a-438b-ac2f-eb47e79b73bb service glance] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:33:17.027258 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1222/2429] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:33:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:33:17.395538 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e79a7-883b-47f7-8284-87eefd7b5a71 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:33:17.395981 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e79a7-883b-47f7-8284-87eefd7b5a71 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:33:17.396298 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e79a7-883b-47f7-8284-87eefd7b5a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:33:17.417004 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-a00e79a7-883b-47f7-8284-87eefd7b5a71 None None] MFA Rules not processed for user `eb50bf5f39b04ab689b55f46d3dd2640`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:33:17.419105 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-a00e79a7-883b-47f7-8284-87eefd7b5a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:33:17.493853 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1208/2430] 10.222.0.62 () {58 vars in 1009 bytes} [Fri May 27 16:33:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:33:17.505525 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c4d00-6d5a-438b-ac2f-eb47e79b73bb service glance] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:33:17.542775 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:33:17.571491 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:33:17.604127 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c4d00-6d5a-438b-ac2f-eb47e79b73bb service glance] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:33:17.611907 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84138ff-f0ee-40c1-bb95-95267baf4efb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8e6ec55445045fcac5623b9b6ffa9ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:33:17.613152 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84138ff-f0ee-40c1-bb95-95267baf4efb service swift] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:33:17.613837 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84138ff-f0ee-40c1-bb95-95267baf4efb service swift] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:33:17.614857 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84138ff-f0ee-40c1-bb95-95267baf4efb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:33:17.630703 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84138ff-f0ee-40c1-bb95-95267baf4efb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:33:17.634705 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84138ff-f0ee-40c1-bb95-95267baf4efb service swift] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:33:17.647527 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1223/2431] 10.222.0.62 () {60 vars in 1384 bytes} [Fri May 27 16:33:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 16:33:18.027081 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:33:18.235352 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:33:18.714010 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:33:19.010516 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:33:20.874239 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:INSERT=5,keystone:DELETE=1,keystone:SELECT=94 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:33:21.211690 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:33:21.624915 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b7da9a-649e-445e-9c89-3b58676c76b9 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:33:21.625283 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b7da9a-649e-445e-9c89-3b58676c76b9 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:33:21.625974 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b7da9a-649e-445e-9c89-3b58676c76b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:33:21.667740 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-31b7da9a-649e-445e-9c89-3b58676c76b9 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:33:21.668974 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-31b7da9a-649e-445e-9c89-3b58676c76b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:33:21.681748 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1209/2432] 10.222.0.79 () {58 vars in 1016 bytes} [Fri May 27 16:33:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:33:21.701561 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84138ff-f0ee-40c1-bb95-95267baf4efb service swift] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:33:21.720846 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84138ff-f0ee-40c1-bb95-95267baf4efb service swift] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:33:21.727501 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6470d78-42dd-4646-9883-425259986e28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb13ad6d8b1e46029262556bff398796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:33:21.728481 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6470d78-42dd-4646-9883-425259986e28 service nova] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:33:21.729163 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6470d78-42dd-4646-9883-425259986e28 service nova] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:33:21.729659 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6470d78-42dd-4646-9883-425259986e28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:33:21.741603 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6470d78-42dd-4646-9883-425259986e28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:33:21.746294 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6470d78-42dd-4646-9883-425259986e28 service nova] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:33:21.757496 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1224/2433] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:33:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 16:33:22.798193 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:33:22.857096 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:33:23.074219 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:33:23.131568 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:33:23.234200 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:33:23.612012 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:33:23.634021 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:33:23.806498 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:33:23.849620 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:33:24.204183 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:33:24.241000 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:33:24.394176 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:33:24.417186 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:33:24.565211 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:33:24.598893 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:33:24.742644 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:33:24.782870 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:33:24.885892 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b7da9a-649e-445e-9c89-3b58676c76b9 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:33:24.888285 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-31b7da9a-649e-445e-9c89-3b58676c76b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:33:24.897117 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:33:25.007376 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:33:25.095633 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b7da9a-649e-445e-9c89-3b58676c76b9 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:33:25.103158 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c5cb15-b1eb-4e22-831e-4a7898518a6c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35d98c4a2af546d8b655d649d655f447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:33:25.103883 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5cb15-b1eb-4e22-831e-4a7898518a6c service placement] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:33:25.105084 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5cb15-b1eb-4e22-831e-4a7898518a6c service placement] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:33:25.105375 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5cb15-b1eb-4e22-831e-4a7898518a6c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:33:25.107542 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-51c5cb15-b1eb-4e22-831e-4a7898518a6c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:33:25.124119 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c5cb15-b1eb-4e22-831e-4a7898518a6c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:33:25.126718 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c5cb15-b1eb-4e22-831e-4a7898518a6c service placement] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:33:25.143670 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1210/2434] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:33:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:33:25.474665 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:33:26.337215 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:33:26.760319 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:33:26.920691 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:33:26.999277 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:33:27.085707 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:33:27.142801 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:33:28.922063 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2296e9d0-84c8-4128-8f68-434768e8aae7 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:33:28.928780 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2296e9d0-84c8-4128-8f68-434768e8aae7 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:33:28.928780 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2296e9d0-84c8-4128-8f68-434768e8aae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:33:28.961210 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-2296e9d0-84c8-4128-8f68-434768e8aae7 None None] MFA Rules not processed for user `d2aced0927994e97bac1ce1a63f4a911`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:33:28.962932 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-2296e9d0-84c8-4128-8f68-434768e8aae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:33:29.043637 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1225/2435] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:33:28 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:33:31.657963 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ffdcc-6d35-428b-93ec-9a08de563dd3 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:33:31.659424 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ffdcc-6d35-428b-93ec-9a08de563dd3 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:33:31.660107 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ffdcc-6d35-428b-93ec-9a08de563dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:33:31.683129 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-e81ffdcc-6d35-428b-93ec-9a08de563dd3 None None] MFA Rules not processed for user `4203b914b8bd40249d70dc77fb7c56f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:33:31.685157 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-e81ffdcc-6d35-428b-93ec-9a08de563dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:33:31.699369 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1211/2436] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:33:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:33:32.284184 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6202d706-8382-4e42-907c-56d65038ea03 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:33:32.284896 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6202d706-8382-4e42-907c-56d65038ea03 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:33:32.285028 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6202d706-8382-4e42-907c-56d65038ea03 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:33:32.287819 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1226/2437] 10.222.0.62 () {54 vars in 921 bytes} [Fri May 27 16:33:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:33:32.294840 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0fa4e1-3206-4691-8cc2-0eb214ec3abb None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:33:32.298913 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0fa4e1-3206-4691-8cc2-0eb214ec3abb None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:33:32.298913 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0fa4e1-3206-4691-8cc2-0eb214ec3abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:33:32.340346 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-3e0fa4e1-3206-4691-8cc2-0eb214ec3abb None None] MFA Rules not processed for user `cb13ad6d8b1e46029262556bff398796`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:33:32.342047 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-3e0fa4e1-3206-4691-8cc2-0eb214ec3abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:33:32.357206 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1212/2438] 10.222.0.62 () {58 vars in 1018 bytes} [Fri May 27 16:33:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:33:32.381977 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6202d706-8382-4e42-907c-56d65038ea03 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:33:32.383905 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-6202d706-8382-4e42-907c-56d65038ea03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:33:32.398214 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6202d706-8382-4e42-907c-56d65038ea03 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:33:32.402502 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc7b7a8-3a4a-40bd-afb2-e09188d1de2a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b072079733049e8ac204ebe5cc635ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:33:32.402645 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc7b7a8-3a4a-40bd-afb2-e09188d1de2a service glance] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:33:32.402937 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc7b7a8-3a4a-40bd-afb2-e09188d1de2a service glance] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:33:32.403214 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc7b7a8-3a4a-40bd-afb2-e09188d1de2a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:33:32.414900 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc7b7a8-3a4a-40bd-afb2-e09188d1de2a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:33:32.416516 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc7b7a8-3a4a-40bd-afb2-e09188d1de2a service glance] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:33:32.429044 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1227/2439] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:33:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:33:32.635667 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985d506-cabc-4e94-9639-c45c8a121204 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:33:32.641032 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985d506-cabc-4e94-9639-c45c8a121204 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:33:32.641032 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985d506-cabc-4e94-9639-c45c8a121204 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:33:32.641032 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1213/2440] 10.222.0.62 () {54 vars in 921 bytes} [Fri May 27 16:33:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:33:32.642740 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b48cda3-3045-435f-97e5-80ca4861b16c None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:33:32.643042 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b48cda3-3045-435f-97e5-80ca4861b16c None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:33:32.643329 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b48cda3-3045-435f-97e5-80ca4861b16c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:33:32.662787 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-1b48cda3-3045-435f-97e5-80ca4861b16c None None] MFA Rules not processed for user `b367ccea28d540a0b24ec4e42ebfef65`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:33:32.664068 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-1b48cda3-3045-435f-97e5-80ca4861b16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:33:32.718352 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1228/2441] 10.222.0.62 () {58 vars in 1018 bytes} [Fri May 27 16:33:32 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:33:32.730373 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9985d506-cabc-4e94-9639-c45c8a121204 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:33:32.732189 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-9985d506-cabc-4e94-9639-c45c8a121204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:33:32.745857 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9985d506-cabc-4e94-9639-c45c8a121204 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:33:32.749403 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3797d9d-6bd8-431c-8a2d-b68005af480d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:33:32.750068 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3797d9d-6bd8-431c-8a2d-b68005af480d service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:33:32.750424 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3797d9d-6bd8-431c-8a2d-b68005af480d service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:33:32.750742 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3797d9d-6bd8-431c-8a2d-b68005af480d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:33:32.759418 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3797d9d-6bd8-431c-8a2d-b68005af480d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:33:32.760996 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3797d9d-6bd8-431c-8a2d-b68005af480d service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:33:32.769478 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1214/2442] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:33:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 16:33:32.867306 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f018a0-0425-4833-ab23-6497c2675baa None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:33:32.867604 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f018a0-0425-4833-ab23-6497c2675baa None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:33:32.868066 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f018a0-0425-4833-ab23-6497c2675baa None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:33:32.869897 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1229/2443] 10.222.0.62 () {54 vars in 921 bytes} [Fri May 27 16:33:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:33:32.875754 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2bfb4-abca-4e30-8f68-95884597a52d None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:33:32.876094 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2bfb4-abca-4e30-8f68-95884597a52d None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:33:32.877194 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2bfb4-abca-4e30-8f68-95884597a52d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:33:32.898365 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-44d2bfb4-abca-4e30-8f68-95884597a52d None None] MFA Rules not processed for user `cb13ad6d8b1e46029262556bff398796`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:33:32.899831 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-44d2bfb4-abca-4e30-8f68-95884597a52d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:33:32.910527 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1215/2444] 10.222.0.62 () {58 vars in 1018 bytes} [Fri May 27 16:33:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:33:32.923133 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f018a0-0425-4833-ab23-6497c2675baa None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:33:32.956403 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f018a0-0425-4833-ab23-6497c2675baa None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:33:32.960386 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044c2bb3-49fa-46a7-80f4-bbe76bf744e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:33:32.961096 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c2bb3-49fa-46a7-80f4-bbe76bf744e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:33:32.961390 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c2bb3-49fa-46a7-80f4-bbe76bf744e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:33:32.961672 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c2bb3-49fa-46a7-80f4-bbe76bf744e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:33:32.994945 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044c2bb3-49fa-46a7-80f4-bbe76bf744e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:33:32.996793 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044c2bb3-49fa-46a7-80f4-bbe76bf744e4 service neutron] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:33:33.015009 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1230/2445] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:33:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:33:40.866555 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a9db5-89c5-4c1d-9171-00e740d6d8f0 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:33:40.867666 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a9db5-89c5-4c1d-9171-00e740d6d8f0 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:33:40.868161 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a9db5-89c5-4c1d-9171-00e740d6d8f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:33:40.890069 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-bb0a9db5-89c5-4c1d-9171-00e740d6d8f0 None None] MFA Rules not processed for user `eb50bf5f39b04ab689b55f46d3dd2640`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:33:40.891463 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-bb0a9db5-89c5-4c1d-9171-00e740d6d8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:33:40.901908 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1216/2446] 10.222.0.62 () {58 vars in 1009 bytes} [Fri May 27 16:33:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:33:40.916594 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044c2bb3-49fa-46a7-80f4-bbe76bf744e4 service neutron] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:33:40.928253 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044c2bb3-49fa-46a7-80f4-bbe76bf744e4 service neutron] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:33:40.933655 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a7ba2-c2e9-4f4f-a566-21e73358154a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8e6ec55445045fcac5623b9b6ffa9ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:33:40.934331 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a7ba2-c2e9-4f4f-a566-21e73358154a service swift] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:33:40.934700 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a7ba2-c2e9-4f4f-a566-21e73358154a service swift] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:33:40.934989 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a7ba2-c2e9-4f4f-a566-21e73358154a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:33:40.945607 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a7ba2-c2e9-4f4f-a566-21e73358154a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:33:40.947250 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a7ba2-c2e9-4f4f-a566-21e73358154a service swift] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:33:40.951004 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:33:40.957218 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1231/2447] 10.222.0.62 () {60 vars in 1384 bytes} [Fri May 27 16:33:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 16:33:50.884562 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=42 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:33:51.038734 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:33:54.720124 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6671124-1b43-4108-ba1c-65a50472659c None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:33:54.722356 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6671124-1b43-4108-ba1c-65a50472659c None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:33:54.723225 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6671124-1b43-4108-ba1c-65a50472659c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:33:54.748037 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-a6671124-1b43-4108-ba1c-65a50472659c None None] MFA Rules not processed for user `eb50bf5f39b04ab689b55f46d3dd2640`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:33:54.749500 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-a6671124-1b43-4108-ba1c-65a50472659c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:33:54.766662 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1217/2448] 10.222.0.62 () {58 vars in 1009 bytes} [Fri May 27 16:33:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:33:54.774513 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a7ba2-c2e9-4f4f-a566-21e73358154a service swift] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:33:54.785519 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a7ba2-c2e9-4f4f-a566-21e73358154a service swift] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:33:54.793088 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd99e364-856d-425e-b918-8e059727eed7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8e6ec55445045fcac5623b9b6ffa9ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:33:54.794083 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd99e364-856d-425e-b918-8e059727eed7 service swift] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:33:54.794507 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd99e364-856d-425e-b918-8e059727eed7 service swift] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:33:54.794888 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd99e364-856d-425e-b918-8e059727eed7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:33:54.805102 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd99e364-856d-425e-b918-8e059727eed7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:33:54.807096 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd99e364-856d-425e-b918-8e059727eed7 service swift] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:33:54.816278 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1232/2449] 10.222.0.62 () {60 vars in 1384 bytes} [Fri May 27 16:33:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 16:33:54.944797 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6671124-1b43-4108-ba1c-65a50472659c None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:33:54.972866 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6671124-1b43-4108-ba1c-65a50472659c None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:33:54.992937 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437c5cd3-b7d8-4de5-824b-4b1e8c05c9b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:33:54.993646 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c5cd3-b7d8-4de5-824b-4b1e8c05c9b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:33:54.993976 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c5cd3-b7d8-4de5-824b-4b1e8c05c9b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:33:54.994305 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c5cd3-b7d8-4de5-824b-4b1e8c05c9b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:33:55.170081 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437c5cd3-b7d8-4de5-824b-4b1e8c05c9b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:33:55.171937 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437c5cd3-b7d8-4de5-824b-4b1e8c05c9b2 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:33:55.191817 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1218/2450] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:33:54 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:33:56.695532 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ab592-ecf9-4454-b5bb-022027c768f4 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:33:56.696069 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ab592-ecf9-4454-b5bb-022027c768f4 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:33:56.696156 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ab592-ecf9-4454-b5bb-022027c768f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:33:56.734824 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-414ab592-ecf9-4454-b5bb-022027c768f4 None None] MFA Rules not processed for user `87089f81f6d44b83bb20ef3f01bca18c`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:33:56.738515 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-414ab592-ecf9-4454-b5bb-022027c768f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:33:56.855460 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1233/2451] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:33:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:34:05.184500 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=33 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:34:06.029319 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec3172a-5326-412c-8229-34b0520ccf76 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:06.030656 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec3172a-5326-412c-8229-34b0520ccf76 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:06.030656 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec3172a-5326-412c-8229-34b0520ccf76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:06.048286 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-0ec3172a-5326-412c-8229-34b0520ccf76 None None] MFA Rules not processed for user `820d152f8d5b45a2aca035e7cc2684ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:34:06.049505 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-0ec3172a-5326-412c-8229-34b0520ccf76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:06.108643 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1219/2452] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:34:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:34:06.848406 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=31 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:34:16.101532 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=25 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:34:19.125417 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154c497-7e65-4f8c-918c-0618bb0e3795 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:19.125991 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154c497-7e65-4f8c-918c-0618bb0e3795 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:19.125991 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154c497-7e65-4f8c-918c-0618bb0e3795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:19.154489 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-b154c497-7e65-4f8c-918c-0618bb0e3795 None None] MFA Rules not processed for user `eb50bf5f39b04ab689b55f46d3dd2640`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:34:19.155678 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-b154c497-7e65-4f8c-918c-0618bb0e3795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:19.164071 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1234/2453] 10.222.0.62 () {58 vars in 967 bytes} [Fri May 27 16:34:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:34:19.188181 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec3172a-5326-412c-8229-34b0520ccf76 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:19.200069 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec3172a-5326-412c-8229-34b0520ccf76 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:19.205438 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f7206a-6deb-4c99-bef9-7827a29742eb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8e6ec55445045fcac5623b9b6ffa9ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:19.206123 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f7206a-6deb-4c99-bef9-7827a29742eb service swift] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:19.206480 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f7206a-6deb-4c99-bef9-7827a29742eb service swift] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:19.206797 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f7206a-6deb-4c99-bef9-7827a29742eb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:19.219670 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f7206a-6deb-4c99-bef9-7827a29742eb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:19.219670 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f7206a-6deb-4c99-bef9-7827a29742eb service swift] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:19.226072 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1220/2454] 10.222.0.62 () {60 vars in 1384 bytes} [Fri May 27 16:34:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 16:34:23.840075 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b154c497-7e65-4f8c-918c-0618bb0e3795 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:23.841947 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-b154c497-7e65-4f8c-918c-0618bb0e3795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:23.860948 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b154c497-7e65-4f8c-918c-0618bb0e3795 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:23.867302 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0804eed-a7ec-427b-86da-d3de8ec00f5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:23.868263 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0804eed-a7ec-427b-86da-d3de8ec00f5e service neutron] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:23.868767 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0804eed-a7ec-427b-86da-d3de8ec00f5e service neutron] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:23.869322 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0804eed-a7ec-427b-86da-d3de8ec00f5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:23.881054 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0804eed-a7ec-427b-86da-d3de8ec00f5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:23.885544 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0804eed-a7ec-427b-86da-d3de8ec00f5e service neutron] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:23.902512 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1235/2455] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:34:23 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 16:34:29.053072 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d1a246-cff6-420e-a4ff-86f9f797981a None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:29.053591 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d1a246-cff6-420e-a4ff-86f9f797981a None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:29.053716 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d1a246-cff6-420e-a4ff-86f9f797981a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:29.073025 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-a1d1a246-cff6-420e-a4ff-86f9f797981a None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:34:29.077198 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-a1d1a246-cff6-420e-a4ff-86f9f797981a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:29.083316 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1221/2456] 10.222.0.79 () {58 vars in 1016 bytes} [Fri May 27 16:34:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:34:29.104513 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0804eed-a7ec-427b-86da-d3de8ec00f5e service neutron] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:29.117826 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0804eed-a7ec-427b-86da-d3de8ec00f5e service neutron] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:29.123456 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4096939d-c534-4a6e-a5ff-6a3669512461 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb13ad6d8b1e46029262556bff398796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:29.124119 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096939d-c534-4a6e-a5ff-6a3669512461 service nova] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:29.124407 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096939d-c534-4a6e-a5ff-6a3669512461 service nova] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:29.124685 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096939d-c534-4a6e-a5ff-6a3669512461 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:29.133499 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4096939d-c534-4a6e-a5ff-6a3669512461 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:29.135127 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4096939d-c534-4a6e-a5ff-6a3669512461 service nova] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:29.146457 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1236/2457] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:34:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:34:35.662781 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350851e-dcfe-4c46-934d-365e4306cf8b None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:35.663267 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350851e-dcfe-4c46-934d-365e4306cf8b None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:35.663478 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350851e-dcfe-4c46-934d-365e4306cf8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:35.681907 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-b350851e-dcfe-4c46-934d-365e4306cf8b None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:34:35.683112 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-b350851e-dcfe-4c46-934d-365e4306cf8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:35.691098 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1222/2458] 10.222.0.79 () {58 vars in 1016 bytes} [Fri May 27 16:34:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:34:35.712962 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4096939d-c534-4a6e-a5ff-6a3669512461 service nova] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:35.725113 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4096939d-c534-4a6e-a5ff-6a3669512461 service nova] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:35.731505 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791fa825-b26a-4c65-847e-7400b319bc57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb13ad6d8b1e46029262556bff398796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:35.732157 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791fa825-b26a-4c65-847e-7400b319bc57 service nova] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:35.732445 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791fa825-b26a-4c65-847e-7400b319bc57 service nova] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:35.732725 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791fa825-b26a-4c65-847e-7400b319bc57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:35.744032 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791fa825-b26a-4c65-847e-7400b319bc57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:35.745624 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791fa825-b26a-4c65-847e-7400b319bc57 service nova] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:35.755710 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1237/2459] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:34:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:34:39.525141 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ada351-4883-41b2-8f40-f64d9e17c003 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:39.525721 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ada351-4883-41b2-8f40-f64d9e17c003 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:39.525844 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ada351-4883-41b2-8f40-f64d9e17c003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:39.544830 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-55ada351-4883-41b2-8f40-f64d9e17c003 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:34:39.545268 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-55ada351-4883-41b2-8f40-f64d9e17c003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:39.553622 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1223/2460] 10.222.0.79 () {58 vars in 1016 bytes} [Fri May 27 16:34:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:34:39.577616 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791fa825-b26a-4c65-847e-7400b319bc57 service nova] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:39.589422 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791fa825-b26a-4c65-847e-7400b319bc57 service nova] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:39.594999 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4855cd-b7d8-45b0-8de3-3211462a6de9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb13ad6d8b1e46029262556bff398796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:39.595640 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4855cd-b7d8-45b0-8de3-3211462a6de9 service nova] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:39.595947 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4855cd-b7d8-45b0-8de3-3211462a6de9 service nova] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:39.596213 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4855cd-b7d8-45b0-8de3-3211462a6de9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:39.604777 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4855cd-b7d8-45b0-8de3-3211462a6de9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:39.606384 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4855cd-b7d8-45b0-8de3-3211462a6de9 service nova] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:39.615949 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1238/2461] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:34:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:34:45.832851 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c55ec-3e19-4832-9005-adde077409ef None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:45.833344 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c55ec-3e19-4832-9005-adde077409ef None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:45.833543 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c55ec-3e19-4832-9005-adde077409ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:45.869258 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-261c55ec-3e19-4832-9005-adde077409ef None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:34:45.869258 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-261c55ec-3e19-4832-9005-adde077409ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:45.869258 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1224/2462] 10.222.0.79 () {58 vars in 1016 bytes} [Fri May 27 16:34:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:34:45.890109 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4855cd-b7d8-45b0-8de3-3211462a6de9 service nova] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:45.901694 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4855cd-b7d8-45b0-8de3-3211462a6de9 service nova] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:45.907279 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3308c109-ee6b-4af7-b7e4-3af11e89b8c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb13ad6d8b1e46029262556bff398796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:45.907911 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308c109-ee6b-4af7-b7e4-3af11e89b8c2 service nova] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:45.908200 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308c109-ee6b-4af7-b7e4-3af11e89b8c2 service nova] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:45.908479 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308c109-ee6b-4af7-b7e4-3af11e89b8c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:45.917263 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3308c109-ee6b-4af7-b7e4-3af11e89b8c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:45.918871 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3308c109-ee6b-4af7-b7e4-3af11e89b8c2 service nova] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:45.928619 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1239/2463] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:34:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:34:50.104862 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c617f877-f6e9-4c3e-80cf-4c5dcddcd5db None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:50.105394 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c617f877-f6e9-4c3e-80cf-4c5dcddcd5db None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:50.105542 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c617f877-f6e9-4c3e-80cf-4c5dcddcd5db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:50.112212 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=19 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:34:50.125692 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-c617f877-f6e9-4c3e-80cf-4c5dcddcd5db None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:34:50.126944 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-c617f877-f6e9-4c3e-80cf-4c5dcddcd5db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:50.135887 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1225/2464] 10.222.0.79 () {58 vars in 1016 bytes} [Fri May 27 16:34:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:34:50.156731 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3308c109-ee6b-4af7-b7e4-3af11e89b8c2 service nova] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:50.162384 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=34 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:34:50.168420 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3308c109-ee6b-4af7-b7e4-3af11e89b8c2 service nova] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:50.174636 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0fad41-bce4-436e-a66f-8f94d8f39c82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb13ad6d8b1e46029262556bff398796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:50.174875 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0fad41-bce4-436e-a66f-8f94d8f39c82 service nova] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:50.175136 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0fad41-bce4-436e-a66f-8f94d8f39c82 service nova] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:50.175418 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0fad41-bce4-436e-a66f-8f94d8f39c82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:50.184113 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0fad41-bce4-436e-a66f-8f94d8f39c82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:50.185710 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0fad41-bce4-436e-a66f-8f94d8f39c82 service nova] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:50.196350 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1240/2465] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:34:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:34:50.530322 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c617f877-f6e9-4c3e-80cf-4c5dcddcd5db None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:50.531831 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-c617f877-f6e9-4c3e-80cf-4c5dcddcd5db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:50.544728 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c617f877-f6e9-4c3e-80cf-4c5dcddcd5db None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:50.549246 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc542d44-ed06-45c9-a241-a4ada150eeb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:50.550158 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc542d44-ed06-45c9-a241-a4ada150eeb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:50.550513 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc542d44-ed06-45c9-a241-a4ada150eeb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:50.550810 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc542d44-ed06-45c9-a241-a4ada150eeb0 admin admin] PATH_INFO: `/v3/users/d2aced0927994e97bac1ce1a63f4a911` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:50.552001 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc542d44-ed06-45c9-a241-a4ada150eeb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2aced0927994e97bac1ce1a63f4a911)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:50.553970 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc542d44-ed06-45c9-a241-a4ada150eeb0 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:50.760506 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-bc542d44-ed06-45c9-a241-a4ada150eeb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2aced0927994e97bac1ce1a63f4a911'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:34:50.767587 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-bc542d44-ed06-45c9-a241-a4ada150eeb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2aced0927994e97bac1ce1a63f4a911'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:34:50.768249 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-bc542d44-ed06-45c9-a241-a4ada150eeb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2aced0927994e97bac1ce1a63f4a911'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:34:50.768853 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-bc542d44-ed06-45c9-a241-a4ada150eeb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2aced0927994e97bac1ce1a63f4a911'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:34:50.859898 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-bc542d44-ed06-45c9-a241-a4ada150eeb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2aced0927994e97bac1ce1a63f4a911'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:34:50.880204 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1226/2466] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:34:50 2022] DELETE /identity/v3/users/d2aced0927994e97bac1ce1a63f4a911 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:34:51.204855 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0fad41-bce4-436e-a66f-8f94d8f39c82 service nova] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:51.216713 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0fad41-bce4-436e-a66f-8f94d8f39c82 service nova] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:51.285084 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cdbda1-c15d-4e01-bd8f-7c3b94ff84a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:51.286262 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cdbda1-c15d-4e01-bd8f-7c3b94ff84a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:51.286616 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cdbda1-c15d-4e01-bd8f-7c3b94ff84a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:51.286957 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cdbda1-c15d-4e01-bd8f-7c3b94ff84a4 admin admin] PATH_INFO: `/v3/projects/ae9096e313b84244a4d719822eb82a1d` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:51.288211 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cdbda1-c15d-4e01-bd8f-7c3b94ff84a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae9096e313b84244a4d719822eb82a1d)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:51.290121 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cdbda1-c15d-4e01-bd8f-7c3b94ff84a4 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:51.437790 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-26cdbda1-c15d-4e01-bd8f-7c3b94ff84a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae9096e313b84244a4d719822eb82a1d', 'request_id': 'req-26cdbda1-c15d-4e01-bd8f-7c3b94ff84a4'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:34:51.444097 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-26cdbda1-c15d-4e01-bd8f-7c3b94ff84a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae9096e313b84244a4d719822eb82a1d', 'request_id': 'req-26cdbda1-c15d-4e01-bd8f-7c3b94ff84a4'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:34:51.450177 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-26cdbda1-c15d-4e01-bd8f-7c3b94ff84a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae9096e313b84244a4d719822eb82a1d', 'request_id': 'req-26cdbda1-c15d-4e01-bd8f-7c3b94ff84a4'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:34:51.540000 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-26cdbda1-c15d-4e01-bd8f-7c3b94ff84a4 admin admin] The token cache is being invalidate because project ae9096e313b84244a4d719822eb82a1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80288) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:34:51.540236 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-26cdbda1-c15d-4e01-bd8f-7c3b94ff84a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:34:51.540859 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-26cdbda1-c15d-4e01-bd8f-7c3b94ff84a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:34:51.542503 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1241/2467] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:34:51 2022] DELETE /identity/v3/projects/ae9096e313b84244a4d719822eb82a1d => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:34:51.547516 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef77f5d-ff92-4bf3-8eb4-46ddc796add3 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:51.547966 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef77f5d-ff92-4bf3-8eb4-46ddc796add3 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:51.548200 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef77f5d-ff92-4bf3-8eb4-46ddc796add3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:51.566903 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-8ef77f5d-ff92-4bf3-8eb4-46ddc796add3 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:34:51.568184 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-8ef77f5d-ff92-4bf3-8eb4-46ddc796add3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:51.628253 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1227/2468] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:34:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:34:51.636694 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2f48e1-24a0-46fc-8780-6c70305b3809 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:51.637004 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2f48e1-24a0-46fc-8780-6c70305b3809 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:51.637276 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2f48e1-24a0-46fc-8780-6c70305b3809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:51.665788 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-fd2f48e1-24a0-46fc-8780-6c70305b3809 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:34:51.668400 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-fd2f48e1-24a0-46fc-8780-6c70305b3809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:51.682957 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1242/2469] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:34:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:34:51.686628 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef77f5d-ff92-4bf3-8eb4-46ddc796add3 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:51.696849 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef77f5d-ff92-4bf3-8eb4-46ddc796add3 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:51.701497 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8469100e-0d8c-4260-9e0c-221f60e16a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:51.702180 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469100e-0d8c-4260-9e0c-221f60e16a9a admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:51.702649 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469100e-0d8c-4260-9e0c-221f60e16a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:51.702970 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469100e-0d8c-4260-9e0c-221f60e16a9a admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:51.703732 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8469100e-0d8c-4260-9e0c-221f60e16a9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:34:51.704067 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8469100e-0d8c-4260-9e0c-221f60e16a9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:51.705713 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8469100e-0d8c-4260-9e0c-221f60e16a9a admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:51.717481 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1228/2470] 10.222.0.62 () {58 vars in 1152 bytes} [Fri May 27 16:34:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:34:51.722929 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2f48e1-24a0-46fc-8780-6c70305b3809 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:51.734701 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2f48e1-24a0-46fc-8780-6c70305b3809 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:51.740270 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1669198c-e176-46e5-a5c6-91c99330301c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:51.740923 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1669198c-e176-46e5-a5c6-91c99330301c admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:51.741734 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1669198c-e176-46e5-a5c6-91c99330301c admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:51.742016 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1669198c-e176-46e5-a5c6-91c99330301c admin admin] PATH_INFO: `/v3/projects` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:51.742747 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1669198c-e176-46e5-a5c6-91c99330301c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:51.744653 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1669198c-e176-46e5-a5c6-91c99330301c admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:51.841432 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1243/2471] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:34:51 2022] POST /identity/v3/projects => generated 367 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:34:51.847332 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8469100e-0d8c-4260-9e0c-221f60e16a9a admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:51.853421 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8469100e-0d8c-4260-9e0c-221f60e16a9a admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:51.903842 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:34:51.910278 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8064c3fb-fe24-424e-879b-495bd8e8c470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:51.910992 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8064c3fb-fe24-424e-879b-495bd8e8c470 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:51.911316 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8064c3fb-fe24-424e-879b-495bd8e8c470 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:51.911630 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8064c3fb-fe24-424e-879b-495bd8e8c470 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:51.912338 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8064c3fb-fe24-424e-879b-495bd8e8c470 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:51.914954 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8064c3fb-fe24-424e-879b-495bd8e8c470 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:52.021284 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1229/2472] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:34:51 2022] POST /identity/v3/users => generated 284 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:34:52.034201 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1669198c-e176-46e5-a5c6-91c99330301c admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:52.045434 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1669198c-e176-46e5-a5c6-91c99330301c admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:52.050038 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5c961c-aace-4b83-845b-8ba4657d78c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:52.050731 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c961c-aace-4b83-845b-8ba4657d78c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:52.051020 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c961c-aace-4b83-845b-8ba4657d78c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:52.051294 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c961c-aace-4b83-845b-8ba4657d78c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:52.052012 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5c961c-aace-4b83-845b-8ba4657d78c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:52.053599 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5c961c-aace-4b83-845b-8ba4657d78c2 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:52.064428 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1244/2473] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:34:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:34:52.072938 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8064c3fb-fe24-424e-879b-495bd8e8c470 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:52.083169 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8064c3fb-fe24-424e-879b-495bd8e8c470 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:52.088434 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cae41e-41bf-42ed-89cd-c7174eccc81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:52.089123 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cae41e-41bf-42ed-89cd-c7174eccc81b admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:52.089415 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cae41e-41bf-42ed-89cd-c7174eccc81b admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:52.089832 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cae41e-41bf-42ed-89cd-c7174eccc81b admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:52.090589 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cae41e-41bf-42ed-89cd-c7174eccc81b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:52.092256 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cae41e-41bf-42ed-89cd-c7174eccc81b admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:52.104497 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1230/2474] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:34:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:34:52.108647 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5c961c-aace-4b83-845b-8ba4657d78c2 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:52.122060 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5c961c-aace-4b83-845b-8ba4657d78c2 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:52.126921 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d020d43-ec74-4825-9d54-640d2208bde1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:52.128078 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d020d43-ec74-4825-9d54-640d2208bde1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:52.128366 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d020d43-ec74-4825-9d54-640d2208bde1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:52.128643 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d020d43-ec74-4825-9d54-640d2208bde1 admin admin] PATH_INFO: `/v3/projects/035c1c034d744690a745701f8e688c84/users/dc50797fe0c34936aa713c78ffc87533/roles/c8ce6d197f654598ac45f6016ecccabd` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:52.145212 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d020d43-ec74-4825-9d54-640d2208bde1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=035c1c034d744690a745701f8e688c84, user_id=dc50797fe0c34936aa713c78ffc87533, role_id=c8ce6d197f654598ac45f6016ecccabd)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:52.148488 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d020d43-ec74-4825-9d54-640d2208bde1 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:52.328979 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1245/2475] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:34:52 2022] PUT /identity/v3/projects/035c1c034d744690a745701f8e688c84/users/dc50797fe0c34936aa713c78ffc87533/roles/c8ce6d197f654598ac45f6016ecccabd => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:34:52.339576 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dddd5d8-70b0-4bdb-8309-b78781b6350b None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:52.339910 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dddd5d8-70b0-4bdb-8309-b78781b6350b None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:52.340224 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dddd5d8-70b0-4bdb-8309-b78781b6350b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:52.366382 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-6dddd5d8-70b0-4bdb-8309-b78781b6350b None None] MFA Rules not processed for user `dc50797fe0c34936aa713c78ffc87533`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:34:52.367506 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-6dddd5d8-70b0-4bdb-8309-b78781b6350b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:52.432528 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1231/2476] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:34:52 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:34:52.443375 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d020d43-ec74-4825-9d54-640d2208bde1 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:52.445577 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-9d020d43-ec74-4825-9d54-640d2208bde1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:52.464881 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:34:52.502627 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d020d43-ec74-4825-9d54-640d2208bde1 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:52.506297 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7f8546-a887-496a-ae4d-7f01b5bba17f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8693a1e72f14fdfb383f11e96330726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:52.507437 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7f8546-a887-496a-ae4d-7f01b5bba17f service cinder] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:52.507719 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7f8546-a887-496a-ae4d-7f01b5bba17f service cinder] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:52.507993 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7f8546-a887-496a-ae4d-7f01b5bba17f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:52.516551 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7f8546-a887-496a-ae4d-7f01b5bba17f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:52.518038 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7f8546-a887-496a-ae4d-7f01b5bba17f service cinder] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:52.529695 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1246/2477] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:34:52 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:34:56.148409 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dddd5d8-70b0-4bdb-8309-b78781b6350b None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:56.158336 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dddd5d8-70b0-4bdb-8309-b78781b6350b None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:56.162089 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd77b558-7f06-48da-a047-d79d27525063 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8693a1e72f14fdfb383f11e96330726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:56.163662 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77b558-7f06-48da-a047-d79d27525063 service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:56.163662 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77b558-7f06-48da-a047-d79d27525063 service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:56.163662 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77b558-7f06-48da-a047-d79d27525063 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:56.165215 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-fd77b558-7f06-48da-a047-d79d27525063 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:56.237909 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd77b558-7f06-48da-a047-d79d27525063 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:56.239412 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd77b558-7f06-48da-a047-d79d27525063 service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:56.251171 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1232/2478] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:34:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:34:57.517413 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7f8546-a887-496a-ae4d-7f01b5bba17f service cinder] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:57.518934 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-ba7f8546-a887-496a-ae4d-7f01b5bba17f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:57.576862 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7f8546-a887-496a-ae4d-7f01b5bba17f service cinder] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:57.580469 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9584220-6a7f-4533-9bc2-c2a2bb78a272 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:57.581131 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9584220-6a7f-4533-9bc2-c2a2bb78a272 service neutron] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:57.581407 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9584220-6a7f-4533-9bc2-c2a2bb78a272 service neutron] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:57.581694 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9584220-6a7f-4533-9bc2-c2a2bb78a272 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:57.583499 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-a9584220-6a7f-4533-9bc2-c2a2bb78a272 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:57.596973 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9584220-6a7f-4533-9bc2-c2a2bb78a272 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:57.598424 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9584220-6a7f-4533-9bc2-c2a2bb78a272 service neutron] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:57.610136 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1247/2479] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:34:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:35:02.771339 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd77b558-7f06-48da-a047-d79d27525063 service cinder] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:02.820157 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:02.838339 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd77b558-7f06-48da-a047-d79d27525063 service cinder] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:02.845891 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b22741-340b-40f4-a86a-c1abfcd204cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:02.846849 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b22741-340b-40f4-a86a-c1abfcd204cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:02.853871 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b22741-340b-40f4-a86a-c1abfcd204cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:02.853871 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b22741-340b-40f4-a86a-c1abfcd204cd admin admin] PATH_INFO: `/v3/users/dc50797fe0c34936aa713c78ffc87533` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:02.853871 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b22741-340b-40f4-a86a-c1abfcd204cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc50797fe0c34936aa713c78ffc87533)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:02.853871 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b22741-340b-40f4-a86a-c1abfcd204cd admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:03.114335 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-05b22741-340b-40f4-a86a-c1abfcd204cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc50797fe0c34936aa713c78ffc87533'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:03.121858 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-05b22741-340b-40f4-a86a-c1abfcd204cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc50797fe0c34936aa713c78ffc87533'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:03.122549 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-05b22741-340b-40f4-a86a-c1abfcd204cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc50797fe0c34936aa713c78ffc87533'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:03.123153 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-05b22741-340b-40f4-a86a-c1abfcd204cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc50797fe0c34936aa713c78ffc87533'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:03.299991 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-05b22741-340b-40f4-a86a-c1abfcd204cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc50797fe0c34936aa713c78ffc87533'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:03.335625 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1233/2480] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:35:02 2022] DELETE /identity/v3/users/dc50797fe0c34936aa713c78ffc87533 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:03.337314 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f7b479-d653-46d7-8167-b89cd4f673dc None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:03.337778 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f7b479-d653-46d7-8167-b89cd4f673dc None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:03.337900 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f7b479-d653-46d7-8167-b89cd4f673dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:03.356280 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-24f7b479-d653-46d7-8167-b89cd4f673dc None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:03.358027 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-24f7b479-d653-46d7-8167-b89cd4f673dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:03.439241 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1248/2481] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:35:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:03.449627 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b22741-340b-40f4-a86a-c1abfcd204cd admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:03.451000 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-05b22741-340b-40f4-a86a-c1abfcd204cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:03.509942 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b22741-340b-40f4-a86a-c1abfcd204cd admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:03.513825 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882454c5-9006-4493-96e5-ff47f3745840 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:03.514520 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882454c5-9006-4493-96e5-ff47f3745840 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:03.514812 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882454c5-9006-4493-96e5-ff47f3745840 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:03.515198 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882454c5-9006-4493-96e5-ff47f3745840 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:03.524761 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882454c5-9006-4493-96e5-ff47f3745840 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:03.526195 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882454c5-9006-4493-96e5-ff47f3745840 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:03.536700 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1234/2482] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:35:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:35:04.032544 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f7b479-d653-46d7-8167-b89cd4f673dc None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:04.034073 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-24f7b479-d653-46d7-8167-b89cd4f673dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:04.047513 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f7b479-d653-46d7-8167-b89cd4f673dc None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:04.051682 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b482c4b9-d839-4005-9721-e2b73807c8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:04.052555 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482c4b9-d839-4005-9721-e2b73807c8d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:04.052843 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482c4b9-d839-4005-9721-e2b73807c8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:04.053231 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482c4b9-d839-4005-9721-e2b73807c8d5 admin admin] PATH_INFO: `/v3/projects/035c1c034d744690a745701f8e688c84` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:04.054474 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b482c4b9-d839-4005-9721-e2b73807c8d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=035c1c034d744690a745701f8e688c84)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:04.056379 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b482c4b9-d839-4005-9721-e2b73807c8d5 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:04.164004 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-b482c4b9-d839-4005-9721-e2b73807c8d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '035c1c034d744690a745701f8e688c84', 'request_id': 'req-b482c4b9-d839-4005-9721-e2b73807c8d5'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:04.170145 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-b482c4b9-d839-4005-9721-e2b73807c8d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '035c1c034d744690a745701f8e688c84', 'request_id': 'req-b482c4b9-d839-4005-9721-e2b73807c8d5'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:04.172245 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:04.176058 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-b482c4b9-d839-4005-9721-e2b73807c8d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '035c1c034d744690a745701f8e688c84', 'request_id': 'req-b482c4b9-d839-4005-9721-e2b73807c8d5'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:04.276823 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-b482c4b9-d839-4005-9721-e2b73807c8d5 admin admin] The token cache is being invalidate because project 035c1c034d744690a745701f8e688c84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80288) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:35:04.277113 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-b482c4b9-d839-4005-9721-e2b73807c8d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:04.277743 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-b482c4b9-d839-4005-9721-e2b73807c8d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:04.279368 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1249/2483] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:35:04 2022] DELETE /identity/v3/projects/035c1c034d744690a745701f8e688c84 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:04.284209 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac32fb2-fadb-441c-9379-4ded9afa88be None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:04.284711 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac32fb2-fadb-441c-9379-4ded9afa88be None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:04.284824 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac32fb2-fadb-441c-9379-4ded9afa88be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:04.303769 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-cac32fb2-fadb-441c-9379-4ded9afa88be None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:04.304968 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-cac32fb2-fadb-441c-9379-4ded9afa88be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:04.364072 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1235/2484] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:35:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:04.373167 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf782cfe-7d5f-40be-99fb-4e485b8ec2df None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:04.373677 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf782cfe-7d5f-40be-99fb-4e485b8ec2df None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:04.373777 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf782cfe-7d5f-40be-99fb-4e485b8ec2df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:04.392318 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-cf782cfe-7d5f-40be-99fb-4e485b8ec2df None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:04.393527 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-cf782cfe-7d5f-40be-99fb-4e485b8ec2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:04.401510 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1250/2485] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:35:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:04.405825 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac32fb2-fadb-441c-9379-4ded9afa88be None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:04.416407 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac32fb2-fadb-441c-9379-4ded9afa88be None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:04.421384 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5155b1c-387a-448a-9f2c-4a48be7be084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:04.422488 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5155b1c-387a-448a-9f2c-4a48be7be084 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:04.422971 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5155b1c-387a-448a-9f2c-4a48be7be084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:04.423422 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5155b1c-387a-448a-9f2c-4a48be7be084 admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:04.424618 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5155b1c-387a-448a-9f2c-4a48be7be084 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:35:04.425135 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5155b1c-387a-448a-9f2c-4a48be7be084 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:04.426787 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5155b1c-387a-448a-9f2c-4a48be7be084 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:04.434158 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:04.440750 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1236/2486] 10.222.0.62 () {58 vars in 1152 bytes} [Fri May 27 16:35:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:35:04.451019 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf782cfe-7d5f-40be-99fb-4e485b8ec2df None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:04.460530 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf782cfe-7d5f-40be-99fb-4e485b8ec2df None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:04.465699 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e43d0d-a9ca-4513-b5a4-219bcb0c6905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:04.466405 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e43d0d-a9ca-4513-b5a4-219bcb0c6905 admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:04.466694 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e43d0d-a9ca-4513-b5a4-219bcb0c6905 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:04.466967 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e43d0d-a9ca-4513-b5a4-219bcb0c6905 admin admin] PATH_INFO: `/v3/projects` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:04.467677 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e43d0d-a9ca-4513-b5a4-219bcb0c6905 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:04.469579 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e43d0d-a9ca-4513-b5a4-219bcb0c6905 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:04.561524 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1251/2487] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:35:04 2022] POST /identity/v3/projects => generated 373 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:35:04.566613 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5155b1c-387a-448a-9f2c-4a48be7be084 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:04.577479 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5155b1c-387a-448a-9f2c-4a48be7be084 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:04.639539 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f362157b-cdb1-4384-9e92-b26f087cf4b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:04.640296 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f362157b-cdb1-4384-9e92-b26f087cf4b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:04.640802 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f362157b-cdb1-4384-9e92-b26f087cf4b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:04.641299 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f362157b-cdb1-4384-9e92-b26f087cf4b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:04.642413 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f362157b-cdb1-4384-9e92-b26f087cf4b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:04.645359 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f362157b-cdb1-4384-9e92-b26f087cf4b2 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:04.746938 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1237/2488] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:35:04 2022] POST /identity/v3/users => generated 287 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:35:04.752329 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e43d0d-a9ca-4513-b5a4-219bcb0c6905 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:04.763052 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e43d0d-a9ca-4513-b5a4-219bcb0c6905 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:04.767875 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411278cb-7a7c-43ba-a7de-f5caf2a88d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:04.768749 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411278cb-7a7c-43ba-a7de-f5caf2a88d3d admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:04.769196 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411278cb-7a7c-43ba-a7de-f5caf2a88d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:04.769642 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411278cb-7a7c-43ba-a7de-f5caf2a88d3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:04.770420 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411278cb-7a7c-43ba-a7de-f5caf2a88d3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:04.772539 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411278cb-7a7c-43ba-a7de-f5caf2a88d3d admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:04.784865 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1252/2489] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:35:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:35:04.789829 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f362157b-cdb1-4384-9e92-b26f087cf4b2 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:04.801219 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f362157b-cdb1-4384-9e92-b26f087cf4b2 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:04.806065 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb96c68-f8f3-4b5a-84e2-4ae205d3cd95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:04.806791 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb96c68-f8f3-4b5a-84e2-4ae205d3cd95 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:04.807318 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb96c68-f8f3-4b5a-84e2-4ae205d3cd95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:04.807318 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb96c68-f8f3-4b5a-84e2-4ae205d3cd95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:04.808064 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb96c68-f8f3-4b5a-84e2-4ae205d3cd95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:04.809697 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb96c68-f8f3-4b5a-84e2-4ae205d3cd95 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:04.823251 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1238/2490] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:35:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:35:04.824765 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411278cb-7a7c-43ba-a7de-f5caf2a88d3d admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:04.835616 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411278cb-7a7c-43ba-a7de-f5caf2a88d3d admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:04.840363 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9724132-889d-492f-b01e-a48e9b794c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:04.841277 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9724132-889d-492f-b01e-a48e9b794c5c admin admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:04.841766 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9724132-889d-492f-b01e-a48e9b794c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:04.842301 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9724132-889d-492f-b01e-a48e9b794c5c admin admin] PATH_INFO: `/v3/projects/9eb8020a8b1c4110b54d4b6de60f756a/users/43721bd2cfb24f54aebc3aaa67c8d747/roles/c8ce6d197f654598ac45f6016ecccabd` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:04.860504 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9724132-889d-492f-b01e-a48e9b794c5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9eb8020a8b1c4110b54d4b6de60f756a, user_id=43721bd2cfb24f54aebc3aaa67c8d747, role_id=c8ce6d197f654598ac45f6016ecccabd)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:04.863643 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9724132-889d-492f-b01e-a48e9b794c5c admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:04.935647 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1253/2491] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:35:04 2022] PUT /identity/v3/projects/9eb8020a8b1c4110b54d4b6de60f756a/users/43721bd2cfb24f54aebc3aaa67c8d747/roles/c8ce6d197f654598ac45f6016ecccabd => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:04.946523 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46505a2a-d59a-45ce-9384-cd838ad9a81f None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:04.946861 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46505a2a-d59a-45ce-9384-cd838ad9a81f None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:04.947149 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46505a2a-d59a-45ce-9384-cd838ad9a81f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:04.976456 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-46505a2a-d59a-45ce-9384-cd838ad9a81f None None] MFA Rules not processed for user `43721bd2cfb24f54aebc3aaa67c8d747`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:04.977884 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-46505a2a-d59a-45ce-9384-cd838ad9a81f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:05.059072 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1239/2492] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:35:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:05.063575 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9724132-889d-492f-b01e-a48e9b794c5c admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:05.143222 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9724132-889d-492f-b01e-a48e9b794c5c admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:05.148161 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe17da2-5c18-4fe4-af48-c0845582b713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:05.148833 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe17da2-5c18-4fe4-af48-c0845582b713 admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:05.149125 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe17da2-5c18-4fe4-af48-c0845582b713 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:05.149413 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe17da2-5c18-4fe4-af48-c0845582b713 admin admin] PATH_INFO: `/v3/projects` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:05.150122 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe17da2-5c18-4fe4-af48-c0845582b713 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:05.152083 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe17da2-5c18-4fe4-af48-c0845582b713 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:05.290646 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1254/2493] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:35:05 2022] POST /identity/v3/projects => generated 369 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:35:05.294781 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46505a2a-d59a-45ce-9384-cd838ad9a81f None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:05.306348 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46505a2a-d59a-45ce-9384-cd838ad9a81f None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:05.361767 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686d9d4d-06f8-4b27-992b-b658ed817531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:05.362484 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d9d4d-06f8-4b27-992b-b658ed817531 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:05.362809 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d9d4d-06f8-4b27-992b-b658ed817531 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:05.363123 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d9d4d-06f8-4b27-992b-b658ed817531 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:05.363835 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686d9d4d-06f8-4b27-992b-b658ed817531 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:05.366406 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686d9d4d-06f8-4b27-992b-b658ed817531 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:05.376119 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:05.502103 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1240/2494] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:35:05 2022] POST /identity/v3/users => generated 291 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:35:05.504247 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe17da2-5c18-4fe4-af48-c0845582b713 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:05.514992 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe17da2-5c18-4fe4-af48-c0845582b713 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:05.519662 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec16c2b3-7d75-4768-b8e4-e0ff8817da4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:05.520325 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16c2b3-7d75-4768-b8e4-e0ff8817da4d admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:05.520612 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16c2b3-7d75-4768-b8e4-e0ff8817da4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:05.520893 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16c2b3-7d75-4768-b8e4-e0ff8817da4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:05.521650 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec16c2b3-7d75-4768-b8e4-e0ff8817da4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:05.523777 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec16c2b3-7d75-4768-b8e4-e0ff8817da4d admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:05.534855 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1255/2495] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:35:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:35:05.539715 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686d9d4d-06f8-4b27-992b-b658ed817531 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:05.549919 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686d9d4d-06f8-4b27-992b-b658ed817531 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:05.566470 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab87813-0703-452d-b6c4-ae2ad0485cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:05.566470 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab87813-0703-452d-b6c4-ae2ad0485cad admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:05.566470 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab87813-0703-452d-b6c4-ae2ad0485cad admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:05.566470 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab87813-0703-452d-b6c4-ae2ad0485cad admin admin] PATH_INFO: `/v3/projects/48ae1e96b02b4f63bfe5cd88e908cb51/users/8fcba8e51a8f4f3aa6679db8814df576/roles/e04fe3eb1f714d74901ac83e33ea8a16` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:05.572025 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab87813-0703-452d-b6c4-ae2ad0485cad admin admin] RBAC: Authorizing `identity:create_grant(project_id=48ae1e96b02b4f63bfe5cd88e908cb51, user_id=8fcba8e51a8f4f3aa6679db8814df576, role_id=e04fe3eb1f714d74901ac83e33ea8a16)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:05.574756 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab87813-0703-452d-b6c4-ae2ad0485cad admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:05.667268 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1241/2496] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:35:05 2022] PUT /identity/v3/projects/48ae1e96b02b4f63bfe5cd88e908cb51/users/8fcba8e51a8f4f3aa6679db8814df576/roles/e04fe3eb1f714d74901ac83e33ea8a16 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:05.671416 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec16c2b3-7d75-4768-b8e4-e0ff8817da4d admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:05.681756 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec16c2b3-7d75-4768-b8e4-e0ff8817da4d admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:05.736777 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:05.743652 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c337cea-8757-42fb-a2cf-4615a12e7c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:05.744367 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c337cea-8757-42fb-a2cf-4615a12e7c89 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:05.744653 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c337cea-8757-42fb-a2cf-4615a12e7c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:05.744932 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c337cea-8757-42fb-a2cf-4615a12e7c89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:05.745687 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c337cea-8757-42fb-a2cf-4615a12e7c89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:05.747459 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c337cea-8757-42fb-a2cf-4615a12e7c89 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:05.758408 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1256/2497] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:35:05 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:35:05.762621 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab87813-0703-452d-b6c4-ae2ad0485cad admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:05.773872 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab87813-0703-452d-b6c4-ae2ad0485cad admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:05.778828 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1693cd4-189b-489d-b2e4-6d36113ee6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:05.779805 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1693cd4-189b-489d-b2e4-6d36113ee6b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:05.780132 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1693cd4-189b-489d-b2e4-6d36113ee6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:05.780436 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1693cd4-189b-489d-b2e4-6d36113ee6b5 admin admin] PATH_INFO: `/v3/projects/48ae1e96b02b4f63bfe5cd88e908cb51/users/8fcba8e51a8f4f3aa6679db8814df576/roles/e04fe3eb1f714d74901ac83e33ea8a16` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:05.782465 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1693cd4-189b-489d-b2e4-6d36113ee6b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48ae1e96b02b4f63bfe5cd88e908cb51, user_id=8fcba8e51a8f4f3aa6679db8814df576, role_id=e04fe3eb1f714d74901ac83e33ea8a16)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:05.790826 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1693cd4-189b-489d-b2e4-6d36113ee6b5 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:05.796410 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1242/2498] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:35:05 2022] PUT /identity/v3/projects/48ae1e96b02b4f63bfe5cd88e908cb51/users/8fcba8e51a8f4f3aa6679db8814df576/roles/e04fe3eb1f714d74901ac83e33ea8a16 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:35:05.806908 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c68877-2e19-4451-9516-6f622f0a6bd6 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:05.807277 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c68877-2e19-4451-9516-6f622f0a6bd6 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:05.807646 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c68877-2e19-4451-9516-6f622f0a6bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:05.834969 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-c1c68877-2e19-4451-9516-6f622f0a6bd6 None None] MFA Rules not processed for user `8fcba8e51a8f4f3aa6679db8814df576`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:05.836205 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-c1c68877-2e19-4451-9516-6f622f0a6bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:05.913080 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1257/2499] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:35:05 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:35:05.924617 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1693cd4-189b-489d-b2e4-6d36113ee6b5 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:05.926378 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-a1693cd4-189b-489d-b2e4-6d36113ee6b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:05.992907 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1693cd4-189b-489d-b2e4-6d36113ee6b5 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:05.996797 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19531a78-303a-4a76-b9ce-28947b9c1f03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8693a1e72f14fdfb383f11e96330726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:05.997484 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19531a78-303a-4a76-b9ce-28947b9c1f03 service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:05.997814 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19531a78-303a-4a76-b9ce-28947b9c1f03 service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:05.998131 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19531a78-303a-4a76-b9ce-28947b9c1f03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:06.014275 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19531a78-303a-4a76-b9ce-28947b9c1f03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:06.015709 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19531a78-303a-4a76-b9ce-28947b9c1f03 service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:06.028147 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1243/2500] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:35:05 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:35:06.362155 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c68877-2e19-4451-9516-6f622f0a6bd6 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:06.363638 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-c1c68877-2e19-4451-9516-6f622f0a6bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:06.376150 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c68877-2e19-4451-9516-6f622f0a6bd6 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:06.380096 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178123cd-d9dc-45cb-9fc5-5002fe134f13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8693a1e72f14fdfb383f11e96330726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:06.380834 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178123cd-d9dc-45cb-9fc5-5002fe134f13 service cinder] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:06.381116 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178123cd-d9dc-45cb-9fc5-5002fe134f13 service cinder] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:06.381392 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178123cd-d9dc-45cb-9fc5-5002fe134f13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:06.447807 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178123cd-d9dc-45cb-9fc5-5002fe134f13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:06.449276 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178123cd-d9dc-45cb-9fc5-5002fe134f13 service cinder] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:06.468327 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1258/2501] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:35:06 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 16:35:13.154683 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266e56f-f170-4aaf-91ef-3f6d6b0b3297 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:13.155218 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266e56f-f170-4aaf-91ef-3f6d6b0b3297 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:13.155317 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266e56f-f170-4aaf-91ef-3f6d6b0b3297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:13.174038 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-1266e56f-f170-4aaf-91ef-3f6d6b0b3297 None None] MFA Rules not processed for user `9eb9fb33e55a4b80b04c6462403195c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:13.175400 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-1266e56f-f170-4aaf-91ef-3f6d6b0b3297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:13.253554 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1244/2502] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:35:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:13.567344 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178123cd-d9dc-45cb-9fc5-5002fe134f13 service cinder] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:13.570238 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-178123cd-d9dc-45cb-9fc5-5002fe134f13 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:13.630571 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178123cd-d9dc-45cb-9fc5-5002fe134f13 service cinder] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:13.634921 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a63759f-5139-4540-ac64-230f858397e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:13.635570 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63759f-5139-4540-ac64-230f858397e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:13.635863 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63759f-5139-4540-ac64-230f858397e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:13.636251 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63759f-5139-4540-ac64-230f858397e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:13.638313 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-7a63759f-5139-4540-ac64-230f858397e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:13.648552 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a63759f-5139-4540-ac64-230f858397e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:13.650014 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a63759f-5139-4540-ac64-230f858397e8 service neutron] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:13.658443 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1259/2503] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:35:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:35:14.085307 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1266e56f-f170-4aaf-91ef-3f6d6b0b3297 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:14.087059 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-1266e56f-f170-4aaf-91ef-3f6d6b0b3297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:14.160230 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1266e56f-f170-4aaf-91ef-3f6d6b0b3297 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:14.165867 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98099779-5766-4cef-a915-f1a92f1fdb9e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35d98c4a2af546d8b655d649d655f447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:14.166570 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98099779-5766-4cef-a915-f1a92f1fdb9e service placement] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:14.166901 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98099779-5766-4cef-a915-f1a92f1fdb9e service placement] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:14.167230 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98099779-5766-4cef-a915-f1a92f1fdb9e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:14.169131 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-98099779-5766-4cef-a915-f1a92f1fdb9e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:14.178724 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:14.181004 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98099779-5766-4cef-a915-f1a92f1fdb9e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:14.182659 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98099779-5766-4cef-a915-f1a92f1fdb9e service placement] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:14.192783 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1245/2504] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:35:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:35:17.231911 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a63759f-5139-4540-ac64-230f858397e8 service neutron] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:17.233720 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-7a63759f-5139-4540-ac64-230f858397e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:17.260460 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:17.315781 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a63759f-5139-4540-ac64-230f858397e8 service neutron] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:17.325781 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38e6085-fe9a-4a68-b143-5e7e4eb9e9e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb13ad6d8b1e46029262556bff398796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:17.327351 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38e6085-fe9a-4a68-b143-5e7e4eb9e9e1 service nova] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:17.327651 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38e6085-fe9a-4a68-b143-5e7e4eb9e9e1 service nova] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:17.327936 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38e6085-fe9a-4a68-b143-5e7e4eb9e9e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:17.329777 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-e38e6085-fe9a-4a68-b143-5e7e4eb9e9e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:17.389700 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38e6085-fe9a-4a68-b143-5e7e4eb9e9e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:17.391364 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38e6085-fe9a-4a68-b143-5e7e4eb9e9e1 service nova] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:17.400698 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1260/2505] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:35:17 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:35:17.721696 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98099779-5766-4cef-a915-f1a92f1fdb9e service placement] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:17.731131 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98099779-5766-4cef-a915-f1a92f1fdb9e service placement] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:17.734803 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dee71e-e2b0-453d-825b-56556d0da3e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:17.735405 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dee71e-e2b0-453d-825b-56556d0da3e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:17.735728 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dee71e-e2b0-453d-825b-56556d0da3e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:17.736045 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dee71e-e2b0-453d-825b-56556d0da3e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:17.737823 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-61dee71e-e2b0-453d-825b-56556d0da3e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:17.747871 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dee71e-e2b0-453d-825b-56556d0da3e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:17.749322 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dee71e-e2b0-453d-825b-56556d0da3e0 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:17.758023 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1246/2506] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:35:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:35:27.518127 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=48 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:27.753908 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=8 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:28.460901 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38e6085-fe9a-4a68-b143-5e7e4eb9e9e1 service nova] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:28.462383 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-e38e6085-fe9a-4a68-b143-5e7e4eb9e9e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:28.545600 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38e6085-fe9a-4a68-b143-5e7e4eb9e9e1 service nova] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:28.551990 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2fa67b-776c-45c0-8f19-7fae80777240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:28.555296 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2fa67b-776c-45c0-8f19-7fae80777240 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:28.555296 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2fa67b-776c-45c0-8f19-7fae80777240 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:28.555296 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2fa67b-776c-45c0-8f19-7fae80777240 admin admin] PATH_INFO: `/v3/users/87089f81f6d44b83bb20ef3f01bca18c` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:28.555948 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2fa67b-776c-45c0-8f19-7fae80777240 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87089f81f6d44b83bb20ef3f01bca18c)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:28.557966 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2fa67b-776c-45c0-8f19-7fae80777240 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:28.575578 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dee71e-e2b0-453d-825b-56556d0da3e0 service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:28.590350 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dee71e-e2b0-453d-825b-56556d0da3e0 service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:28.596708 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3913d1-c3ef-4449-9f32-94997577dfab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb13ad6d8b1e46029262556bff398796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:28.597401 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3913d1-c3ef-4449-9f32-94997577dfab service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:28.597938 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3913d1-c3ef-4449-9f32-94997577dfab service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:28.598272 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3913d1-c3ef-4449-9f32-94997577dfab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:28.600961 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-4e3913d1-c3ef-4449-9f32-94997577dfab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:28.613665 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3913d1-c3ef-4449-9f32-94997577dfab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:28.615937 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3913d1-c3ef-4449-9f32-94997577dfab service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:28.627697 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1247/2507] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:35:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:35:28.807569 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-9c2fa67b-776c-45c0-8f19-7fae80777240 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87089f81f6d44b83bb20ef3f01bca18c'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:28.823238 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-9c2fa67b-776c-45c0-8f19-7fae80777240 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87089f81f6d44b83bb20ef3f01bca18c'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:28.824176 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-9c2fa67b-776c-45c0-8f19-7fae80777240 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87089f81f6d44b83bb20ef3f01bca18c'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:28.824997 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-9c2fa67b-776c-45c0-8f19-7fae80777240 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87089f81f6d44b83bb20ef3f01bca18c'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:28.957416 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-9c2fa67b-776c-45c0-8f19-7fae80777240 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87089f81f6d44b83bb20ef3f01bca18c'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:28.980413 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1261/2508] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:35:28 2022] DELETE /identity/v3/users/87089f81f6d44b83bb20ef3f01bca18c => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:29.330071 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3913d1-c3ef-4449-9f32-94997577dfab service nova] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:29.351259 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3913d1-c3ef-4449-9f32-94997577dfab service nova] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:29.439050 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b12dd5-f079-4e43-b795-aad3bb800b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:29.442493 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b12dd5-f079-4e43-b795-aad3bb800b52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:29.442493 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b12dd5-f079-4e43-b795-aad3bb800b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:29.442493 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b12dd5-f079-4e43-b795-aad3bb800b52 admin admin] PATH_INFO: `/v3/projects/950926111a2946daaf7a21d6a6f079f8` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:29.442493 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b12dd5-f079-4e43-b795-aad3bb800b52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=950926111a2946daaf7a21d6a6f079f8)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:29.444514 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b12dd5-f079-4e43-b795-aad3bb800b52 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:29.547951 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-20b12dd5-f079-4e43-b795-aad3bb800b52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '950926111a2946daaf7a21d6a6f079f8', 'request_id': 'req-20b12dd5-f079-4e43-b795-aad3bb800b52'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:29.554309 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-20b12dd5-f079-4e43-b795-aad3bb800b52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '950926111a2946daaf7a21d6a6f079f8', 'request_id': 'req-20b12dd5-f079-4e43-b795-aad3bb800b52'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:29.631660 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-20b12dd5-f079-4e43-b795-aad3bb800b52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '950926111a2946daaf7a21d6a6f079f8', 'request_id': 'req-20b12dd5-f079-4e43-b795-aad3bb800b52'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:29.645100 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-20b12dd5-f079-4e43-b795-aad3bb800b52 admin admin] The token cache is being invalidate because project 950926111a2946daaf7a21d6a6f079f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:35:29.645765 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-20b12dd5-f079-4e43-b795-aad3bb800b52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:29.647481 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-20b12dd5-f079-4e43-b795-aad3bb800b52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:29.649544 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1248/2509] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:35:29 2022] DELETE /identity/v3/projects/950926111a2946daaf7a21d6a6f079f8 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:38.976454 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=53,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:39.641018 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:44.804354 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2fa67b-776c-45c0-8f19-7fae80777240 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:44.805844 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-9c2fa67b-776c-45c0-8f19-7fae80777240 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:44.864981 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2fa67b-776c-45c0-8f19-7fae80777240 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:44.913571 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365f5a9c-fdce-4675-a956-b33387911c9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:44.914799 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365f5a9c-fdce-4675-a956-b33387911c9d service neutron] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:44.915081 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365f5a9c-fdce-4675-a956-b33387911c9d service neutron] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:44.915394 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365f5a9c-fdce-4675-a956-b33387911c9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:44.917198 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-365f5a9c-fdce-4675-a956-b33387911c9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:44.979499 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365f5a9c-fdce-4675-a956-b33387911c9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:44.980859 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365f5a9c-fdce-4675-a956-b33387911c9d service neutron] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:44.990700 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1262/2510] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:35:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:35:45.946439 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b12dd5-f079-4e43-b795-aad3bb800b52 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:45.948805 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-20b12dd5-f079-4e43-b795-aad3bb800b52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:45.962331 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b12dd5-f079-4e43-b795-aad3bb800b52 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:45.967685 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edf91b4-142b-4314-957b-85d247256b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:45.968817 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf91b4-142b-4314-957b-85d247256b4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:45.969339 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf91b4-142b-4314-957b-85d247256b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:45.969844 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf91b4-142b-4314-957b-85d247256b4f admin admin] PATH_INFO: `/v3/users/43721bd2cfb24f54aebc3aaa67c8d747` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:45.971160 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edf91b4-142b-4314-957b-85d247256b4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=43721bd2cfb24f54aebc3aaa67c8d747)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:45.973562 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edf91b4-142b-4314-957b-85d247256b4f admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:46.153370 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-4edf91b4-142b-4314-957b-85d247256b4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43721bd2cfb24f54aebc3aaa67c8d747'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:46.160535 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-4edf91b4-142b-4314-957b-85d247256b4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43721bd2cfb24f54aebc3aaa67c8d747'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:46.161218 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-4edf91b4-142b-4314-957b-85d247256b4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43721bd2cfb24f54aebc3aaa67c8d747'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:46.161832 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-4edf91b4-142b-4314-957b-85d247256b4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43721bd2cfb24f54aebc3aaa67c8d747'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:46.230925 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-4edf91b4-142b-4314-957b-85d247256b4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43721bd2cfb24f54aebc3aaa67c8d747'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:46.257358 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1249/2511] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:35:45 2022] DELETE /identity/v3/users/43721bd2cfb24f54aebc3aaa67c8d747 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:46.262323 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a6eb66-e725-4fb7-9432-6e4753a3e905 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:46.262828 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a6eb66-e725-4fb7-9432-6e4753a3e905 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:46.262947 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a6eb66-e725-4fb7-9432-6e4753a3e905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:46.281870 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-50a6eb66-e725-4fb7-9432-6e4753a3e905 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:46.283422 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-50a6eb66-e725-4fb7-9432-6e4753a3e905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:46.346722 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1263/2512] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:35:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:46.356952 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edf91b4-142b-4314-957b-85d247256b4f admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:46.359317 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-4edf91b4-142b-4314-957b-85d247256b4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:46.418089 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edf91b4-142b-4314-957b-85d247256b4f admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:46.423157 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78e04db-3af5-4941-b766-23b08a6452e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:46.424153 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e04db-3af5-4941-b766-23b08a6452e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:46.424153 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e04db-3af5-4941-b766-23b08a6452e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:46.424434 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e04db-3af5-4941-b766-23b08a6452e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:46.436582 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78e04db-3af5-4941-b766-23b08a6452e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:46.438426 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78e04db-3af5-4941-b766-23b08a6452e8 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:46.449478 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1250/2513] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:35:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:35:46.955825 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a6eb66-e725-4fb7-9432-6e4753a3e905 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:46.959117 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-50a6eb66-e725-4fb7-9432-6e4753a3e905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:46.972433 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a6eb66-e725-4fb7-9432-6e4753a3e905 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:46.978851 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eaf630-6c85-4a9d-9a62-09dd15641696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:46.979732 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eaf630-6c85-4a9d-9a62-09dd15641696 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:46.980019 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eaf630-6c85-4a9d-9a62-09dd15641696 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:46.980297 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eaf630-6c85-4a9d-9a62-09dd15641696 admin admin] PATH_INFO: `/v3/projects/9eb8020a8b1c4110b54d4b6de60f756a` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:46.981963 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eaf630-6c85-4a9d-9a62-09dd15641696 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9eb8020a8b1c4110b54d4b6de60f756a)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:46.984055 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eaf630-6c85-4a9d-9a62-09dd15641696 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:46.985768 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:47.111602 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-70eaf630-6c85-4a9d-9a62-09dd15641696 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9eb8020a8b1c4110b54d4b6de60f756a', 'request_id': 'req-70eaf630-6c85-4a9d-9a62-09dd15641696'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:47.117893 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-70eaf630-6c85-4a9d-9a62-09dd15641696 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9eb8020a8b1c4110b54d4b6de60f756a', 'request_id': 'req-70eaf630-6c85-4a9d-9a62-09dd15641696'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:47.123534 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-70eaf630-6c85-4a9d-9a62-09dd15641696 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9eb8020a8b1c4110b54d4b6de60f756a', 'request_id': 'req-70eaf630-6c85-4a9d-9a62-09dd15641696'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:47.224636 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-70eaf630-6c85-4a9d-9a62-09dd15641696 admin admin] The token cache is being invalidate because project 9eb8020a8b1c4110b54d4b6de60f756a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80288) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:35:47.224858 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-70eaf630-6c85-4a9d-9a62-09dd15641696 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:47.225472 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-70eaf630-6c85-4a9d-9a62-09dd15641696 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:47.227597 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1264/2514] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:35:46 2022] DELETE /identity/v3/projects/9eb8020a8b1c4110b54d4b6de60f756a => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:47.231874 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78e04db-3af5-4941-b766-23b08a6452e8 service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:47.241452 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78e04db-3af5-4941-b766-23b08a6452e8 service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:47.303447 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3832b16-6032-4b90-9ba7-f120cfc187fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:47.304409 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3832b16-6032-4b90-9ba7-f120cfc187fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:47.304734 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3832b16-6032-4b90-9ba7-f120cfc187fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:47.305019 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3832b16-6032-4b90-9ba7-f120cfc187fa admin admin] PATH_INFO: `/v3/users/8fcba8e51a8f4f3aa6679db8814df576` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:47.306273 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3832b16-6032-4b90-9ba7-f120cfc187fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fcba8e51a8f4f3aa6679db8814df576)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:47.308217 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3832b16-6032-4b90-9ba7-f120cfc187fa admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:47.333718 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:47.519330 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b3832b16-6032-4b90-9ba7-f120cfc187fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fcba8e51a8f4f3aa6679db8814df576'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:47.527999 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b3832b16-6032-4b90-9ba7-f120cfc187fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fcba8e51a8f4f3aa6679db8814df576'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:47.528822 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b3832b16-6032-4b90-9ba7-f120cfc187fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fcba8e51a8f4f3aa6679db8814df576'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:47.529439 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b3832b16-6032-4b90-9ba7-f120cfc187fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fcba8e51a8f4f3aa6679db8814df576'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:47.636712 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b3832b16-6032-4b90-9ba7-f120cfc187fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fcba8e51a8f4f3aa6679db8814df576'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:47.658615 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1251/2515] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:35:47 2022] DELETE /identity/v3/users/8fcba8e51a8f4f3aa6679db8814df576 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:48.181399 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eaf630-6c85-4a9d-9a62-09dd15641696 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:48.182885 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-70eaf630-6c85-4a9d-9a62-09dd15641696 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:48.196015 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eaf630-6c85-4a9d-9a62-09dd15641696 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:48.257542 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd3465-50da-4350-8560-64ebea6e7a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:48.258535 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd3465-50da-4350-8560-64ebea6e7a70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:48.258820 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd3465-50da-4350-8560-64ebea6e7a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:48.259097 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd3465-50da-4350-8560-64ebea6e7a70 admin admin] PATH_INFO: `/v3/projects/48ae1e96b02b4f63bfe5cd88e908cb51` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:48.260295 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcd3465-50da-4350-8560-64ebea6e7a70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48ae1e96b02b4f63bfe5cd88e908cb51)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:48.262241 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcd3465-50da-4350-8560-64ebea6e7a70 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:48.398196 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-efcd3465-50da-4350-8560-64ebea6e7a70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48ae1e96b02b4f63bfe5cd88e908cb51', 'request_id': 'req-efcd3465-50da-4350-8560-64ebea6e7a70'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:48.405400 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-efcd3465-50da-4350-8560-64ebea6e7a70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48ae1e96b02b4f63bfe5cd88e908cb51', 'request_id': 'req-efcd3465-50da-4350-8560-64ebea6e7a70'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:48.415904 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-efcd3465-50da-4350-8560-64ebea6e7a70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48ae1e96b02b4f63bfe5cd88e908cb51', 'request_id': 'req-efcd3465-50da-4350-8560-64ebea6e7a70'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:48.521688 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-efcd3465-50da-4350-8560-64ebea6e7a70 admin admin] The token cache is being invalidate because project 48ae1e96b02b4f63bfe5cd88e908cb51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80288) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:35:48.521688 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-efcd3465-50da-4350-8560-64ebea6e7a70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:48.521688 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-efcd3465-50da-4350-8560-64ebea6e7a70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:48.528623 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1265/2516] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:35:48 2022] DELETE /identity/v3/projects/48ae1e96b02b4f63bfe5cd88e908cb51 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:35:48.530463 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c101b61-6208-4408-a046-b06a106a413f None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:48.530940 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c101b61-6208-4408-a046-b06a106a413f None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:48.531160 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c101b61-6208-4408-a046-b06a106a413f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:48.550000 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-1c101b61-6208-4408-a046-b06a106a413f None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:48.551580 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-1c101b61-6208-4408-a046-b06a106a413f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:48.620052 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1252/2517] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:35:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:48.628339 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856683d-af95-4431-b514-a96b89aaf939 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:48.628704 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856683d-af95-4431-b514-a96b89aaf939 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:48.628989 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856683d-af95-4431-b514-a96b89aaf939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:48.649167 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-5856683d-af95-4431-b514-a96b89aaf939 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:48.650446 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-5856683d-af95-4431-b514-a96b89aaf939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:48.658899 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1266/2518] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:35:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:48.663210 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c101b61-6208-4408-a046-b06a106a413f None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:48.673532 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c101b61-6208-4408-a046-b06a106a413f None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:48.678708 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe774c8-1fe0-4ead-8a30-f65b3748aba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:48.679975 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe774c8-1fe0-4ead-8a30-f65b3748aba7 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:48.680268 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe774c8-1fe0-4ead-8a30-f65b3748aba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:48.680546 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe774c8-1fe0-4ead-8a30-f65b3748aba7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:48.681283 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe774c8-1fe0-4ead-8a30-f65b3748aba7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:35:48.681595 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe774c8-1fe0-4ead-8a30-f65b3748aba7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:48.683256 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe774c8-1fe0-4ead-8a30-f65b3748aba7 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:48.696633 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1253/2519] 10.222.0.62 () {58 vars in 1152 bytes} [Fri May 27 16:35:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:35:48.701090 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5856683d-af95-4431-b514-a96b89aaf939 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:48.711508 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5856683d-af95-4431-b514-a96b89aaf939 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:48.716524 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0927ed50-eff1-4830-9d3d-ef71718b3a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:48.717435 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0927ed50-eff1-4830-9d3d-ef71718b3a34 admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:48.717791 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0927ed50-eff1-4830-9d3d-ef71718b3a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:48.718137 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0927ed50-eff1-4830-9d3d-ef71718b3a34 admin admin] PATH_INFO: `/v3/projects` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:48.718937 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0927ed50-eff1-4830-9d3d-ef71718b3a34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:48.720920 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0927ed50-eff1-4830-9d3d-ef71718b3a34 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:48.733135 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:48.840528 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1267/2520] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:35:48 2022] POST /identity/v3/projects => generated 367 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:35:48.844531 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe774c8-1fe0-4ead-8a30-f65b3748aba7 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:48.856027 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe774c8-1fe0-4ead-8a30-f65b3748aba7 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:48.897115 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0927ed50-eff1-4830-9d3d-ef71718b3a34 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:48.903323 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-0927ed50-eff1-4830-9d3d-ef71718b3a34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:48.943317 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeff165-e087-4831-8882-2d14e33caf8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:48.944155 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeff165-e087-4831-8882-2d14e33caf8a admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:48.944504 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeff165-e087-4831-8882-2d14e33caf8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:48.944868 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeff165-e087-4831-8882-2d14e33caf8a admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:48.945658 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeff165-e087-4831-8882-2d14e33caf8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:48.947654 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeff165-e087-4831-8882-2d14e33caf8a admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:48.973526 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0927ed50-eff1-4830-9d3d-ef71718b3a34 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:48.979343 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9962f38-af0d-4dc1-97c3-783fc309e308 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35d98c4a2af546d8b655d649d655f447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:48.979990 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9962f38-af0d-4dc1-97c3-783fc309e308 service placement] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:48.980277 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9962f38-af0d-4dc1-97c3-783fc309e308 service placement] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:48.980557 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9962f38-af0d-4dc1-97c3-783fc309e308 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:48.982398 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-e9962f38-af0d-4dc1-97c3-783fc309e308 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:48.994717 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9962f38-af0d-4dc1-97c3-783fc309e308 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:48.996392 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9962f38-af0d-4dc1-97c3-783fc309e308 service placement] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:49.006768 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1268/2521] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:35:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 16:35:49.070648 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9962f38-af0d-4dc1-97c3-783fc309e308 service placement] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:49.072101 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-e9962f38-af0d-4dc1-97c3-783fc309e308 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:49.083367 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1254/2522] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:35:48 2022] POST /identity/v3/users => generated 284 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:35:49.087178 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeff165-e087-4831-8882-2d14e33caf8a admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:49.087850 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9962f38-af0d-4dc1-97c3-783fc309e308 service placement] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:49.092602 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b3c417-9317-4a46-8888-8a7dc9a83d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:49.093548 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b3c417-9317-4a46-8888-8a7dc9a83d35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:49.093831 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b3c417-9317-4a46-8888-8a7dc9a83d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:49.094114 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b3c417-9317-4a46-8888-8a7dc9a83d35 admin admin] PATH_INFO: `/v3/users/820d152f8d5b45a2aca035e7cc2684ef` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:49.095392 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b3c417-9317-4a46-8888-8a7dc9a83d35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=820d152f8d5b45a2aca035e7cc2684ef)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:49.097283 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeff165-e087-4831-8882-2d14e33caf8a admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:49.099918 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b3c417-9317-4a46-8888-8a7dc9a83d35 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:49.102551 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f72902-e8f5-4e82-bde4-1c7ee301f76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:49.103199 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f72902-e8f5-4e82-bde4-1c7ee301f76e admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:49.103480 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f72902-e8f5-4e82-bde4-1c7ee301f76e admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:49.103755 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f72902-e8f5-4e82-bde4-1c7ee301f76e admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:49.104477 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f72902-e8f5-4e82-bde4-1c7ee301f76e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:49.106050 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f72902-e8f5-4e82-bde4-1c7ee301f76e admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:49.111913 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:49.118732 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1255/2523] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:35:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 16:35:49.122639 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f72902-e8f5-4e82-bde4-1c7ee301f76e admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:49.133051 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f72902-e8f5-4e82-bde4-1c7ee301f76e admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:49.137703 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c8c8e-0933-4420-84e4-7c1aa5d77ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:49.138367 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c8c8e-0933-4420-84e4-7c1aa5d77ded admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:49.138653 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c8c8e-0933-4420-84e4-7c1aa5d77ded admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:49.138928 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c8c8e-0933-4420-84e4-7c1aa5d77ded admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:49.139636 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3c8c8e-0933-4420-84e4-7c1aa5d77ded admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:49.141204 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3c8c8e-0933-4420-84e4-7c1aa5d77ded admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:49.153972 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1256/2524] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:35:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 16:35:49.155306 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c8c8e-0933-4420-84e4-7c1aa5d77ded admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:49.166583 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c8c8e-0933-4420-84e4-7c1aa5d77ded admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:49.171242 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebd9a5b-7db8-4f3a-b0cf-ce20b87a09b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:49.172143 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd9a5b-7db8-4f3a-b0cf-ce20b87a09b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:49.172430 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd9a5b-7db8-4f3a-b0cf-ce20b87a09b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:49.172713 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd9a5b-7db8-4f3a-b0cf-ce20b87a09b9 admin admin] PATH_INFO: `/v3/projects/06f42a876e1f42c8b070cec4ccff55d2/users/c237b14376444db7953ac83853e32c55/roles/c8ce6d197f654598ac45f6016ecccabd` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:49.187991 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebd9a5b-7db8-4f3a-b0cf-ce20b87a09b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06f42a876e1f42c8b070cec4ccff55d2, user_id=c237b14376444db7953ac83853e32c55, role_id=c8ce6d197f654598ac45f6016ecccabd)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:49.190768 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebd9a5b-7db8-4f3a-b0cf-ce20b87a09b9 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:49.304967 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1257/2525] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:35:49 2022] PUT /identity/v3/projects/06f42a876e1f42c8b070cec4ccff55d2/users/c237b14376444db7953ac83853e32c55/roles/c8ce6d197f654598ac45f6016ecccabd => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:35:49.315073 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e1d650-f2a3-4f57-89f1-39cf2a113ae2 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:49.315384 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e1d650-f2a3-4f57-89f1-39cf2a113ae2 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:49.315659 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e1d650-f2a3-4f57-89f1-39cf2a113ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:49.342049 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-14e1d650-f2a3-4f57-89f1-39cf2a113ae2 None None] MFA Rules not processed for user `c237b14376444db7953ac83853e32c55`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:49.342292 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-65b3c417-9317-4a46-8888-8a7dc9a83d35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '820d152f8d5b45a2aca035e7cc2684ef'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:49.343279 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-14e1d650-f2a3-4f57-89f1-39cf2a113ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:49.355584 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-65b3c417-9317-4a46-8888-8a7dc9a83d35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '820d152f8d5b45a2aca035e7cc2684ef'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:49.356270 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-65b3c417-9317-4a46-8888-8a7dc9a83d35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '820d152f8d5b45a2aca035e7cc2684ef'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:49.356879 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-65b3c417-9317-4a46-8888-8a7dc9a83d35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '820d152f8d5b45a2aca035e7cc2684ef'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:49.408110 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1258/2526] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:35:49 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:35:49.412455 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e1d650-f2a3-4f57-89f1-39cf2a113ae2 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:49.413779 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-14e1d650-f2a3-4f57-89f1-39cf2a113ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:49.447771 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-65b3c417-9317-4a46-8888-8a7dc9a83d35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '820d152f8d5b45a2aca035e7cc2684ef'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:49.461322 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1269/2527] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:35:49 2022] DELETE /identity/v3/users/820d152f8d5b45a2aca035e7cc2684ef => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:35:49.478513 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e1d650-f2a3-4f57-89f1-39cf2a113ae2 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:49.537633 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3290efd-d41d-4dbe-a7c7-04ec12c3441c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:49.538341 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3290efd-d41d-4dbe-a7c7-04ec12c3441c admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:49.538603 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3290efd-d41d-4dbe-a7c7-04ec12c3441c admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:49.538975 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3290efd-d41d-4dbe-a7c7-04ec12c3441c admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:49.540262 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3290efd-d41d-4dbe-a7c7-04ec12c3441c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:49.542203 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3290efd-d41d-4dbe-a7c7-04ec12c3441c admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:49.546677 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:49.696454 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1259/2528] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:35:49 2022] POST /identity/v3/projects => generated 367 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:35:49.700271 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b3c417-9317-4a46-8888-8a7dc9a83d35 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:49.712399 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b3c417-9317-4a46-8888-8a7dc9a83d35 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:49.724800 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3290efd-d41d-4dbe-a7c7-04ec12c3441c admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:49.727349 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-c3290efd-d41d-4dbe-a7c7-04ec12c3441c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:49.770558 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:49.780168 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a493201-c2bb-44c6-9232-8241e1568c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:49.780847 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a493201-c2bb-44c6-9232-8241e1568c7c admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:49.781137 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a493201-c2bb-44c6-9232-8241e1568c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:49.781420 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a493201-c2bb-44c6-9232-8241e1568c7c admin admin] PATH_INFO: `/v3/users` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:49.782146 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a493201-c2bb-44c6-9232-8241e1568c7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:49.784147 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a493201-c2bb-44c6-9232-8241e1568c7c admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:49.799027 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3290efd-d41d-4dbe-a7c7-04ec12c3441c admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:49.804297 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255591b4-ccc6-4dfe-ae58-0e539601d456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:49.805359 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255591b4-ccc6-4dfe-ae58-0e539601d456 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:49.805647 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255591b4-ccc6-4dfe-ae58-0e539601d456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:49.805961 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255591b4-ccc6-4dfe-ae58-0e539601d456 admin admin] PATH_INFO: `/v3/projects/08e477d9bd754665844c35963f723850` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:49.807245 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255591b4-ccc6-4dfe-ae58-0e539601d456 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08e477d9bd754665844c35963f723850)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:49.809393 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255591b4-ccc6-4dfe-ae58-0e539601d456 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:49.934573 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1270/2529] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:35:49 2022] POST /identity/v3/users => generated 290 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:35:49.938447 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a493201-c2bb-44c6-9232-8241e1568c7c admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:49.949858 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a493201-c2bb-44c6-9232-8241e1568c7c admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:49.963252 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-255591b4-ccc6-4dfe-ae58-0e539601d456 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08e477d9bd754665844c35963f723850', 'request_id': 'req-255591b4-ccc6-4dfe-ae58-0e539601d456'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:49.969539 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-255591b4-ccc6-4dfe-ae58-0e539601d456 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08e477d9bd754665844c35963f723850', 'request_id': 'req-255591b4-ccc6-4dfe-ae58-0e539601d456'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:50.009313 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df06d9f-60b0-4780-b1af-c944fbf4b666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:50.009985 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df06d9f-60b0-4780-b1af-c944fbf4b666 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:50.010298 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df06d9f-60b0-4780-b1af-c944fbf4b666 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:50.010585 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df06d9f-60b0-4780-b1af-c944fbf4b666 admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:50.011313 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df06d9f-60b0-4780-b1af-c944fbf4b666 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:50.012916 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df06d9f-60b0-4780-b1af-c944fbf4b666 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:50.022610 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1271/2530] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:35:49 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:35:50.026825 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df06d9f-60b0-4780-b1af-c944fbf4b666 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:50.036167 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df06d9f-60b0-4780-b1af-c944fbf4b666 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:50.041584 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc478a0-646c-4df7-af97-fb3d84ed381f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:50.051281 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc478a0-646c-4df7-af97-fb3d84ed381f admin admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:50.051281 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc478a0-646c-4df7-af97-fb3d84ed381f admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:50.051281 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc478a0-646c-4df7-af97-fb3d84ed381f admin admin] PATH_INFO: `/v3/projects/d352d3f7b91e4c9784f539dbfec55906/users/a505ce5ff8d24d7d8b680fa21e12c80b/roles/e04fe3eb1f714d74901ac83e33ea8a16` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:50.058024 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc478a0-646c-4df7-af97-fb3d84ed381f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d352d3f7b91e4c9784f539dbfec55906, user_id=a505ce5ff8d24d7d8b680fa21e12c80b, role_id=e04fe3eb1f714d74901ac83e33ea8a16)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:50.060765 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc478a0-646c-4df7-af97-fb3d84ed381f admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:50.076461 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-255591b4-ccc6-4dfe-ae58-0e539601d456 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08e477d9bd754665844c35963f723850', 'request_id': 'req-255591b4-ccc6-4dfe-ae58-0e539601d456'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:50.087488 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-255591b4-ccc6-4dfe-ae58-0e539601d456 admin admin] The token cache is being invalidate because project 08e477d9bd754665844c35963f723850 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:35:50.087779 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-255591b4-ccc6-4dfe-ae58-0e539601d456 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:50.088446 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-255591b4-ccc6-4dfe-ae58-0e539601d456 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:50.090019 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1260/2531] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:35:49 2022] DELETE /identity/v3/projects/08e477d9bd754665844c35963f723850 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:35:50.094759 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d768e-0974-4497-b039-1305e1bc85d4 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:50.095056 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d768e-0974-4497-b039-1305e1bc85d4 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:50.095337 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d768e-0974-4497-b039-1305e1bc85d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:50.112991 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-bd7d768e-0974-4497-b039-1305e1bc85d4 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:50.114402 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-bd7d768e-0974-4497-b039-1305e1bc85d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:50.123192 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1261/2532] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:35:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:35:50.130599 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eb1383-441c-4706-8389-a4b0c44864bf None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:50.137207 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eb1383-441c-4706-8389-a4b0c44864bf None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:50.137207 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eb1383-441c-4706-8389-a4b0c44864bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:50.149435 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-99eb1383-441c-4706-8389-a4b0c44864bf None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:50.150806 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-99eb1383-441c-4706-8389-a4b0c44864bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:50.159589 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1262/2533] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:35:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:35:50.163503 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eb1383-441c-4706-8389-a4b0c44864bf None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:50.172725 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eb1383-441c-4706-8389-a4b0c44864bf None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:50.174180 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1272/2534] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:35:50 2022] PUT /identity/v3/projects/d352d3f7b91e4c9784f539dbfec55906/users/a505ce5ff8d24d7d8b680fa21e12c80b/roles/e04fe3eb1f714d74901ac83e33ea8a16 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:35:50.178191 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc478a0-646c-4df7-af97-fb3d84ed381f admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:50.180357 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-7fc478a0-646c-4df7-af97-fb3d84ed381f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:50.233067 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f5bdd4-7fc5-4142-a8c3-1080c1c44ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:50.233744 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f5bdd4-7fc5-4142-a8c3-1080c1c44ebf admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:50.234037 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f5bdd4-7fc5-4142-a8c3-1080c1c44ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:50.234351 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f5bdd4-7fc5-4142-a8c3-1080c1c44ebf admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:50.235111 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f5bdd4-7fc5-4142-a8c3-1080c1c44ebf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:35:50.235424 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f5bdd4-7fc5-4142-a8c3-1080c1c44ebf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:50.237083 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f5bdd4-7fc5-4142-a8c3-1080c1c44ebf admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:50.245135 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:50.246984 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc478a0-646c-4df7-af97-fb3d84ed381f admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:50.251120 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1263/2535] 10.222.0.62 () {58 vars in 1152 bytes} [Fri May 27 16:35:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:35:50.255225 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f5bdd4-7fc5-4142-a8c3-1080c1c44ebf admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:50.255762 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2968af-2534-4e8e-b64e-8e14d165e86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:50.256452 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2968af-2534-4e8e-b64e-8e14d165e86f admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:50.256739 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2968af-2534-4e8e-b64e-8e14d165e86f admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:50.257020 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2968af-2534-4e8e-b64e-8e14d165e86f admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:50.258372 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2968af-2534-4e8e-b64e-8e14d165e86f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:50.263498 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2968af-2534-4e8e-b64e-8e14d165e86f admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:50.266699 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f5bdd4-7fc5-4142-a8c3-1080c1c44ebf admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:50.271829 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9f5cae-a748-4456-853d-5fcaa860140f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:50.272474 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1273/2536] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:35:50 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 16:35:50.274726 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f5cae-a748-4456-853d-5fcaa860140f admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:50.275019 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f5cae-a748-4456-853d-5fcaa860140f admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:50.275440 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f5cae-a748-4456-853d-5fcaa860140f admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:50.276375 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9f5cae-a748-4456-853d-5fcaa860140f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:50.276749 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2968af-2534-4e8e-b64e-8e14d165e86f admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:50.278314 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9f5cae-a748-4456-853d-5fcaa860140f admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:50.287591 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2968af-2534-4e8e-b64e-8e14d165e86f admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:50.292965 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139247c0-f790-4cfd-8ca2-904501716bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:50.293931 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139247c0-f790-4cfd-8ca2-904501716bbc admin admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:50.294425 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139247c0-f790-4cfd-8ca2-904501716bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:50.294714 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139247c0-f790-4cfd-8ca2-904501716bbc admin admin] PATH_INFO: `/v3/projects/d352d3f7b91e4c9784f539dbfec55906/users/a505ce5ff8d24d7d8b680fa21e12c80b/roles/e04fe3eb1f714d74901ac83e33ea8a16` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:50.296844 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139247c0-f790-4cfd-8ca2-904501716bbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d352d3f7b91e4c9784f539dbfec55906, user_id=a505ce5ff8d24d7d8b680fa21e12c80b, role_id=e04fe3eb1f714d74901ac83e33ea8a16)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:50.299691 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139247c0-f790-4cfd-8ca2-904501716bbc admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:50.311425 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1274/2537] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:35:50 2022] PUT /identity/v3/projects/d352d3f7b91e4c9784f539dbfec55906/users/a505ce5ff8d24d7d8b680fa21e12c80b/roles/e04fe3eb1f714d74901ac83e33ea8a16 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:35:50.324202 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624864c-e6a6-49f6-9baf-707c3671e2ba None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:50.324430 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624864c-e6a6-49f6-9baf-707c3671e2ba None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:50.324713 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624864c-e6a6-49f6-9baf-707c3671e2ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:50.352460 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-5624864c-e6a6-49f6-9baf-707c3671e2ba None None] MFA Rules not processed for user `a505ce5ff8d24d7d8b680fa21e12c80b`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:50.353724 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-5624864c-e6a6-49f6-9baf-707c3671e2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:50.380495 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:50.420627 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1264/2538] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:35:50 2022] POST /identity/v3/projects => generated 373 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:35:50.421756 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9f5cae-a748-4456-853d-5fcaa860140f admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:50.423885 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1275/2539] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:35:50 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:35:50.440538 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5624864c-e6a6-49f6-9baf-707c3671e2ba None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:50.441919 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-5624864c-e6a6-49f6-9baf-707c3671e2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:50.485506 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9f5cae-a748-4456-853d-5fcaa860140f admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:50.490639 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3155935a-4442-4d8e-925a-d3ec1be3dadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:50.491403 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3155935a-4442-4d8e-925a-d3ec1be3dadf admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:50.491692 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3155935a-4442-4d8e-925a-d3ec1be3dadf admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:50.492011 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3155935a-4442-4d8e-925a-d3ec1be3dadf admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:50.493218 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3155935a-4442-4d8e-925a-d3ec1be3dadf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:50.495258 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3155935a-4442-4d8e-925a-d3ec1be3dadf admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:50.504711 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5624864c-e6a6-49f6-9baf-707c3671e2ba None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:50.553423 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be806f29-2440-4e57-b286-5e8f8aac6c6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8693a1e72f14fdfb383f11e96330726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:50.554074 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be806f29-2440-4e57-b286-5e8f8aac6c6c service cinder] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:50.554454 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be806f29-2440-4e57-b286-5e8f8aac6c6c service cinder] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:50.554747 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be806f29-2440-4e57-b286-5e8f8aac6c6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:50.618829 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be806f29-2440-4e57-b286-5e8f8aac6c6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:50.620351 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be806f29-2440-4e57-b286-5e8f8aac6c6c service cinder] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:50.620527 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1265/2540] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:35:50 2022] POST /identity/v3/users => generated 287 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:35:50.624599 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3155935a-4442-4d8e-925a-d3ec1be3dadf admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:50.631832 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1276/2541] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:35:50 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 16:35:50.634996 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3155935a-4442-4d8e-925a-d3ec1be3dadf admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:50.639924 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251b26f4-ed2c-48cc-b016-e95bf27c84e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:50.640587 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b26f4-ed2c-48cc-b016-e95bf27c84e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:50.640982 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b26f4-ed2c-48cc-b016-e95bf27c84e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:50.641215 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b26f4-ed2c-48cc-b016-e95bf27c84e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:50.641950 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251b26f4-ed2c-48cc-b016-e95bf27c84e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:50.643594 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251b26f4-ed2c-48cc-b016-e95bf27c84e4 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:50.653955 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1266/2542] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:35:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 16:35:50.658561 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be806f29-2440-4e57-b286-5e8f8aac6c6c service cinder] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:50.670267 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be806f29-2440-4e57-b286-5e8f8aac6c6c service cinder] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:50.675041 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb15c530-0696-4dab-9005-fb7dbcd3ca87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:50.675701 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15c530-0696-4dab-9005-fb7dbcd3ca87 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:50.675993 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15c530-0696-4dab-9005-fb7dbcd3ca87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:50.676275 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15c530-0696-4dab-9005-fb7dbcd3ca87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:50.677068 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb15c530-0696-4dab-9005-fb7dbcd3ca87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:50.678895 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb15c530-0696-4dab-9005-fb7dbcd3ca87 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:50.690119 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1277/2543] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:35:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:35:50.694231 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251b26f4-ed2c-48cc-b016-e95bf27c84e4 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:50.704235 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251b26f4-ed2c-48cc-b016-e95bf27c84e4 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:50.708893 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a5dc5f-aeb8-4ca5-97c1-5599f9754eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:50.709770 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a5dc5f-aeb8-4ca5-97c1-5599f9754eeb admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:50.710060 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a5dc5f-aeb8-4ca5-97c1-5599f9754eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:50.710380 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a5dc5f-aeb8-4ca5-97c1-5599f9754eeb admin admin] PATH_INFO: `/v3/projects/9251922253d84771acc58561d70cdaf9/users/f2eca8448d2b4d4cba692afe756f5478/roles/c8ce6d197f654598ac45f6016ecccabd` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:50.736182 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a5dc5f-aeb8-4ca5-97c1-5599f9754eeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9251922253d84771acc58561d70cdaf9, user_id=f2eca8448d2b4d4cba692afe756f5478, role_id=c8ce6d197f654598ac45f6016ecccabd)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:50.738979 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a5dc5f-aeb8-4ca5-97c1-5599f9754eeb admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:50.766762 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb15c530-0696-4dab-9005-fb7dbcd3ca87 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:50.769456 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-bb15c530-0696-4dab-9005-fb7dbcd3ca87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:50.792852 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb15c530-0696-4dab-9005-fb7dbcd3ca87 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:50.797674 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8884b823-3938-4370-9c26-61c65a7445ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8693a1e72f14fdfb383f11e96330726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:50.798440 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884b823-3938-4370-9c26-61c65a7445ee service cinder] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:50.798767 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884b823-3938-4370-9c26-61c65a7445ee service cinder] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:50.799087 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884b823-3938-4370-9c26-61c65a7445ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:50.802300 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-8884b823-3938-4370-9c26-61c65a7445ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:50.819736 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:50.854482 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1267/2544] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:35:50 2022] PUT /identity/v3/projects/9251922253d84771acc58561d70cdaf9/users/f2eca8448d2b4d4cba692afe756f5478/roles/c8ce6d197f654598ac45f6016ecccabd => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:50.871441 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8884b823-3938-4370-9c26-61c65a7445ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:50.872931 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09743b22-2759-4656-b7e2-fbcf52dbe821 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:50.873078 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8884b823-3938-4370-9c26-61c65a7445ee service cinder] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:50.873228 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09743b22-2759-4656-b7e2-fbcf52dbe821 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:50.873509 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09743b22-2759-4656-b7e2-fbcf52dbe821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:50.883309 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1278/2545] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:35:50 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 16:35:50.900908 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-09743b22-2759-4656-b7e2-fbcf52dbe821 None None] MFA Rules not processed for user `f2eca8448d2b4d4cba692afe756f5478`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:50.902127 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-09743b22-2759-4656-b7e2-fbcf52dbe821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:50.971049 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1268/2546] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:35:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:35:50.983184 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8884b823-3938-4370-9c26-61c65a7445ee service cinder] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:50.984652 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-8884b823-3938-4370-9c26-61c65a7445ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:51.060827 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8884b823-3938-4370-9c26-61c65a7445ee service cinder] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:51.126831 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f2ab9-3d9b-400d-b988-ff29b33cf45e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb13ad6d8b1e46029262556bff398796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:51.127618 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f2ab9-3d9b-400d-b988-ff29b33cf45e service nova] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:51.127885 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f2ab9-3d9b-400d-b988-ff29b33cf45e service nova] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:51.128702 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f2ab9-3d9b-400d-b988-ff29b33cf45e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:51.138331 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05f2ab9-3d9b-400d-b988-ff29b33cf45e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:51.140096 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05f2ab9-3d9b-400d-b988-ff29b33cf45e service nova] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:51.154642 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1279/2547] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:35:50 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:35:51.365501 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09743b22-2759-4656-b7e2-fbcf52dbe821 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:51.387506 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:51.431091 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09743b22-2759-4656-b7e2-fbcf52dbe821 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:51.435677 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd87f74a-31c5-4b86-a8a4-d2525948c7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:51.436577 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd87f74a-31c5-4b86-a8a4-d2525948c7b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:51.436866 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd87f74a-31c5-4b86-a8a4-d2525948c7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:51.437142 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd87f74a-31c5-4b86-a8a4-d2525948c7b7 admin admin] PATH_INFO: `/v3/users/f2eca8448d2b4d4cba692afe756f5478` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:51.438597 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd87f74a-31c5-4b86-a8a4-d2525948c7b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2eca8448d2b4d4cba692afe756f5478)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:51.440957 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd87f74a-31c5-4b86-a8a4-d2525948c7b7 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:51.724610 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-fd87f74a-31c5-4b86-a8a4-d2525948c7b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2eca8448d2b4d4cba692afe756f5478'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:51.731827 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-fd87f74a-31c5-4b86-a8a4-d2525948c7b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2eca8448d2b4d4cba692afe756f5478'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:51.732485 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-fd87f74a-31c5-4b86-a8a4-d2525948c7b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2eca8448d2b4d4cba692afe756f5478'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:51.733084 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-fd87f74a-31c5-4b86-a8a4-d2525948c7b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2eca8448d2b4d4cba692afe756f5478'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:51.845436 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-fd87f74a-31c5-4b86-a8a4-d2525948c7b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2eca8448d2b4d4cba692afe756f5478'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:51.866286 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1269/2548] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:35:51 2022] DELETE /identity/v3/users/f2eca8448d2b4d4cba692afe756f5478 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:51.870035 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3f8a50-4fc6-4450-9c61-5efec75b01ab None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:51.870533 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3f8a50-4fc6-4450-9c61-5efec75b01ab None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:51.870648 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3f8a50-4fc6-4450-9c61-5efec75b01ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:51.891412 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-3c3f8a50-4fc6-4450-9c61-5efec75b01ab None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:51.892738 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-3c3f8a50-4fc6-4450-9c61-5efec75b01ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:51.931010 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:51.956414 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1280/2549] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:35:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:51.967142 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd87f74a-31c5-4b86-a8a4-d2525948c7b7 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:51.968730 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-fd87f74a-31c5-4b86-a8a4-d2525948c7b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:52.028697 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd87f74a-31c5-4b86-a8a4-d2525948c7b7 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:52.032320 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cc4327-eaa3-4aa1-8aef-b7657c060d3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:52.032963 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc4327-eaa3-4aa1-8aef-b7657c060d3e service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:52.033246 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc4327-eaa3-4aa1-8aef-b7657c060d3e service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:52.033525 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc4327-eaa3-4aa1-8aef-b7657c060d3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:52.044478 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cc4327-eaa3-4aa1-8aef-b7657c060d3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:52.045901 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cc4327-eaa3-4aa1-8aef-b7657c060d3e service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:52.055396 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1270/2550] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:35:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:35:52.524280 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3f8a50-4fc6-4450-9c61-5efec75b01ab None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:52.525725 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-3c3f8a50-4fc6-4450-9c61-5efec75b01ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:52.538431 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3f8a50-4fc6-4450-9c61-5efec75b01ab None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:52.543608 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb68d7d-0c2c-4c3a-8f2b-60ab01e6c61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:52.544464 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb68d7d-0c2c-4c3a-8f2b-60ab01e6c61b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:52.544743 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb68d7d-0c2c-4c3a-8f2b-60ab01e6c61b admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:52.545089 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb68d7d-0c2c-4c3a-8f2b-60ab01e6c61b admin admin] PATH_INFO: `/v3/projects/9251922253d84771acc58561d70cdaf9` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:52.546321 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb68d7d-0c2c-4c3a-8f2b-60ab01e6c61b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9251922253d84771acc58561d70cdaf9)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:52.548286 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb68d7d-0c2c-4c3a-8f2b-60ab01e6c61b admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:52.652656 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-ccb68d7d-0c2c-4c3a-8f2b-60ab01e6c61b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9251922253d84771acc58561d70cdaf9', 'request_id': 'req-ccb68d7d-0c2c-4c3a-8f2b-60ab01e6c61b'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:52.658872 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-ccb68d7d-0c2c-4c3a-8f2b-60ab01e6c61b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9251922253d84771acc58561d70cdaf9', 'request_id': 'req-ccb68d7d-0c2c-4c3a-8f2b-60ab01e6c61b'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:52.665077 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-ccb68d7d-0c2c-4c3a-8f2b-60ab01e6c61b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9251922253d84771acc58561d70cdaf9', 'request_id': 'req-ccb68d7d-0c2c-4c3a-8f2b-60ab01e6c61b'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:52.778444 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-ccb68d7d-0c2c-4c3a-8f2b-60ab01e6c61b admin admin] The token cache is being invalidate because project 9251922253d84771acc58561d70cdaf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80288) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:35:52.778665 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-ccb68d7d-0c2c-4c3a-8f2b-60ab01e6c61b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:52.779278 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-ccb68d7d-0c2c-4c3a-8f2b-60ab01e6c61b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:52.780842 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1281/2551] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:35:52 2022] DELETE /identity/v3/projects/9251922253d84771acc58561d70cdaf9 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:52.785661 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4770bc8-4393-495e-992d-f48335a045e3 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:52.786158 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4770bc8-4393-495e-992d-f48335a045e3 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:52.786279 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4770bc8-4393-495e-992d-f48335a045e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:52.804029 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-c4770bc8-4393-495e-992d-f48335a045e3 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:52.805893 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-c4770bc8-4393-495e-992d-f48335a045e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:52.844320 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:52.875691 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1271/2552] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:35:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:52.880794 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da4470f-74ed-43cf-8f28-8981f9fc0a5d None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:52.881327 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da4470f-74ed-43cf-8f28-8981f9fc0a5d None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:52.881655 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da4470f-74ed-43cf-8f28-8981f9fc0a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:52.900952 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-5da4470f-74ed-43cf-8f28-8981f9fc0a5d None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:52.902176 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-5da4470f-74ed-43cf-8f28-8981f9fc0a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:52.917489 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1282/2553] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:35:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:35:52.919024 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4770bc8-4393-495e-992d-f48335a045e3 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:52.928552 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4770bc8-4393-495e-992d-f48335a045e3 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:52.933776 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab2613-372f-4ab5-b36a-e7991b90a3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:52.934477 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab2613-372f-4ab5-b36a-e7991b90a3aa admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:52.934769 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab2613-372f-4ab5-b36a-e7991b90a3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:52.935050 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab2613-372f-4ab5-b36a-e7991b90a3aa admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:52.935777 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ab2613-372f-4ab5-b36a-e7991b90a3aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:35:52.936091 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ab2613-372f-4ab5-b36a-e7991b90a3aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:52.937739 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ab2613-372f-4ab5-b36a-e7991b90a3aa admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:52.949441 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1272/2554] 10.222.0.62 () {58 vars in 1152 bytes} [Fri May 27 16:35:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:35:52.953822 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da4470f-74ed-43cf-8f28-8981f9fc0a5d None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:52.962969 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da4470f-74ed-43cf-8f28-8981f9fc0a5d None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:52.967650 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b872d-4c93-41a5-976c-38c763091b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:52.968305 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b872d-4c93-41a5-976c-38c763091b08 admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:52.968592 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b872d-4c93-41a5-976c-38c763091b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:52.968866 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b872d-4c93-41a5-976c-38c763091b08 admin admin] PATH_INFO: `/v3/projects` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:52.969598 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6b872d-4c93-41a5-976c-38c763091b08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:52.971520 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6b872d-4c93-41a5-976c-38c763091b08 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:53.121134 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1283/2555] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:35:52 2022] POST /identity/v3/projects => generated 393 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:35:53.122697 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab2613-372f-4ab5-b36a-e7991b90a3aa admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:53.133071 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab2613-372f-4ab5-b36a-e7991b90a3aa admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:53.191199 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df55503e-4dda-48dd-81ae-23f74d0fa061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:53.191864 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55503e-4dda-48dd-81ae-23f74d0fa061 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:53.192151 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55503e-4dda-48dd-81ae-23f74d0fa061 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:53.192426 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55503e-4dda-48dd-81ae-23f74d0fa061 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:53.193104 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df55503e-4dda-48dd-81ae-23f74d0fa061 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:53.195068 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df55503e-4dda-48dd-81ae-23f74d0fa061 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:53.346197 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1273/2556] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:35:53 2022] POST /identity/v3/users => generated 297 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:35:53.350397 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b872d-4c93-41a5-976c-38c763091b08 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:53.360724 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b872d-4c93-41a5-976c-38c763091b08 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:53.365466 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01990f06-6529-4b68-9afd-00531476d2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:53.366233 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01990f06-6529-4b68-9afd-00531476d2d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:53.366640 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01990f06-6529-4b68-9afd-00531476d2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:53.367529 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01990f06-6529-4b68-9afd-00531476d2d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:53.368339 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01990f06-6529-4b68-9afd-00531476d2d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:53.370087 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01990f06-6529-4b68-9afd-00531476d2d6 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:53.381648 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1284/2557] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:35:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:35:53.386455 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df55503e-4dda-48dd-81ae-23f74d0fa061 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:53.397191 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df55503e-4dda-48dd-81ae-23f74d0fa061 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:53.402237 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee813a8-262c-451d-a9ae-e96dd7813162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:53.402946 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee813a8-262c-451d-a9ae-e96dd7813162 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:53.403263 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee813a8-262c-451d-a9ae-e96dd7813162 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:53.403597 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee813a8-262c-451d-a9ae-e96dd7813162 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:53.404375 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee813a8-262c-451d-a9ae-e96dd7813162 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:53.406127 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee813a8-262c-451d-a9ae-e96dd7813162 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:53.417638 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1274/2558] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:35:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:35:53.421955 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01990f06-6529-4b68-9afd-00531476d2d6 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:53.432419 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01990f06-6529-4b68-9afd-00531476d2d6 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:53.436933 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5811cf-af6a-474a-8f11-4bf24b864219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:53.437810 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5811cf-af6a-474a-8f11-4bf24b864219 admin admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:53.438095 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5811cf-af6a-474a-8f11-4bf24b864219 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:53.438410 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5811cf-af6a-474a-8f11-4bf24b864219 admin admin] PATH_INFO: `/v3/projects/ad063d8fed494f82af42d6b8150d27fb/users/75c6ee8fb26b457aa73a6965308fc59d/roles/c8ce6d197f654598ac45f6016ecccabd` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:53.454173 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5811cf-af6a-474a-8f11-4bf24b864219 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad063d8fed494f82af42d6b8150d27fb, user_id=75c6ee8fb26b457aa73a6965308fc59d, role_id=c8ce6d197f654598ac45f6016ecccabd)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:53.456970 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5811cf-af6a-474a-8f11-4bf24b864219 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:53.530237 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1285/2559] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:35:53 2022] PUT /identity/v3/projects/ad063d8fed494f82af42d6b8150d27fb/users/75c6ee8fb26b457aa73a6965308fc59d/roles/c8ce6d197f654598ac45f6016ecccabd => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:53.541979 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5cd64-a31b-4920-ab93-90d59fadbfcd None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:53.542553 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5cd64-a31b-4920-ab93-90d59fadbfcd None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:53.542880 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5cd64-a31b-4920-ab93-90d59fadbfcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:53.571072 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-4ae5cd64-a31b-4920-ab93-90d59fadbfcd None None] MFA Rules not processed for user `75c6ee8fb26b457aa73a6965308fc59d`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:53.572243 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-4ae5cd64-a31b-4920-ab93-90d59fadbfcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:53.637358 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1275/2560] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:35:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:53.641944 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5811cf-af6a-474a-8f11-4bf24b864219 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:53.703733 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5811cf-af6a-474a-8f11-4bf24b864219 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:53.708647 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3511c1fb-9e32-45ca-b788-06d7e9d2965d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:53.709353 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511c1fb-9e32-45ca-b788-06d7e9d2965d admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:53.709645 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511c1fb-9e32-45ca-b788-06d7e9d2965d admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:53.709924 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511c1fb-9e32-45ca-b788-06d7e9d2965d admin admin] PATH_INFO: `/v3/projects` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:53.710644 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3511c1fb-9e32-45ca-b788-06d7e9d2965d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:53.712547 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3511c1fb-9e32-45ca-b788-06d7e9d2965d admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:53.715863 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:53.835354 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1286/2561] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:35:53 2022] POST /identity/v3/projects => generated 393 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:35:53.840082 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae5cd64-a31b-4920-ab93-90d59fadbfcd None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:53.852502 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae5cd64-a31b-4920-ab93-90d59fadbfcd None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:53.895622 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:53.921493 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed9bac2-4fb3-4587-93f0-782ddd11f175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:53.922187 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed9bac2-4fb3-4587-93f0-782ddd11f175 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:53.922501 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed9bac2-4fb3-4587-93f0-782ddd11f175 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:53.926135 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed9bac2-4fb3-4587-93f0-782ddd11f175 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:53.926135 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed9bac2-4fb3-4587-93f0-782ddd11f175 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:53.926135 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed9bac2-4fb3-4587-93f0-782ddd11f175 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:54.072443 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1276/2562] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:35:53 2022] POST /identity/v3/users => generated 303 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:35:54.076539 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3511c1fb-9e32-45ca-b788-06d7e9d2965d admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:54.087850 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3511c1fb-9e32-45ca-b788-06d7e9d2965d admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:54.092697 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d4fe64-9386-4638-a22a-769b8bec77a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:54.093391 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4fe64-9386-4638-a22a-769b8bec77a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:54.093675 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4fe64-9386-4638-a22a-769b8bec77a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:54.094009 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4fe64-9386-4638-a22a-769b8bec77a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:54.094869 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d4fe64-9386-4638-a22a-769b8bec77a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:54.096623 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d4fe64-9386-4638-a22a-769b8bec77a3 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:54.108057 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1287/2563] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:35:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:35:54.112262 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed9bac2-4fb3-4587-93f0-782ddd11f175 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:54.122802 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed9bac2-4fb3-4587-93f0-782ddd11f175 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:54.127818 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5651014b-ca03-4e7b-bed0-21a42753313c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:54.128703 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651014b-ca03-4e7b-bed0-21a42753313c admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:54.128986 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651014b-ca03-4e7b-bed0-21a42753313c admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:54.129262 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651014b-ca03-4e7b-bed0-21a42753313c admin admin] PATH_INFO: `/v3/projects/84529adaa61c4bf5b5f51989cc0772d5/users/6b059530d9624b4d8014897a7d59d02c/roles/e04fe3eb1f714d74901ac83e33ea8a16` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:54.145270 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5651014b-ca03-4e7b-bed0-21a42753313c admin admin] RBAC: Authorizing `identity:create_grant(project_id=84529adaa61c4bf5b5f51989cc0772d5, user_id=6b059530d9624b4d8014897a7d59d02c, role_id=e04fe3eb1f714d74901ac83e33ea8a16)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:54.148071 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5651014b-ca03-4e7b-bed0-21a42753313c admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:54.249692 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1277/2564] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:35:54 2022] PUT /identity/v3/projects/84529adaa61c4bf5b5f51989cc0772d5/users/6b059530d9624b4d8014897a7d59d02c/roles/e04fe3eb1f714d74901ac83e33ea8a16 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:54.254030 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d4fe64-9386-4638-a22a-769b8bec77a3 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:54.264223 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d4fe64-9386-4638-a22a-769b8bec77a3 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:54.320618 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae288e5d-3012-4726-9262-60a9b5d767f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:54.321276 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae288e5d-3012-4726-9262-60a9b5d767f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:54.321562 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae288e5d-3012-4726-9262-60a9b5d767f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:54.321855 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae288e5d-3012-4726-9262-60a9b5d767f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:54.322651 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae288e5d-3012-4726-9262-60a9b5d767f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:54.324198 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae288e5d-3012-4726-9262-60a9b5d767f7 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:54.334230 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1288/2565] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:35:54 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:35:54.338542 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5651014b-ca03-4e7b-bed0-21a42753313c admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:54.348833 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5651014b-ca03-4e7b-bed0-21a42753313c admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:54.354047 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfccf7a-1a11-42af-afa9-05becd2cfcbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:54.354960 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfccf7a-1a11-42af-afa9-05becd2cfcbf admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:54.355251 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfccf7a-1a11-42af-afa9-05becd2cfcbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:54.355532 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfccf7a-1a11-42af-afa9-05becd2cfcbf admin admin] PATH_INFO: `/v3/projects/84529adaa61c4bf5b5f51989cc0772d5/users/6b059530d9624b4d8014897a7d59d02c/roles/e04fe3eb1f714d74901ac83e33ea8a16` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:54.357487 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfccf7a-1a11-42af-afa9-05becd2cfcbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=84529adaa61c4bf5b5f51989cc0772d5, user_id=6b059530d9624b4d8014897a7d59d02c, role_id=e04fe3eb1f714d74901ac83e33ea8a16)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:54.360159 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfccf7a-1a11-42af-afa9-05becd2cfcbf admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:54.370969 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1278/2566] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:35:54 2022] PUT /identity/v3/projects/84529adaa61c4bf5b5f51989cc0772d5/users/6b059530d9624b4d8014897a7d59d02c/roles/e04fe3eb1f714d74901ac83e33ea8a16 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:54.383106 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc697605-4fc9-4497-8009-29094ca8e39b None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:54.383399 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc697605-4fc9-4497-8009-29094ca8e39b None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:54.383680 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc697605-4fc9-4497-8009-29094ca8e39b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:54.410998 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-dc697605-4fc9-4497-8009-29094ca8e39b None None] MFA Rules not processed for user `6b059530d9624b4d8014897a7d59d02c`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:54.412213 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-dc697605-4fc9-4497-8009-29094ca8e39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:54.483058 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1289/2567] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:35:54 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:54.494531 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfccf7a-1a11-42af-afa9-05becd2cfcbf admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:54.496208 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-6dfccf7a-1a11-42af-afa9-05becd2cfcbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:54.555953 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfccf7a-1a11-42af-afa9-05becd2cfcbf admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:54.559673 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bbf5af-c4ee-452a-8783-e38a5ea453ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8693a1e72f14fdfb383f11e96330726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:54.560319 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bbf5af-c4ee-452a-8783-e38a5ea453ea service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:54.560606 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bbf5af-c4ee-452a-8783-e38a5ea453ea service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:54.560885 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bbf5af-c4ee-452a-8783-e38a5ea453ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:54.570382 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bbf5af-c4ee-452a-8783-e38a5ea453ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:54.571826 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bbf5af-c4ee-452a-8783-e38a5ea453ea service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:54.581894 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1279/2568] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:35:54 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:35:54.634878 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc697605-4fc9-4497-8009-29094ca8e39b None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:54.636302 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-dc697605-4fc9-4497-8009-29094ca8e39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:54.648986 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc697605-4fc9-4497-8009-29094ca8e39b None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:54.652812 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac66b73a-bf29-4a53-a2f2-f739b9742b49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8693a1e72f14fdfb383f11e96330726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:54.653462 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac66b73a-bf29-4a53-a2f2-f739b9742b49 service cinder] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:54.653750 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac66b73a-bf29-4a53-a2f2-f739b9742b49 service cinder] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:54.654034 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac66b73a-bf29-4a53-a2f2-f739b9742b49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:54.709997 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:54.714485 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac66b73a-bf29-4a53-a2f2-f739b9742b49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:54.716008 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac66b73a-bf29-4a53-a2f2-f739b9742b49 service cinder] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:54.725224 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1290/2569] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:35:54 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:35:56.455451 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bbf5af-c4ee-452a-8783-e38a5ea453ea service cinder] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:56.456847 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-27bbf5af-c4ee-452a-8783-e38a5ea453ea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:56.523322 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bbf5af-c4ee-452a-8783-e38a5ea453ea service cinder] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:56.528053 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00789e18-fa65-408a-8d5c-8b6a92a2115c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:56.528944 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00789e18-fa65-408a-8d5c-8b6a92a2115c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:56.529238 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00789e18-fa65-408a-8d5c-8b6a92a2115c admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:56.529555 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00789e18-fa65-408a-8d5c-8b6a92a2115c admin admin] PATH_INFO: `/v3/users/c237b14376444db7953ac83853e32c55` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:56.530813 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00789e18-fa65-408a-8d5c-8b6a92a2115c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c237b14376444db7953ac83853e32c55)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:56.532766 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00789e18-fa65-408a-8d5c-8b6a92a2115c admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:56.778323 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:56.788098 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-00789e18-fa65-408a-8d5c-8b6a92a2115c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c237b14376444db7953ac83853e32c55'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:56.795947 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-00789e18-fa65-408a-8d5c-8b6a92a2115c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c237b14376444db7953ac83853e32c55'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:56.796641 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-00789e18-fa65-408a-8d5c-8b6a92a2115c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c237b14376444db7953ac83853e32c55'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:56.797244 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-00789e18-fa65-408a-8d5c-8b6a92a2115c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c237b14376444db7953ac83853e32c55'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:56.933263 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-00789e18-fa65-408a-8d5c-8b6a92a2115c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c237b14376444db7953ac83853e32c55'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:56.955045 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1280/2570] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:35:56 2022] DELETE /identity/v3/users/c237b14376444db7953ac83853e32c55 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:35:56.956980 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e497b57-86aa-4694-99d8-525bbc6fec3a None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:56.957465 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e497b57-86aa-4694-99d8-525bbc6fec3a None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:56.957577 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e497b57-86aa-4694-99d8-525bbc6fec3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:56.976992 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-3e497b57-86aa-4694-99d8-525bbc6fec3a None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:56.978296 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-3e497b57-86aa-4694-99d8-525bbc6fec3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:57.040860 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1291/2571] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:35:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:57.050690 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00789e18-fa65-408a-8d5c-8b6a92a2115c admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:57.052111 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-00789e18-fa65-408a-8d5c-8b6a92a2115c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:57.110919 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00789e18-fa65-408a-8d5c-8b6a92a2115c admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:57.121479 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f5fa04-fd13-4990-ba42-9aa45f9726e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:57.121479 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f5fa04-fd13-4990-ba42-9aa45f9726e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:57.121479 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f5fa04-fd13-4990-ba42-9aa45f9726e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:57.121479 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f5fa04-fd13-4990-ba42-9aa45f9726e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:57.126154 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f5fa04-fd13-4990-ba42-9aa45f9726e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:57.127634 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f5fa04-fd13-4990-ba42-9aa45f9726e1 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:57.138031 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1281/2572] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:35:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:35:57.586825 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e497b57-86aa-4694-99d8-525bbc6fec3a None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:57.588893 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-3e497b57-86aa-4694-99d8-525bbc6fec3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:57.604007 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e497b57-86aa-4694-99d8-525bbc6fec3a None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:57.608702 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a25c7c-c519-4d1d-9048-9c14f66400db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:57.610887 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a25c7c-c519-4d1d-9048-9c14f66400db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:57.611262 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a25c7c-c519-4d1d-9048-9c14f66400db admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:57.611440 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a25c7c-c519-4d1d-9048-9c14f66400db admin admin] PATH_INFO: `/v3/projects/06f42a876e1f42c8b070cec4ccff55d2` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:57.613067 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a25c7c-c519-4d1d-9048-9c14f66400db admin admin] RBAC: Authorizing `identity:delete_project(project_id=06f42a876e1f42c8b070cec4ccff55d2)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:57.616405 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a25c7c-c519-4d1d-9048-9c14f66400db admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:57.760458 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-d2a25c7c-c519-4d1d-9048-9c14f66400db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06f42a876e1f42c8b070cec4ccff55d2', 'request_id': 'req-d2a25c7c-c519-4d1d-9048-9c14f66400db'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:57.767053 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-d2a25c7c-c519-4d1d-9048-9c14f66400db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06f42a876e1f42c8b070cec4ccff55d2', 'request_id': 'req-d2a25c7c-c519-4d1d-9048-9c14f66400db'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:57.772897 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-d2a25c7c-c519-4d1d-9048-9c14f66400db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06f42a876e1f42c8b070cec4ccff55d2', 'request_id': 'req-d2a25c7c-c519-4d1d-9048-9c14f66400db'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:57.904998 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-d2a25c7c-c519-4d1d-9048-9c14f66400db admin admin] The token cache is being invalidate because project 06f42a876e1f42c8b070cec4ccff55d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80288) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:35:57.905286 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-d2a25c7c-c519-4d1d-9048-9c14f66400db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:57.905913 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-d2a25c7c-c519-4d1d-9048-9c14f66400db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:57.907562 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1292/2573] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:35:57 2022] DELETE /identity/v3/projects/06f42a876e1f42c8b070cec4ccff55d2 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:57.911552 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f5fa04-fd13-4990-ba42-9aa45f9726e1 service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:57.922133 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f5fa04-fd13-4990-ba42-9aa45f9726e1 service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:57.991424 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34400dae-e905-4b97-aa90-a9d98a895845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:57.992901 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34400dae-e905-4b97-aa90-a9d98a895845 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:57.993190 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34400dae-e905-4b97-aa90-a9d98a895845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:57.993475 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34400dae-e905-4b97-aa90-a9d98a895845 admin admin] PATH_INFO: `/v3/users/a505ce5ff8d24d7d8b680fa21e12c80b` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:57.995007 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34400dae-e905-4b97-aa90-a9d98a895845 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a505ce5ff8d24d7d8b680fa21e12c80b)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:57.998455 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34400dae-e905-4b97-aa90-a9d98a895845 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:58.215576 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-34400dae-e905-4b97-aa90-a9d98a895845 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a505ce5ff8d24d7d8b680fa21e12c80b'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:58.222354 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-34400dae-e905-4b97-aa90-a9d98a895845 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a505ce5ff8d24d7d8b680fa21e12c80b'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:58.223020 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-34400dae-e905-4b97-aa90-a9d98a895845 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a505ce5ff8d24d7d8b680fa21e12c80b'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:58.223708 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-34400dae-e905-4b97-aa90-a9d98a895845 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a505ce5ff8d24d7d8b680fa21e12c80b'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:58.225386 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:58.314962 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-34400dae-e905-4b97-aa90-a9d98a895845 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a505ce5ff8d24d7d8b680fa21e12c80b'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:58.339743 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1282/2574] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:35:57 2022] DELETE /identity/v3/users/a505ce5ff8d24d7d8b680fa21e12c80b => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:58.792139 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a25c7c-c519-4d1d-9048-9c14f66400db admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:58.793588 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-d2a25c7c-c519-4d1d-9048-9c14f66400db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:58.807481 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a25c7c-c519-4d1d-9048-9c14f66400db admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:58.866557 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4fbb9a-203e-4803-8e54-e92235b6677d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:58.867424 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4fbb9a-203e-4803-8e54-e92235b6677d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:58.867709 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4fbb9a-203e-4803-8e54-e92235b6677d admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:58.867989 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4fbb9a-203e-4803-8e54-e92235b6677d admin admin] PATH_INFO: `/v3/projects/d352d3f7b91e4c9784f539dbfec55906` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:58.869171 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4fbb9a-203e-4803-8e54-e92235b6677d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d352d3f7b91e4c9784f539dbfec55906)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:58.871110 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4fbb9a-203e-4803-8e54-e92235b6677d admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:58.893149 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:59.036910 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-5a4fbb9a-203e-4803-8e54-e92235b6677d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd352d3f7b91e4c9784f539dbfec55906', 'request_id': 'req-5a4fbb9a-203e-4803-8e54-e92235b6677d'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:59.043436 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-5a4fbb9a-203e-4803-8e54-e92235b6677d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd352d3f7b91e4c9784f539dbfec55906', 'request_id': 'req-5a4fbb9a-203e-4803-8e54-e92235b6677d'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:59.049276 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-5a4fbb9a-203e-4803-8e54-e92235b6677d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd352d3f7b91e4c9784f539dbfec55906', 'request_id': 'req-5a4fbb9a-203e-4803-8e54-e92235b6677d'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:59.149221 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-5a4fbb9a-203e-4803-8e54-e92235b6677d admin admin] The token cache is being invalidate because project d352d3f7b91e4c9784f539dbfec55906 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80288) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:35:59.149445 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-5a4fbb9a-203e-4803-8e54-e92235b6677d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:59.150451 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-5a4fbb9a-203e-4803-8e54-e92235b6677d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:59.157169 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1293/2575] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:35:58 2022] DELETE /identity/v3/projects/d352d3f7b91e4c9784f539dbfec55906 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:59.158191 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a6dfab-8a44-4128-abcc-bfe57495e89b None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:59.158656 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a6dfab-8a44-4128-abcc-bfe57495e89b None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:59.158804 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a6dfab-8a44-4128-abcc-bfe57495e89b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:59.177042 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-68a6dfab-8a44-4128-abcc-bfe57495e89b None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:59.178294 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-68a6dfab-8a44-4128-abcc-bfe57495e89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:59.236519 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1283/2576] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:35:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:35:59.244752 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2629a245-2ad3-45d1-be58-4617b9b0d85e None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:59.245045 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2629a245-2ad3-45d1-be58-4617b9b0d85e None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:59.245352 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2629a245-2ad3-45d1-be58-4617b9b0d85e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:59.265079 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-2629a245-2ad3-45d1-be58-4617b9b0d85e None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:59.266896 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-2629a245-2ad3-45d1-be58-4617b9b0d85e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:59.275138 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1294/2577] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:35:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:59.279318 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a6dfab-8a44-4128-abcc-bfe57495e89b None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:59.289007 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a6dfab-8a44-4128-abcc-bfe57495e89b None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:59.293615 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3e5659-d9e6-4d1b-ba2b-b644a5cd74fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:59.294275 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e5659-d9e6-4d1b-ba2b-b644a5cd74fb admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:59.294570 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e5659-d9e6-4d1b-ba2b-b644a5cd74fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:59.294845 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e5659-d9e6-4d1b-ba2b-b644a5cd74fb admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:59.295562 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3e5659-d9e6-4d1b-ba2b-b644a5cd74fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:35:59.295870 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3e5659-d9e6-4d1b-ba2b-b644a5cd74fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:59.297517 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3e5659-d9e6-4d1b-ba2b-b644a5cd74fb admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:59.309277 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1284/2578] 10.222.0.62 () {58 vars in 1152 bytes} [Fri May 27 16:35:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:35:59.313601 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2629a245-2ad3-45d1-be58-4617b9b0d85e None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:59.323381 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2629a245-2ad3-45d1-be58-4617b9b0d85e None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:59.328105 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2064ad3-925f-46f7-916a-f8dada9bca50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:59.328748 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2064ad3-925f-46f7-916a-f8dada9bca50 admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:59.329033 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2064ad3-925f-46f7-916a-f8dada9bca50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:59.329309 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2064ad3-925f-46f7-916a-f8dada9bca50 admin admin] PATH_INFO: `/v3/projects` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:59.329989 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2064ad3-925f-46f7-916a-f8dada9bca50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:59.331917 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2064ad3-925f-46f7-916a-f8dada9bca50 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:59.423369 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1295/2579] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:35:59 2022] POST /identity/v3/projects => generated 383 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:35:59.424702 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3e5659-d9e6-4d1b-ba2b-b644a5cd74fb admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:59.435450 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3e5659-d9e6-4d1b-ba2b-b644a5cd74fb admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:59.492398 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793a24f0-fd7c-4f4a-80f5-6b082b105b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:59.493117 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a24f0-fd7c-4f4a-80f5-6b082b105b48 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:59.493409 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a24f0-fd7c-4f4a-80f5-6b082b105b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:59.493693 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a24f0-fd7c-4f4a-80f5-6b082b105b48 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:59.494435 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793a24f0-fd7c-4f4a-80f5-6b082b105b48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:59.496367 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793a24f0-fd7c-4f4a-80f5-6b082b105b48 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:59.625135 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1285/2580] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:35:59 2022] POST /identity/v3/users => generated 292 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:35:59.630025 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2064ad3-925f-46f7-916a-f8dada9bca50 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:59.640285 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2064ad3-925f-46f7-916a-f8dada9bca50 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:59.644803 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b60fb-899f-4f33-ba76-d357acef0487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:59.645500 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b60fb-899f-4f33-ba76-d357acef0487 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:59.645794 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b60fb-899f-4f33-ba76-d357acef0487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:59.646075 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b60fb-899f-4f33-ba76-d357acef0487 admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:59.646914 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02b60fb-899f-4f33-ba76-d357acef0487 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:59.648526 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02b60fb-899f-4f33-ba76-d357acef0487 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:59.658595 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1296/2581] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:35:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:35:59.662383 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793a24f0-fd7c-4f4a-80f5-6b082b105b48 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:59.672715 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793a24f0-fd7c-4f4a-80f5-6b082b105b48 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:59.677472 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffb679c-e68e-47ca-a5c6-96b749ccd924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:59.678127 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb679c-e68e-47ca-a5c6-96b749ccd924 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:59.678451 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb679c-e68e-47ca-a5c6-96b749ccd924 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:59.678736 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb679c-e68e-47ca-a5c6-96b749ccd924 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:59.680377 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffb679c-e68e-47ca-a5c6-96b749ccd924 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:59.682677 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffb679c-e68e-47ca-a5c6-96b749ccd924 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:59.702866 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1286/2582] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:35:59 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 16:35:59.707226 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b60fb-899f-4f33-ba76-d357acef0487 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:59.717298 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b60fb-899f-4f33-ba76-d357acef0487 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:59.721862 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da423cf5-878e-41dc-9b1a-f28f20afc76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:59.722790 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da423cf5-878e-41dc-9b1a-f28f20afc76e admin admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:59.723077 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da423cf5-878e-41dc-9b1a-f28f20afc76e admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:59.723357 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da423cf5-878e-41dc-9b1a-f28f20afc76e admin admin] PATH_INFO: `/v3/projects/ac362d9f70b140979fcd03eae4a6c423/users/8e7245335db240beb917d7b05b3c1e95/roles/c8ce6d197f654598ac45f6016ecccabd` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:59.738988 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da423cf5-878e-41dc-9b1a-f28f20afc76e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac362d9f70b140979fcd03eae4a6c423, user_id=8e7245335db240beb917d7b05b3c1e95, role_id=c8ce6d197f654598ac45f6016ecccabd)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:59.741672 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da423cf5-878e-41dc-9b1a-f28f20afc76e admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:59.859859 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1297/2583] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:35:59 2022] PUT /identity/v3/projects/ac362d9f70b140979fcd03eae4a6c423/users/8e7245335db240beb917d7b05b3c1e95/roles/c8ce6d197f654598ac45f6016ecccabd => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:59.871149 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76cb97-28d1-41ac-9025-d12e40726cad None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:59.871442 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76cb97-28d1-41ac-9025-d12e40726cad None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:59.871722 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76cb97-28d1-41ac-9025-d12e40726cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:59.897590 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-ab76cb97-28d1-41ac-9025-d12e40726cad None None] MFA Rules not processed for user `8e7245335db240beb917d7b05b3c1e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:59.899352 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-ab76cb97-28d1-41ac-9025-d12e40726cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:59.928613 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:59.962132 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1287/2584] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:35:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:59.966742 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da423cf5-878e-41dc-9b1a-f28f20afc76e admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:00.029485 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da423cf5-878e-41dc-9b1a-f28f20afc76e admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:00.034204 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ca61e8-ada7-463b-9f86-1e7936b30838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:00.034881 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca61e8-ada7-463b-9f86-1e7936b30838 admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:00.035529 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca61e8-ada7-463b-9f86-1e7936b30838 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:00.035529 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca61e8-ada7-463b-9f86-1e7936b30838 admin admin] PATH_INFO: `/v3/projects` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:00.036174 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ca61e8-ada7-463b-9f86-1e7936b30838 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:00.038114 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ca61e8-ada7-463b-9f86-1e7936b30838 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:00.124281 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab76cb97-28d1-41ac-9025-d12e40726cad None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:00.125958 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-ab76cb97-28d1-41ac-9025-d12e40726cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:00.137421 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1298/2585] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:35:59 2022] POST /identity/v3/projects => generated 383 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:36:00.140918 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab76cb97-28d1-41ac-9025-d12e40726cad None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:00.141552 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ca61e8-ada7-463b-9f86-1e7936b30838 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:00.163490 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:00.203415 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b560820b-c079-4b22-8eca-522315db3322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:00.204415 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b560820b-c079-4b22-8eca-522315db3322 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:00.204702 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b560820b-c079-4b22-8eca-522315db3322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:00.205028 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b560820b-c079-4b22-8eca-522315db3322 admin admin] PATH_INFO: `/v3/users/75c6ee8fb26b457aa73a6965308fc59d` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:00.206232 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b560820b-c079-4b22-8eca-522315db3322 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75c6ee8fb26b457aa73a6965308fc59d)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:00.207466 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ca61e8-ada7-463b-9f86-1e7936b30838 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:00.208266 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b560820b-c079-4b22-8eca-522315db3322 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:00.213367 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13326b8c-8e1f-4d7d-95c6-17b03e93c9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:00.214098 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13326b8c-8e1f-4d7d-95c6-17b03e93c9f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:00.214542 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13326b8c-8e1f-4d7d-95c6-17b03e93c9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:00.214832 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13326b8c-8e1f-4d7d-95c6-17b03e93c9f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:00.215527 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13326b8c-8e1f-4d7d-95c6-17b03e93c9f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:00.217454 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13326b8c-8e1f-4d7d-95c6-17b03e93c9f8 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:00.335269 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1299/2586] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:36:00 2022] POST /identity/v3/users => generated 298 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:36:00.338900 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13326b8c-8e1f-4d7d-95c6-17b03e93c9f8 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:00.348824 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13326b8c-8e1f-4d7d-95c6-17b03e93c9f8 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:00.353564 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0622c0b8-a88f-4d2f-bf94-63097187603b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:00.354213 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0622c0b8-a88f-4d2f-bf94-63097187603b admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:00.354548 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0622c0b8-a88f-4d2f-bf94-63097187603b admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:00.354861 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0622c0b8-a88f-4d2f-bf94-63097187603b admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:00.355630 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0622c0b8-a88f-4d2f-bf94-63097187603b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:00.357231 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0622c0b8-a88f-4d2f-bf94-63097187603b admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:00.367764 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1300/2587] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:36:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 16:36:00.371789 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0622c0b8-a88f-4d2f-bf94-63097187603b admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:00.381504 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0622c0b8-a88f-4d2f-bf94-63097187603b admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:00.386618 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0390367e-d78e-42bd-98f8-3220be7ca22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:00.387460 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390367e-d78e-42bd-98f8-3220be7ca22e admin admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:00.387743 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390367e-d78e-42bd-98f8-3220be7ca22e admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:00.388018 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390367e-d78e-42bd-98f8-3220be7ca22e admin admin] PATH_INFO: `/v3/projects/99fe029e7a9e48deb6b269377ac99372/users/be78a76d018041c78af3c04e1d47ca6a/roles/e04fe3eb1f714d74901ac83e33ea8a16` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:00.403029 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0390367e-d78e-42bd-98f8-3220be7ca22e admin admin] RBAC: Authorizing `identity:create_grant(project_id=99fe029e7a9e48deb6b269377ac99372, user_id=be78a76d018041c78af3c04e1d47ca6a, role_id=e04fe3eb1f714d74901ac83e33ea8a16)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:00.405672 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0390367e-d78e-42bd-98f8-3220be7ca22e admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:00.505364 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1301/2588] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:36:00 2022] PUT /identity/v3/projects/99fe029e7a9e48deb6b269377ac99372/users/be78a76d018041c78af3c04e1d47ca6a/roles/e04fe3eb1f714d74901ac83e33ea8a16 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:36:00.509815 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0390367e-d78e-42bd-98f8-3220be7ca22e admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:00.514162 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b560820b-c079-4b22-8eca-522315db3322 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75c6ee8fb26b457aa73a6965308fc59d'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:00.522786 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b560820b-c079-4b22-8eca-522315db3322 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75c6ee8fb26b457aa73a6965308fc59d'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:00.523471 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b560820b-c079-4b22-8eca-522315db3322 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75c6ee8fb26b457aa73a6965308fc59d'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:00.524081 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b560820b-c079-4b22-8eca-522315db3322 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75c6ee8fb26b457aa73a6965308fc59d'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:00.569320 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0390367e-d78e-42bd-98f8-3220be7ca22e admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:00.574637 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973e62c2-9ecc-47a4-aed5-7bb0304ff982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:00.575295 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e62c2-9ecc-47a4-aed5-7bb0304ff982 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:00.575580 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e62c2-9ecc-47a4-aed5-7bb0304ff982 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:00.575856 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e62c2-9ecc-47a4-aed5-7bb0304ff982 admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:00.576575 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973e62c2-9ecc-47a4-aed5-7bb0304ff982 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:00.578166 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973e62c2-9ecc-47a4-aed5-7bb0304ff982 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:00.589112 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1302/2589] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:36:00 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 16:36:00.593186 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973e62c2-9ecc-47a4-aed5-7bb0304ff982 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:00.594905 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-973e62c2-9ecc-47a4-aed5-7bb0304ff982 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:00.607028 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973e62c2-9ecc-47a4-aed5-7bb0304ff982 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:00.611658 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bbf465-b867-456d-a940-78f8087aacab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:00.612459 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bbf465-b867-456d-a940-78f8087aacab admin admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:00.612741 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bbf465-b867-456d-a940-78f8087aacab admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:00.613020 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bbf465-b867-456d-a940-78f8087aacab admin admin] PATH_INFO: `/v3/projects/99fe029e7a9e48deb6b269377ac99372/users/be78a76d018041c78af3c04e1d47ca6a/roles/e04fe3eb1f714d74901ac83e33ea8a16` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:00.614975 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bbf465-b867-456d-a940-78f8087aacab admin admin] RBAC: Authorizing `identity:create_grant(project_id=99fe029e7a9e48deb6b269377ac99372, user_id=be78a76d018041c78af3c04e1d47ca6a, role_id=e04fe3eb1f714d74901ac83e33ea8a16)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:00.618074 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bbf465-b867-456d-a940-78f8087aacab admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:00.619268 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b560820b-c079-4b22-8eca-522315db3322 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75c6ee8fb26b457aa73a6965308fc59d'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:00.629643 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1303/2590] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:36:00 2022] PUT /identity/v3/projects/99fe029e7a9e48deb6b269377ac99372/users/be78a76d018041c78af3c04e1d47ca6a/roles/e04fe3eb1f714d74901ac83e33ea8a16 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:36:00.638406 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1288/2591] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:36:00 2022] DELETE /identity/v3/users/75c6ee8fb26b457aa73a6965308fc59d => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:36:00.640312 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea24f5-8a05-4b1b-b18f-9cb33c1c9599 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:00.640703 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea24f5-8a05-4b1b-b18f-9cb33c1c9599 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:00.641200 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea24f5-8a05-4b1b-b18f-9cb33c1c9599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:00.642534 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf7b8da-da49-402f-bce6-533bfb550797 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:00.642828 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf7b8da-da49-402f-bce6-533bfb550797 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:00.643111 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf7b8da-da49-402f-bce6-533bfb550797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:00.660050 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-bdf7b8da-da49-402f-bce6-533bfb550797 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:36:00.662269 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-bdf7b8da-da49-402f-bce6-533bfb550797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:00.669128 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-acea24f5-8a05-4b1b-b18f-9cb33c1c9599 None None] MFA Rules not processed for user `be78a76d018041c78af3c04e1d47ca6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:36:00.670362 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-acea24f5-8a05-4b1b-b18f-9cb33c1c9599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:00.707154 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:00.717314 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:00.722605 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1289/2592] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:36:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:36:00.732273 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf7b8da-da49-402f-bce6-533bfb550797 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:00.733636 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-bdf7b8da-da49-402f-bce6-533bfb550797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:00.740989 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1304/2593] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:36:00 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:36:00.752940 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acea24f5-8a05-4b1b-b18f-9cb33c1c9599 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:00.754409 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-acea24f5-8a05-4b1b-b18f-9cb33c1c9599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:00.795777 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf7b8da-da49-402f-bce6-533bfb550797 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:00.800951 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e89c9d3-a84a-4680-a5ab-d66dcb014e08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:00.800951 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e89c9d3-a84a-4680-a5ab-d66dcb014e08 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:00.800951 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e89c9d3-a84a-4680-a5ab-d66dcb014e08 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:00.800951 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e89c9d3-a84a-4680-a5ab-d66dcb014e08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:00.810204 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e89c9d3-a84a-4680-a5ab-d66dcb014e08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:00.811739 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e89c9d3-a84a-4680-a5ab-d66dcb014e08 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:00.812584 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acea24f5-8a05-4b1b-b18f-9cb33c1c9599 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:00.816259 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe369aa-1966-404e-b0b7-accdbd2415cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8693a1e72f14fdfb383f11e96330726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:00.816912 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe369aa-1966-404e-b0b7-accdbd2415cc service cinder] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:00.817197 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe369aa-1966-404e-b0b7-accdbd2415cc service cinder] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:00.817492 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe369aa-1966-404e-b0b7-accdbd2415cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:00.822235 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1290/2594] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:36:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 16:36:00.827949 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe369aa-1966-404e-b0b7-accdbd2415cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:00.829413 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe369aa-1966-404e-b0b7-accdbd2415cc service cinder] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:00.841142 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1305/2595] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:36:00 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 16:36:00.945238 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e89c9d3-a84a-4680-a5ab-d66dcb014e08 service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:00.954531 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e89c9d3-a84a-4680-a5ab-d66dcb014e08 service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:00.958178 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93652349-3d52-4890-8927-aa9a7e8f820d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8693a1e72f14fdfb383f11e96330726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:00.958825 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93652349-3d52-4890-8927-aa9a7e8f820d service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:00.959117 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93652349-3d52-4890-8927-aa9a7e8f820d service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:00.959396 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93652349-3d52-4890-8927-aa9a7e8f820d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:00.961219 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-93652349-3d52-4890-8927-aa9a7e8f820d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:01.019736 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93652349-3d52-4890-8927-aa9a7e8f820d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:01.021203 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93652349-3d52-4890-8927-aa9a7e8f820d service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:01.030562 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1291/2596] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:36:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:36:01.279911 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe369aa-1966-404e-b0b7-accdbd2415cc service cinder] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:01.281471 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-9fe369aa-1966-404e-b0b7-accdbd2415cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:01.296231 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe369aa-1966-404e-b0b7-accdbd2415cc service cinder] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:01.303693 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2026f0-b539-4eaf-886a-91eee3a62e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:01.304596 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2026f0-b539-4eaf-886a-91eee3a62e79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:01.304875 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2026f0-b539-4eaf-886a-91eee3a62e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:01.305168 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2026f0-b539-4eaf-886a-91eee3a62e79 admin admin] PATH_INFO: `/v3/projects/ad063d8fed494f82af42d6b8150d27fb` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:01.306356 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2026f0-b539-4eaf-886a-91eee3a62e79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad063d8fed494f82af42d6b8150d27fb)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:01.311220 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2026f0-b539-4eaf-886a-91eee3a62e79 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:01.454420 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-bd2026f0-b539-4eaf-886a-91eee3a62e79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad063d8fed494f82af42d6b8150d27fb', 'request_id': 'req-bd2026f0-b539-4eaf-886a-91eee3a62e79'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:01.461760 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-bd2026f0-b539-4eaf-886a-91eee3a62e79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad063d8fed494f82af42d6b8150d27fb', 'request_id': 'req-bd2026f0-b539-4eaf-886a-91eee3a62e79'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:01.467862 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-bd2026f0-b539-4eaf-886a-91eee3a62e79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad063d8fed494f82af42d6b8150d27fb', 'request_id': 'req-bd2026f0-b539-4eaf-886a-91eee3a62e79'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:01.546393 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-bd2026f0-b539-4eaf-886a-91eee3a62e79 admin admin] The token cache is being invalidate because project ad063d8fed494f82af42d6b8150d27fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80288) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:36:01.546393 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-bd2026f0-b539-4eaf-886a-91eee3a62e79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:01.546393 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-bd2026f0-b539-4eaf-886a-91eee3a62e79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:01.546393 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1306/2597] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:36:01 2022] DELETE /identity/v3/projects/ad063d8fed494f82af42d6b8150d27fb => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:36:01.549112 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93652349-3d52-4890-8927-aa9a7e8f820d service cinder] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:01.559592 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93652349-3d52-4890-8927-aa9a7e8f820d service cinder] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:01.618481 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13952f0-5e6b-4540-99d6-4d150a6b1748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:01.619354 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13952f0-5e6b-4540-99d6-4d150a6b1748 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:01.619642 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13952f0-5e6b-4540-99d6-4d150a6b1748 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:01.619924 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13952f0-5e6b-4540-99d6-4d150a6b1748 admin admin] PATH_INFO: `/v3/users/6b059530d9624b4d8014897a7d59d02c` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:01.621104 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13952f0-5e6b-4540-99d6-4d150a6b1748 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b059530d9624b4d8014897a7d59d02c)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:01.623052 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13952f0-5e6b-4540-99d6-4d150a6b1748 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:01.826661 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:01.838996 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-a13952f0-5e6b-4540-99d6-4d150a6b1748 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b059530d9624b4d8014897a7d59d02c'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:01.846158 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-a13952f0-5e6b-4540-99d6-4d150a6b1748 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b059530d9624b4d8014897a7d59d02c'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:01.846873 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-a13952f0-5e6b-4540-99d6-4d150a6b1748 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b059530d9624b4d8014897a7d59d02c'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:01.847506 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-a13952f0-5e6b-4540-99d6-4d150a6b1748 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b059530d9624b4d8014897a7d59d02c'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:01.927791 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-a13952f0-5e6b-4540-99d6-4d150a6b1748 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b059530d9624b4d8014897a7d59d02c'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:01.946621 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1292/2598] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:36:01 2022] DELETE /identity/v3/users/6b059530d9624b4d8014897a7d59d02c => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:36:02.419453 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2026f0-b539-4eaf-886a-91eee3a62e79 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:02.420918 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-bd2026f0-b539-4eaf-886a-91eee3a62e79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:02.434394 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2026f0-b539-4eaf-886a-91eee3a62e79 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:02.491953 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b796e-edda-4de1-bced-ee2bd06708aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:02.492814 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b796e-edda-4de1-bced-ee2bd06708aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:02.493100 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b796e-edda-4de1-bced-ee2bd06708aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:02.493378 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b796e-edda-4de1-bced-ee2bd06708aa admin admin] PATH_INFO: `/v3/projects/84529adaa61c4bf5b5f51989cc0772d5` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:02.494591 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b796e-edda-4de1-bced-ee2bd06708aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=84529adaa61c4bf5b5f51989cc0772d5)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:02.496644 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b796e-edda-4de1-bced-ee2bd06708aa admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:02.507804 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:02.751312 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-9c9b796e-edda-4de1-bced-ee2bd06708aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84529adaa61c4bf5b5f51989cc0772d5', 'request_id': 'req-9c9b796e-edda-4de1-bced-ee2bd06708aa'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:02.758239 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-9c9b796e-edda-4de1-bced-ee2bd06708aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84529adaa61c4bf5b5f51989cc0772d5', 'request_id': 'req-9c9b796e-edda-4de1-bced-ee2bd06708aa'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:02.763782 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-9c9b796e-edda-4de1-bced-ee2bd06708aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84529adaa61c4bf5b5f51989cc0772d5', 'request_id': 'req-9c9b796e-edda-4de1-bced-ee2bd06708aa'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:02.853220 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-9c9b796e-edda-4de1-bced-ee2bd06708aa admin admin] The token cache is being invalidate because project 84529adaa61c4bf5b5f51989cc0772d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80288) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:36:02.855615 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-9c9b796e-edda-4de1-bced-ee2bd06708aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:02.855615 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-9c9b796e-edda-4de1-bced-ee2bd06708aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:02.855877 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1307/2599] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:36:02 2022] DELETE /identity/v3/projects/84529adaa61c4bf5b5f51989cc0772d5 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:36:02.861828 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc753a-85dc-4a4c-a676-a430aab75352 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:02.862336 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc753a-85dc-4a4c-a676-a430aab75352 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:02.862428 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc753a-85dc-4a4c-a676-a430aab75352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:02.888763 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-53fc753a-85dc-4a4c-a676-a430aab75352 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:36:02.890028 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-53fc753a-85dc-4a4c-a676-a430aab75352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:02.953494 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1293/2600] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:36:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:36:02.961516 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b98dc-e4d1-496f-bc08-858b5212a576 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:02.961812 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b98dc-e4d1-496f-bc08-858b5212a576 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:02.962093 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b98dc-e4d1-496f-bc08-858b5212a576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:02.980376 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-124b98dc-e4d1-496f-bc08-858b5212a576 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:36:02.981600 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-124b98dc-e4d1-496f-bc08-858b5212a576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:02.989647 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1308/2601] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:36:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:36:02.994305 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc753a-85dc-4a4c-a676-a430aab75352 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:03.004496 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc753a-85dc-4a4c-a676-a430aab75352 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:03.009770 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba97926-edf4-4922-92c3-10bdb6111f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:03.010467 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba97926-edf4-4922-92c3-10bdb6111f0f admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:03.010755 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba97926-edf4-4922-92c3-10bdb6111f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:03.011058 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba97926-edf4-4922-92c3-10bdb6111f0f admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:03.011783 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba97926-edf4-4922-92c3-10bdb6111f0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:36:03.012094 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba97926-edf4-4922-92c3-10bdb6111f0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:03.013715 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba97926-edf4-4922-92c3-10bdb6111f0f admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:03.026193 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1294/2602] 10.222.0.62 () {58 vars in 1152 bytes} [Fri May 27 16:36:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:36:03.030754 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124b98dc-e4d1-496f-bc08-858b5212a576 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:03.040394 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124b98dc-e4d1-496f-bc08-858b5212a576 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:03.045081 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ace0314-d454-43f2-abb4-b1b839a052be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:03.045740 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace0314-d454-43f2-abb4-b1b839a052be admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:03.046078 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace0314-d454-43f2-abb4-b1b839a052be admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:03.046370 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace0314-d454-43f2-abb4-b1b839a052be admin admin] PATH_INFO: `/v3/projects` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:03.047127 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ace0314-d454-43f2-abb4-b1b839a052be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:03.049067 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ace0314-d454-43f2-abb4-b1b839a052be admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:03.193274 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1309/2603] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:36:03 2022] POST /identity/v3/projects => generated 375 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:36:03.197537 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba97926-edf4-4922-92c3-10bdb6111f0f admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:03.213395 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba97926-edf4-4922-92c3-10bdb6111f0f admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:03.272048 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe251f-1c61-4bd8-a697-07aaea0449c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:03.272813 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe251f-1c61-4bd8-a697-07aaea0449c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:03.273102 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe251f-1c61-4bd8-a697-07aaea0449c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:03.273379 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe251f-1c61-4bd8-a697-07aaea0449c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:03.274069 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfe251f-1c61-4bd8-a697-07aaea0449c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:03.276180 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfe251f-1c61-4bd8-a697-07aaea0449c9 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:03.420517 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1295/2604] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:36:03 2022] POST /identity/v3/users => generated 288 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:36:03.424835 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ace0314-d454-43f2-abb4-b1b839a052be admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:03.436496 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ace0314-d454-43f2-abb4-b1b839a052be admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:03.441487 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c730b4e-78f4-4d42-8542-45e5d2b0a2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:03.442347 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c730b4e-78f4-4d42-8542-45e5d2b0a2c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:03.446158 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c730b4e-78f4-4d42-8542-45e5d2b0a2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:03.446158 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c730b4e-78f4-4d42-8542-45e5d2b0a2c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:03.446158 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c730b4e-78f4-4d42-8542-45e5d2b0a2c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:03.446158 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c730b4e-78f4-4d42-8542-45e5d2b0a2c6 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:03.461821 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1310/2605] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:36:03 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:36:03.462023 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe251f-1c61-4bd8-a697-07aaea0449c9 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:03.475095 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe251f-1c61-4bd8-a697-07aaea0449c9 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:03.479730 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d51f28a-02d7-4c54-bdf9-c52140491edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:03.480402 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51f28a-02d7-4c54-bdf9-c52140491edb admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:03.480741 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51f28a-02d7-4c54-bdf9-c52140491edb admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:03.481025 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51f28a-02d7-4c54-bdf9-c52140491edb admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:03.481759 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d51f28a-02d7-4c54-bdf9-c52140491edb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:03.483403 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d51f28a-02d7-4c54-bdf9-c52140491edb admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:03.494464 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1296/2606] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:36:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 16:36:03.498813 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c730b4e-78f4-4d42-8542-45e5d2b0a2c6 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:03.509245 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c730b4e-78f4-4d42-8542-45e5d2b0a2c6 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:03.513857 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f2bd4-db39-4cd1-8fb4-d81929a6b42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:03.514825 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f2bd4-db39-4cd1-8fb4-d81929a6b42c admin admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:03.515123 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f2bd4-db39-4cd1-8fb4-d81929a6b42c admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:03.515405 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f2bd4-db39-4cd1-8fb4-d81929a6b42c admin admin] PATH_INFO: `/v3/projects/b7ea13bf0cb3479585e59d092cba8294/users/a239c638f1724839898cae77cf8e83df/roles/c8ce6d197f654598ac45f6016ecccabd` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:03.530812 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8f2bd4-db39-4cd1-8fb4-d81929a6b42c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7ea13bf0cb3479585e59d092cba8294, user_id=a239c638f1724839898cae77cf8e83df, role_id=c8ce6d197f654598ac45f6016ecccabd)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:03.533567 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8f2bd4-db39-4cd1-8fb4-d81929a6b42c admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:03.654629 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1311/2607] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:36:03 2022] PUT /identity/v3/projects/b7ea13bf0cb3479585e59d092cba8294/users/a239c638f1724839898cae77cf8e83df/roles/c8ce6d197f654598ac45f6016ecccabd => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:36:03.665611 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69703d29-61d5-4df9-a24f-87da65a253cf None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:03.665957 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69703d29-61d5-4df9-a24f-87da65a253cf None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:03.666262 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69703d29-61d5-4df9-a24f-87da65a253cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:03.693438 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-69703d29-61d5-4df9-a24f-87da65a253cf None None] MFA Rules not processed for user `a239c638f1724839898cae77cf8e83df`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:36:03.694618 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-69703d29-61d5-4df9-a24f-87da65a253cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:03.698788 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:03.774695 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1297/2608] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:36:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:36:03.785820 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f2bd4-db39-4cd1-8fb4-d81929a6b42c admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:03.787683 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-5f8f2bd4-db39-4cd1-8fb4-d81929a6b42c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:03.869047 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f2bd4-db39-4cd1-8fb4-d81929a6b42c admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:03.881851 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a38ec3-5e14-4b57-855b-491169e0a32a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b072079733049e8ac204ebe5cc635ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:03.887223 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a38ec3-5e14-4b57-855b-491169e0a32a service glance] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:03.887730 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a38ec3-5e14-4b57-855b-491169e0a32a service glance] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:03.888087 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a38ec3-5e14-4b57-855b-491169e0a32a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:03.901395 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a38ec3-5e14-4b57-855b-491169e0a32a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:03.903770 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a38ec3-5e14-4b57-855b-491169e0a32a service glance] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:03.908236 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69703d29-61d5-4df9-a24f-87da65a253cf None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:03.909729 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-69703d29-61d5-4df9-a24f-87da65a253cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:03.948773 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1312/2609] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:36:03 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:36:04.056449 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69703d29-61d5-4df9-a24f-87da65a253cf None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:04.064215 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fc9603-30dd-4637-a775-0599d545cd9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb13ad6d8b1e46029262556bff398796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:04.065683 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc9603-30dd-4637-a775-0599d545cd9b service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:04.065977 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc9603-30dd-4637-a775-0599d545cd9b service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:04.066285 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc9603-30dd-4637-a775-0599d545cd9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:04.068570 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-54fc9603-30dd-4637-a775-0599d545cd9b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:04.082622 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fc9603-30dd-4637-a775-0599d545cd9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:04.084251 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fc9603-30dd-4637-a775-0599d545cd9b service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:04.103023 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1298/2610] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:36:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:36:04.177204 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a38ec3-5e14-4b57-855b-491169e0a32a service glance] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:04.180598 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-71a38ec3-5e14-4b57-855b-491169e0a32a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:04.280822 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:04.312175 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a38ec3-5e14-4b57-855b-491169e0a32a service glance] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:04.317429 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94947d9d-04dd-48b8-b832-8b79744fbe4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:04.318350 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94947d9d-04dd-48b8-b832-8b79744fbe4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:04.318720 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94947d9d-04dd-48b8-b832-8b79744fbe4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:04.319021 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94947d9d-04dd-48b8-b832-8b79744fbe4e admin admin] PATH_INFO: `/v3/users/8e7245335db240beb917d7b05b3c1e95` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:04.320789 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94947d9d-04dd-48b8-b832-8b79744fbe4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e7245335db240beb917d7b05b3c1e95)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:04.322774 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94947d9d-04dd-48b8-b832-8b79744fbe4e admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:04.596650 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-94947d9d-04dd-48b8-b832-8b79744fbe4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e7245335db240beb917d7b05b3c1e95'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:04.611096 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-94947d9d-04dd-48b8-b832-8b79744fbe4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e7245335db240beb917d7b05b3c1e95'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:04.611909 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-94947d9d-04dd-48b8-b832-8b79744fbe4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e7245335db240beb917d7b05b3c1e95'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:04.612498 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-94947d9d-04dd-48b8-b832-8b79744fbe4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e7245335db240beb917d7b05b3c1e95'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:04.688781 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-94947d9d-04dd-48b8-b832-8b79744fbe4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e7245335db240beb917d7b05b3c1e95'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:04.711605 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1313/2611] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:36:04 2022] DELETE /identity/v3/users/8e7245335db240beb917d7b05b3c1e95 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:36:04.717409 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f4b46-369b-469c-8dba-4ce9eee51537 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:04.717723 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f4b46-369b-469c-8dba-4ce9eee51537 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:04.717999 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f4b46-369b-469c-8dba-4ce9eee51537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:04.736472 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-088f4b46-369b-469c-8dba-4ce9eee51537 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:36:04.737928 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-088f4b46-369b-469c-8dba-4ce9eee51537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:04.811439 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1299/2612] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:36:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:36:04.822609 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94947d9d-04dd-48b8-b832-8b79744fbe4e admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:04.824584 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-94947d9d-04dd-48b8-b832-8b79744fbe4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:04.894734 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94947d9d-04dd-48b8-b832-8b79744fbe4e admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:04.899517 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746f86c9-3a08-47a3-a1de-5f42b53ff92f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:04.900170 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746f86c9-3a08-47a3-a1de-5f42b53ff92f service neutron] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:04.900456 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746f86c9-3a08-47a3-a1de-5f42b53ff92f service neutron] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:04.900734 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746f86c9-3a08-47a3-a1de-5f42b53ff92f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:04.913582 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746f86c9-3a08-47a3-a1de-5f42b53ff92f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:04.915446 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746f86c9-3a08-47a3-a1de-5f42b53ff92f service neutron] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:04.928256 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1314/2613] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:36:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:36:05.515275 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088f4b46-369b-469c-8dba-4ce9eee51537 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:05.515275 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-088f4b46-369b-469c-8dba-4ce9eee51537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:05.529018 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088f4b46-369b-469c-8dba-4ce9eee51537 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:05.534066 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093235f0-2c11-4a5a-9a67-ba318f96d19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:05.535065 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093235f0-2c11-4a5a-9a67-ba318f96d19f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:05.535421 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093235f0-2c11-4a5a-9a67-ba318f96d19f admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:05.535774 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093235f0-2c11-4a5a-9a67-ba318f96d19f admin admin] PATH_INFO: `/v3/projects/ac362d9f70b140979fcd03eae4a6c423` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:05.537094 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093235f0-2c11-4a5a-9a67-ba318f96d19f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac362d9f70b140979fcd03eae4a6c423)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:05.539741 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093235f0-2c11-4a5a-9a67-ba318f96d19f admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:05.653870 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:05.674737 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-093235f0-2c11-4a5a-9a67-ba318f96d19f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac362d9f70b140979fcd03eae4a6c423', 'request_id': 'req-093235f0-2c11-4a5a-9a67-ba318f96d19f'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:05.682154 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-093235f0-2c11-4a5a-9a67-ba318f96d19f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac362d9f70b140979fcd03eae4a6c423', 'request_id': 'req-093235f0-2c11-4a5a-9a67-ba318f96d19f'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:05.765874 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-093235f0-2c11-4a5a-9a67-ba318f96d19f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac362d9f70b140979fcd03eae4a6c423', 'request_id': 'req-093235f0-2c11-4a5a-9a67-ba318f96d19f'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:05.784357 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-093235f0-2c11-4a5a-9a67-ba318f96d19f admin admin] The token cache is being invalidate because project ac362d9f70b140979fcd03eae4a6c423 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:36:05.785313 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-093235f0-2c11-4a5a-9a67-ba318f96d19f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:05.786329 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-093235f0-2c11-4a5a-9a67-ba318f96d19f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:05.789474 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1300/2614] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:36:05 2022] DELETE /identity/v3/projects/ac362d9f70b140979fcd03eae4a6c423 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:36:05.794053 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746f86c9-3a08-47a3-a1de-5f42b53ff92f service neutron] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:05.805552 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746f86c9-3a08-47a3-a1de-5f42b53ff92f service neutron] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:05.876037 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af656d17-b884-4011-9f29-a0dea7e27b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:05.877065 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af656d17-b884-4011-9f29-a0dea7e27b90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:05.877350 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af656d17-b884-4011-9f29-a0dea7e27b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:05.877627 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af656d17-b884-4011-9f29-a0dea7e27b90 admin admin] PATH_INFO: `/v3/users/be78a76d018041c78af3c04e1d47ca6a` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:05.878857 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af656d17-b884-4011-9f29-a0dea7e27b90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be78a76d018041c78af3c04e1d47ca6a)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:05.880783 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af656d17-b884-4011-9f29-a0dea7e27b90 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:05.882826 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:06.125012 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-af656d17-b884-4011-9f29-a0dea7e27b90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be78a76d018041c78af3c04e1d47ca6a'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:06.138331 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-af656d17-b884-4011-9f29-a0dea7e27b90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be78a76d018041c78af3c04e1d47ca6a'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:06.139187 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-af656d17-b884-4011-9f29-a0dea7e27b90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be78a76d018041c78af3c04e1d47ca6a'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:06.140440 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-af656d17-b884-4011-9f29-a0dea7e27b90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be78a76d018041c78af3c04e1d47ca6a'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:06.277540 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-af656d17-b884-4011-9f29-a0dea7e27b90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be78a76d018041c78af3c04e1d47ca6a'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:06.293171 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1315/2615] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:36:05 2022] DELETE /identity/v3/users/be78a76d018041c78af3c04e1d47ca6a => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:36:06.936317 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093235f0-2c11-4a5a-9a67-ba318f96d19f admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:06.937801 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-093235f0-2c11-4a5a-9a67-ba318f96d19f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:06.954805 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093235f0-2c11-4a5a-9a67-ba318f96d19f admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:07.018497 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c63ce4-555d-4dbe-b7ba-c1738e9b0539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:07.019363 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c63ce4-555d-4dbe-b7ba-c1738e9b0539 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:07.019648 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c63ce4-555d-4dbe-b7ba-c1738e9b0539 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:07.019927 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c63ce4-555d-4dbe-b7ba-c1738e9b0539 admin admin] PATH_INFO: `/v3/projects/99fe029e7a9e48deb6b269377ac99372` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:07.022094 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c63ce4-555d-4dbe-b7ba-c1738e9b0539 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99fe029e7a9e48deb6b269377ac99372)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:07.023715 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c63ce4-555d-4dbe-b7ba-c1738e9b0539 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:07.215076 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-19c63ce4-555d-4dbe-b7ba-c1738e9b0539 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99fe029e7a9e48deb6b269377ac99372', 'request_id': 'req-19c63ce4-555d-4dbe-b7ba-c1738e9b0539'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:07.221364 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-19c63ce4-555d-4dbe-b7ba-c1738e9b0539 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99fe029e7a9e48deb6b269377ac99372', 'request_id': 'req-19c63ce4-555d-4dbe-b7ba-c1738e9b0539'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:07.396663 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-19c63ce4-555d-4dbe-b7ba-c1738e9b0539 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99fe029e7a9e48deb6b269377ac99372', 'request_id': 'req-19c63ce4-555d-4dbe-b7ba-c1738e9b0539'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:07.408719 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-19c63ce4-555d-4dbe-b7ba-c1738e9b0539 admin admin] The token cache is being invalidate because project 99fe029e7a9e48deb6b269377ac99372 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:36:07.409096 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-19c63ce4-555d-4dbe-b7ba-c1738e9b0539 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:07.409833 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-19c63ce4-555d-4dbe-b7ba-c1738e9b0539 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:07.411558 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1301/2616] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:36:06 2022] DELETE /identity/v3/projects/99fe029e7a9e48deb6b269377ac99372 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:36:07.417198 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd64664-64b2-45c3-9762-40b70b735148 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:07.417689 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd64664-64b2-45c3-9762-40b70b735148 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:07.417773 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd64664-64b2-45c3-9762-40b70b735148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:07.437310 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-efd64664-64b2-45c3-9762-40b70b735148 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:36:07.438664 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-efd64664-64b2-45c3-9762-40b70b735148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:07.507922 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1316/2617] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:36:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:36:07.515516 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aed0bc3-86af-486f-855a-9df424fc9a98 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:07.515816 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aed0bc3-86af-486f-855a-9df424fc9a98 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:07.516104 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aed0bc3-86af-486f-855a-9df424fc9a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:07.536663 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-6aed0bc3-86af-486f-855a-9df424fc9a98 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:36:07.537890 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-6aed0bc3-86af-486f-855a-9df424fc9a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:07.548082 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1302/2618] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:36:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:36:07.552730 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd64664-64b2-45c3-9762-40b70b735148 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:07.565823 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd64664-64b2-45c3-9762-40b70b735148 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:07.571499 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d5840-7424-43fd-9d8d-3d3ffa9d36dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:07.571627 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d5840-7424-43fd-9d8d-3d3ffa9d36dd admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:07.571957 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d5840-7424-43fd-9d8d-3d3ffa9d36dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:07.572240 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d5840-7424-43fd-9d8d-3d3ffa9d36dd admin admin] PATH_INFO: `/v3/domains` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:07.573014 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8d5840-7424-43fd-9d8d-3d3ffa9d36dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:36:07.573329 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8d5840-7424-43fd-9d8d-3d3ffa9d36dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:07.574982 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8d5840-7424-43fd-9d8d-3d3ffa9d36dd admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:07.587595 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1317/2619] 10.222.0.62 () {58 vars in 1152 bytes} [Fri May 27 16:36:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:36:07.592199 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aed0bc3-86af-486f-855a-9df424fc9a98 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:07.602564 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aed0bc3-86af-486f-855a-9df424fc9a98 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:07.607258 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2c9a26-cc1c-4c71-a00d-5fbcb61dc273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:07.607913 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c9a26-cc1c-4c71-a00d-5fbcb61dc273 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:07.608201 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c9a26-cc1c-4c71-a00d-5fbcb61dc273 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:07.608484 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c9a26-cc1c-4c71-a00d-5fbcb61dc273 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:07.609169 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2c9a26-cc1c-4c71-a00d-5fbcb61dc273 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:07.611197 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2c9a26-cc1c-4c71-a00d-5fbcb61dc273 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:07.730083 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1303/2620] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:36:07 2022] POST /identity/v3/projects => generated 379 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:36:07.734430 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d5840-7424-43fd-9d8d-3d3ffa9d36dd admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:07.747335 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d5840-7424-43fd-9d8d-3d3ffa9d36dd admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:07.817402 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b625d25e-a2d4-4218-bdd5-6303b12162ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:07.817958 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b625d25e-a2d4-4218-bdd5-6303b12162ef admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:07.818262 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b625d25e-a2d4-4218-bdd5-6303b12162ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:07.818562 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b625d25e-a2d4-4218-bdd5-6303b12162ef admin admin] PATH_INFO: `/v3/users` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:07.819914 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b625d25e-a2d4-4218-bdd5-6303b12162ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:07.821898 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b625d25e-a2d4-4218-bdd5-6303b12162ef admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:07.832476 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:07.989065 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1318/2621] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:36:07 2022] POST /identity/v3/users => generated 290 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:36:07.990502 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2c9a26-cc1c-4c71-a00d-5fbcb61dc273 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:08.012892 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2c9a26-cc1c-4c71-a00d-5fbcb61dc273 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:08.012892 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b484e17-086a-41af-940c-82108d06d5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:08.012892 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b484e17-086a-41af-940c-82108d06d5c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:08.012892 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b484e17-086a-41af-940c-82108d06d5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:08.013443 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b484e17-086a-41af-940c-82108d06d5c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:08.013443 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b484e17-086a-41af-940c-82108d06d5c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:08.013443 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b484e17-086a-41af-940c-82108d06d5c3 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:08.025216 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1304/2622] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:36:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:36:08.028291 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b625d25e-a2d4-4218-bdd5-6303b12162ef admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:08.042577 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b625d25e-a2d4-4218-bdd5-6303b12162ef admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:08.048309 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8360ca-acd1-4745-9f5d-ec814164bafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:08.049155 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8360ca-acd1-4745-9f5d-ec814164bafc admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:08.049549 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8360ca-acd1-4745-9f5d-ec814164bafc admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:08.049960 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8360ca-acd1-4745-9f5d-ec814164bafc admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:08.050862 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8360ca-acd1-4745-9f5d-ec814164bafc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:08.052712 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8360ca-acd1-4745-9f5d-ec814164bafc admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:08.067079 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1319/2623] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:36:08 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:36:08.080733 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b484e17-086a-41af-940c-82108d06d5c3 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:08.080733 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:08.083201 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b484e17-086a-41af-940c-82108d06d5c3 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:08.088459 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c094d3d-d524-4144-8ca1-433f3eda977d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:08.089386 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c094d3d-d524-4144-8ca1-433f3eda977d admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:08.089674 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c094d3d-d524-4144-8ca1-433f3eda977d admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:08.090009 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c094d3d-d524-4144-8ca1-433f3eda977d admin admin] PATH_INFO: `/v3/projects/04b276c561b54aa58bfb836cd73e19e5/users/88cc024d0dbf44af840dbc6c54eda0a1/roles/c8ce6d197f654598ac45f6016ecccabd` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:08.119269 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c094d3d-d524-4144-8ca1-433f3eda977d admin admin] RBAC: Authorizing `identity:create_grant(project_id=04b276c561b54aa58bfb836cd73e19e5, user_id=88cc024d0dbf44af840dbc6c54eda0a1, role_id=c8ce6d197f654598ac45f6016ecccabd)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:08.122182 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c094d3d-d524-4144-8ca1-433f3eda977d admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:08.211039 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1305/2624] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:36:08 2022] PUT /identity/v3/projects/04b276c561b54aa58bfb836cd73e19e5/users/88cc024d0dbf44af840dbc6c54eda0a1/roles/c8ce6d197f654598ac45f6016ecccabd => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:36:08.221116 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f85aa-c4e8-4ba5-9fff-00431aff5813 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:08.221633 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f85aa-c4e8-4ba5-9fff-00431aff5813 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:08.222155 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f85aa-c4e8-4ba5-9fff-00431aff5813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:08.261245 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-7a4f85aa-c4e8-4ba5-9fff-00431aff5813 None None] MFA Rules not processed for user `88cc024d0dbf44af840dbc6c54eda0a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:36:08.262632 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-7a4f85aa-c4e8-4ba5-9fff-00431aff5813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:08.338605 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1320/2625] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:36:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:36:08.343372 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c094d3d-d524-4144-8ca1-433f3eda977d admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:08.408922 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c094d3d-d524-4144-8ca1-433f3eda977d admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:08.416458 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c03b61-36c5-43bd-8eab-05aac478b0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:08.417135 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c03b61-36c5-43bd-8eab-05aac478b0b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:08.417426 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c03b61-36c5-43bd-8eab-05aac478b0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:08.417722 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c03b61-36c5-43bd-8eab-05aac478b0b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:08.418461 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c03b61-36c5-43bd-8eab-05aac478b0b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:08.420422 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c03b61-36c5-43bd-8eab-05aac478b0b9 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:08.809357 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1306/2626] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:36:08 2022] POST /identity/v3/projects => generated 377 bytes in 466 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:36:08.817815 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4f85aa-c4e8-4ba5-9fff-00431aff5813 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:08.830172 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4f85aa-c4e8-4ba5-9fff-00431aff5813 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:08.891612 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16c5362-0f39-492f-8799-d6d8e41cee39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:08.901187 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c5362-0f39-492f-8799-d6d8e41cee39 admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:08.901187 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c5362-0f39-492f-8799-d6d8e41cee39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:08.901187 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c5362-0f39-492f-8799-d6d8e41cee39 admin admin] PATH_INFO: `/v3/users` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:08.901187 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16c5362-0f39-492f-8799-d6d8e41cee39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:08.901187 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16c5362-0f39-492f-8799-d6d8e41cee39 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:09.007809 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1321/2627] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:36:08 2022] POST /identity/v3/users => generated 289 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:36:09.011901 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c03b61-36c5-43bd-8eab-05aac478b0b9 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:09.022622 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c03b61-36c5-43bd-8eab-05aac478b0b9 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:09.027148 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb326de8-2829-4dfd-a6ba-9d65ca051c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:09.027843 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb326de8-2829-4dfd-a6ba-9d65ca051c77 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:09.028129 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb326de8-2829-4dfd-a6ba-9d65ca051c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:09.028404 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb326de8-2829-4dfd-a6ba-9d65ca051c77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:09.029187 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb326de8-2829-4dfd-a6ba-9d65ca051c77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:09.030822 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb326de8-2829-4dfd-a6ba-9d65ca051c77 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:09.041761 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1307/2628] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:36:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:36:09.045869 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16c5362-0f39-492f-8799-d6d8e41cee39 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:09.056595 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16c5362-0f39-492f-8799-d6d8e41cee39 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:09.061190 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a4a286-b352-42cc-a4b6-4f164d03e416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:09.061854 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a4a286-b352-42cc-a4b6-4f164d03e416 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:09.062142 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a4a286-b352-42cc-a4b6-4f164d03e416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:09.062461 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a4a286-b352-42cc-a4b6-4f164d03e416 admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:09.063279 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a4a286-b352-42cc-a4b6-4f164d03e416 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:09.064880 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a4a286-b352-42cc-a4b6-4f164d03e416 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:09.075848 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1322/2629] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:36:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:36:09.080110 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb326de8-2829-4dfd-a6ba-9d65ca051c77 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:09.090178 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb326de8-2829-4dfd-a6ba-9d65ca051c77 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:09.094811 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9bfe51-ace0-4c40-b1e9-e304e0205616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:09.095689 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9bfe51-ace0-4c40-b1e9-e304e0205616 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:09.095973 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9bfe51-ace0-4c40-b1e9-e304e0205616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:09.096252 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9bfe51-ace0-4c40-b1e9-e304e0205616 admin admin] PATH_INFO: `/v3/projects/062b89cd99484f0786f4937d47d4dcdf/users/c3ea5e9343bb49bdbbc931b4fbe90a65/roles/c8ce6d197f654598ac45f6016ecccabd` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:09.112085 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9bfe51-ace0-4c40-b1e9-e304e0205616 admin admin] RBAC: Authorizing `identity:create_grant(project_id=062b89cd99484f0786f4937d47d4dcdf, user_id=c3ea5e9343bb49bdbbc931b4fbe90a65, role_id=c8ce6d197f654598ac45f6016ecccabd)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:09.115441 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9bfe51-ace0-4c40-b1e9-e304e0205616 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:09.258414 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1308/2630] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:36:09 2022] PUT /identity/v3/projects/062b89cd99484f0786f4937d47d4dcdf/users/c3ea5e9343bb49bdbbc931b4fbe90a65/roles/c8ce6d197f654598ac45f6016ecccabd => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:36:09.270172 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f08320-d7fc-4c42-8f0f-f1a0d2287b78 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:09.270497 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f08320-d7fc-4c42-8f0f-f1a0d2287b78 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:09.270797 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f08320-d7fc-4c42-8f0f-f1a0d2287b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:09.298709 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-79f08320-d7fc-4c42-8f0f-f1a0d2287b78 None None] MFA Rules not processed for user `c3ea5e9343bb49bdbbc931b4fbe90a65`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:36:09.299969 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-79f08320-d7fc-4c42-8f0f-f1a0d2287b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:09.347345 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:09.377183 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1323/2631] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:36:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:36:09.381463 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9bfe51-ace0-4c40-b1e9-e304e0205616 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:09.460774 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9bfe51-ace0-4c40-b1e9-e304e0205616 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:09.465499 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f470f-4af5-4ba1-b331-c91ca8d2bacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:09.466162 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f470f-4af5-4ba1-b331-c91ca8d2bacb admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:09.466476 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f470f-4af5-4ba1-b331-c91ca8d2bacb admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:09.466776 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f470f-4af5-4ba1-b331-c91ca8d2bacb admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:09.467449 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9f470f-4af5-4ba1-b331-c91ca8d2bacb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:09.469363 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9f470f-4af5-4ba1-b331-c91ca8d2bacb admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:09.593047 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1309/2632] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:36:09 2022] POST /identity/v3/projects => generated 377 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:36:09.597379 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f08320-d7fc-4c42-8f0f-f1a0d2287b78 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:09.608695 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f08320-d7fc-4c42-8f0f-f1a0d2287b78 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:09.666879 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13a8d0e-65fc-48b4-83b2-f2772b81ef58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:09.667562 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a8d0e-65fc-48b4-83b2-f2772b81ef58 admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:09.667847 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a8d0e-65fc-48b4-83b2-f2772b81ef58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:09.668133 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a8d0e-65fc-48b4-83b2-f2772b81ef58 admin admin] PATH_INFO: `/v3/users` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:09.668845 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13a8d0e-65fc-48b4-83b2-f2772b81ef58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:09.670821 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13a8d0e-65fc-48b4-83b2-f2772b81ef58 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:09.801073 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1324/2633] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:36:09 2022] POST /identity/v3/users => generated 295 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:36:09.802090 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f470f-4af5-4ba1-b331-c91ca8d2bacb admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:09.816853 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f470f-4af5-4ba1-b331-c91ca8d2bacb admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:09.821827 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fe784d-c534-4786-a924-b43d86d9c0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:09.822531 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe784d-c534-4786-a924-b43d86d9c0de admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:09.822815 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe784d-c534-4786-a924-b43d86d9c0de admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:09.823088 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe784d-c534-4786-a924-b43d86d9c0de admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:09.823853 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fe784d-c534-4786-a924-b43d86d9c0de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:09.825449 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fe784d-c534-4786-a924-b43d86d9c0de admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:09.836933 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1310/2634] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:36:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 16:36:09.841235 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13a8d0e-65fc-48b4-83b2-f2772b81ef58 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:09.858079 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13a8d0e-65fc-48b4-83b2-f2772b81ef58 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:09.862381 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef6fec1-773a-4627-9cd5-3a6cfe0a5f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:09.868047 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6fec1-773a-4627-9cd5-3a6cfe0a5f6e admin admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:09.868047 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6fec1-773a-4627-9cd5-3a6cfe0a5f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:09.868047 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6fec1-773a-4627-9cd5-3a6cfe0a5f6e admin admin] PATH_INFO: `/v3/projects/3308f459696e456892402a4a27006c7e/users/d983ba269f2b454dbcfaaa9eeeb8c540/roles/e04fe3eb1f714d74901ac83e33ea8a16` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:09.887205 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef6fec1-773a-4627-9cd5-3a6cfe0a5f6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3308f459696e456892402a4a27006c7e, user_id=d983ba269f2b454dbcfaaa9eeeb8c540, role_id=e04fe3eb1f714d74901ac83e33ea8a16)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:09.890078 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef6fec1-773a-4627-9cd5-3a6cfe0a5f6e admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:09.973538 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1325/2635] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:36:09 2022] PUT /identity/v3/projects/3308f459696e456892402a4a27006c7e/users/d983ba269f2b454dbcfaaa9eeeb8c540/roles/e04fe3eb1f714d74901ac83e33ea8a16 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:36:09.978229 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fe784d-c534-4786-a924-b43d86d9c0de admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:09.984898 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:09.988735 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fe784d-c534-4786-a924-b43d86d9c0de admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:10.047036 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b970b51-ab1e-4d5d-81f1-985504b865e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:10.047692 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b970b51-ab1e-4d5d-81f1-985504b865e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:10.047908 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b970b51-ab1e-4d5d-81f1-985504b865e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:10.048189 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b970b51-ab1e-4d5d-81f1-985504b865e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:10.048923 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b970b51-ab1e-4d5d-81f1-985504b865e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:10.050659 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b970b51-ab1e-4d5d-81f1-985504b865e2 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:10.061438 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1311/2636] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:36:09 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:36:10.065781 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef6fec1-773a-4627-9cd5-3a6cfe0a5f6e admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:10.077093 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef6fec1-773a-4627-9cd5-3a6cfe0a5f6e admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:10.081957 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e7f393-2f10-4e27-9a85-fd8d0771ad70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:10.083007 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7f393-2f10-4e27-9a85-fd8d0771ad70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:10.083294 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7f393-2f10-4e27-9a85-fd8d0771ad70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:10.083571 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7f393-2f10-4e27-9a85-fd8d0771ad70 admin admin] PATH_INFO: `/v3/projects/3308f459696e456892402a4a27006c7e/users/d983ba269f2b454dbcfaaa9eeeb8c540/roles/e04fe3eb1f714d74901ac83e33ea8a16` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:10.086410 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e7f393-2f10-4e27-9a85-fd8d0771ad70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3308f459696e456892402a4a27006c7e, user_id=d983ba269f2b454dbcfaaa9eeeb8c540, role_id=e04fe3eb1f714d74901ac83e33ea8a16)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:10.089429 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e7f393-2f10-4e27-9a85-fd8d0771ad70 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:10.100622 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1326/2637] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:36:10 2022] PUT /identity/v3/projects/3308f459696e456892402a4a27006c7e/users/d983ba269f2b454dbcfaaa9eeeb8c540/roles/e04fe3eb1f714d74901ac83e33ea8a16 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:36:10.110898 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c755b-e139-4b64-84c6-06e67d6dd7eb None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:10.111193 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c755b-e139-4b64-84c6-06e67d6dd7eb None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:10.111476 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c755b-e139-4b64-84c6-06e67d6dd7eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:10.137948 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-581c755b-e139-4b64-84c6-06e67d6dd7eb None None] MFA Rules not processed for user `d983ba269f2b454dbcfaaa9eeeb8c540`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:36:10.139892 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-581c755b-e139-4b64-84c6-06e67d6dd7eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:10.214282 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1312/2638] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:36:10 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:36:10.227869 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e7f393-2f10-4e27-9a85-fd8d0771ad70 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:10.229569 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-84e7f393-2f10-4e27-9a85-fd8d0771ad70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:10.291527 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e7f393-2f10-4e27-9a85-fd8d0771ad70 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:10.295386 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12776c5-13dc-4d72-b2eb-659e3623877d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8693a1e72f14fdfb383f11e96330726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:10.296035 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12776c5-13dc-4d72-b2eb-659e3623877d service cinder] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:10.296385 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12776c5-13dc-4d72-b2eb-659e3623877d service cinder] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:10.296660 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12776c5-13dc-4d72-b2eb-659e3623877d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:10.314641 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12776c5-13dc-4d72-b2eb-659e3623877d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:10.314641 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12776c5-13dc-4d72-b2eb-659e3623877d service cinder] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:10.317398 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1327/2639] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:36:10 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:36:10.537052 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581c755b-e139-4b64-84c6-06e67d6dd7eb None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:10.538576 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-581c755b-e139-4b64-84c6-06e67d6dd7eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:10.551054 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581c755b-e139-4b64-84c6-06e67d6dd7eb None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:10.555133 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e84c99-3b73-471e-88dc-e9d41025af65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8693a1e72f14fdfb383f11e96330726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:10.555769 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e84c99-3b73-471e-88dc-e9d41025af65 service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:10.556051 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e84c99-3b73-471e-88dc-e9d41025af65 service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:10.556325 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e84c99-3b73-471e-88dc-e9d41025af65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:10.619810 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e84c99-3b73-471e-88dc-e9d41025af65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:10.621308 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e84c99-3b73-471e-88dc-e9d41025af65 service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:10.633499 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1313/2640] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:36:10 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:36:12.828624 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12776c5-13dc-4d72-b2eb-659e3623877d service cinder] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:12.830405 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-b12776c5-13dc-4d72-b2eb-659e3623877d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:12.892130 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:12.919115 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12776c5-13dc-4d72-b2eb-659e3623877d service cinder] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:12.929622 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d72fde1-e37b-4db6-8025-dd866c394733 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb13ad6d8b1e46029262556bff398796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:12.929622 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72fde1-e37b-4db6-8025-dd866c394733 service nova] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:12.929622 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72fde1-e37b-4db6-8025-dd866c394733 service nova] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:12.929622 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72fde1-e37b-4db6-8025-dd866c394733 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:12.931091 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-4d72fde1-e37b-4db6-8025-dd866c394733 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:13.003501 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d72fde1-e37b-4db6-8025-dd866c394733 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:13.005233 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d72fde1-e37b-4db6-8025-dd866c394733 service nova] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:13.015410 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1328/2641] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:36:12 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:36:15.022286 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e84c99-3b73-471e-88dc-e9d41025af65 service cinder] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:15.048571 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:15.091582 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e84c99-3b73-471e-88dc-e9d41025af65 service cinder] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:15.096088 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8ad3c5-c29f-42b7-99be-bb08c7144364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:15.096964 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ad3c5-c29f-42b7-99be-bb08c7144364 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:15.097282 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ad3c5-c29f-42b7-99be-bb08c7144364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:15.097561 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ad3c5-c29f-42b7-99be-bb08c7144364 admin admin] PATH_INFO: `/v3/users/88cc024d0dbf44af840dbc6c54eda0a1` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:15.098836 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8ad3c5-c29f-42b7-99be-bb08c7144364 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88cc024d0dbf44af840dbc6c54eda0a1)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:15.100770 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8ad3c5-c29f-42b7-99be-bb08c7144364 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:15.345619 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-cc8ad3c5-c29f-42b7-99be-bb08c7144364 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88cc024d0dbf44af840dbc6c54eda0a1'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:15.353432 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-cc8ad3c5-c29f-42b7-99be-bb08c7144364 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88cc024d0dbf44af840dbc6c54eda0a1'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:15.354201 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-cc8ad3c5-c29f-42b7-99be-bb08c7144364 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88cc024d0dbf44af840dbc6c54eda0a1'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:15.354898 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-cc8ad3c5-c29f-42b7-99be-bb08c7144364 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88cc024d0dbf44af840dbc6c54eda0a1'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:15.436586 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-cc8ad3c5-c29f-42b7-99be-bb08c7144364 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88cc024d0dbf44af840dbc6c54eda0a1'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:15.458351 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1314/2642] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:36:15 2022] DELETE /identity/v3/users/88cc024d0dbf44af840dbc6c54eda0a1 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:36:15.463477 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea882987-6578-4e5e-a78b-13b74e57f530 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:15.463996 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea882987-6578-4e5e-a78b-13b74e57f530 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:15.464112 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea882987-6578-4e5e-a78b-13b74e57f530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:15.481853 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-ea882987-6578-4e5e-a78b-13b74e57f530 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:36:15.483198 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-ea882987-6578-4e5e-a78b-13b74e57f530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:15.566767 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1329/2643] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:36:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:36:15.574451 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8ad3c5-c29f-42b7-99be-bb08c7144364 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:15.576496 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-cc8ad3c5-c29f-42b7-99be-bb08c7144364 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:15.670073 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8ad3c5-c29f-42b7-99be-bb08c7144364 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:15.675315 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618d9e0c-6ff0-4ade-bd00-1fc91a679f06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:15.675984 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d9e0c-6ff0-4ade-bd00-1fc91a679f06 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:15.676270 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d9e0c-6ff0-4ade-bd00-1fc91a679f06 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:15.676553 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d9e0c-6ff0-4ade-bd00-1fc91a679f06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:15.689173 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618d9e0c-6ff0-4ade-bd00-1fc91a679f06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:15.689173 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618d9e0c-6ff0-4ade-bd00-1fc91a679f06 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:15.700614 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1315/2644] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:36:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:36:16.242094 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea882987-6578-4e5e-a78b-13b74e57f530 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:16.242094 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-ea882987-6578-4e5e-a78b-13b74e57f530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:16.256397 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea882987-6578-4e5e-a78b-13b74e57f530 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:16.261836 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd660f-d888-423d-9161-32d9217e1568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:16.262735 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd660f-d888-423d-9161-32d9217e1568 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:16.263023 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd660f-d888-423d-9161-32d9217e1568 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:16.263807 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd660f-d888-423d-9161-32d9217e1568 admin admin] PATH_INFO: `/v3/projects/04b276c561b54aa58bfb836cd73e19e5` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:16.265365 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fd660f-d888-423d-9161-32d9217e1568 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04b276c561b54aa58bfb836cd73e19e5)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:16.267349 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fd660f-d888-423d-9161-32d9217e1568 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:16.413442 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54430030-906a-4aa1-aad3-c03a40256d00 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:16.413881 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54430030-906a-4aa1-aad3-c03a40256d00 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:16.414044 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54430030-906a-4aa1-aad3-c03a40256d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:16.432123 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-54430030-906a-4aa1-aad3-c03a40256d00 None None] MFA Rules not processed for user `eb50bf5f39b04ab689b55f46d3dd2640`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:36:16.433327 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-54430030-906a-4aa1-aad3-c03a40256d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:16.474808 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:16.489315 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1316/2645] 10.222.0.62 () {58 vars in 967 bytes} [Fri May 27 16:36:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:36:16.495501 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-75fd660f-d888-423d-9161-32d9217e1568 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04b276c561b54aa58bfb836cd73e19e5', 'request_id': 'req-75fd660f-d888-423d-9161-32d9217e1568'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:16.502575 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-75fd660f-d888-423d-9161-32d9217e1568 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04b276c561b54aa58bfb836cd73e19e5', 'request_id': 'req-75fd660f-d888-423d-9161-32d9217e1568'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:16.509103 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-75fd660f-d888-423d-9161-32d9217e1568 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04b276c561b54aa58bfb836cd73e19e5', 'request_id': 'req-75fd660f-d888-423d-9161-32d9217e1568'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:16.630449 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:16.635470 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-75fd660f-d888-423d-9161-32d9217e1568 admin admin] The token cache is being invalidate because project 04b276c561b54aa58bfb836cd73e19e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80288) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:36:16.638412 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-75fd660f-d888-423d-9161-32d9217e1568 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:16.638412 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-75fd660f-d888-423d-9161-32d9217e1568 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:16.638412 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1330/2646] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:36:16 2022] DELETE /identity/v3/projects/04b276c561b54aa58bfb836cd73e19e5 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:36:16.642177 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54430030-906a-4aa1-aad3-c03a40256d00 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:16.655651 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54430030-906a-4aa1-aad3-c03a40256d00 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:16.668770 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd660f-d888-423d-9161-32d9217e1568 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:16.670225 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-75fd660f-d888-423d-9161-32d9217e1568 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:16.752462 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd660f-d888-423d-9161-32d9217e1568 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:16.758393 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe116ba-4873-499e-b711-ac8cc1a725a4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8e6ec55445045fcac5623b9b6ffa9ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:16.758590 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a83f40-eaff-443b-bbaa-f626e78400a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:16.759819 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a83f40-eaff-443b-bbaa-f626e78400a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:16.759974 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a83f40-eaff-443b-bbaa-f626e78400a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:16.760400 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a83f40-eaff-443b-bbaa-f626e78400a6 admin admin] PATH_INFO: `/v3/users/c3ea5e9343bb49bdbbc931b4fbe90a65` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:16.760676 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe116ba-4873-499e-b711-ac8cc1a725a4 service swift] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:16.761112 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe116ba-4873-499e-b711-ac8cc1a725a4 service swift] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:16.761541 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe116ba-4873-499e-b711-ac8cc1a725a4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:16.762543 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a83f40-eaff-443b-bbaa-f626e78400a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3ea5e9343bb49bdbbc931b4fbe90a65)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:16.764189 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a83f40-eaff-443b-bbaa-f626e78400a6 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:16.766023 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-fbe116ba-4873-499e-b711-ac8cc1a725a4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:16.837881 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe116ba-4873-499e-b711-ac8cc1a725a4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:16.839569 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe116ba-4873-499e-b711-ac8cc1a725a4 service swift] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:16.849482 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1331/2647] 10.222.0.62 () {60 vars in 1384 bytes} [Fri May 27 16:36:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 27 16:36:16.959476 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-72a83f40-eaff-443b-bbaa-f626e78400a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3ea5e9343bb49bdbbc931b4fbe90a65'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:16.971927 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-72a83f40-eaff-443b-bbaa-f626e78400a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3ea5e9343bb49bdbbc931b4fbe90a65'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:16.971927 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-72a83f40-eaff-443b-bbaa-f626e78400a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3ea5e9343bb49bdbbc931b4fbe90a65'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:16.971927 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-72a83f40-eaff-443b-bbaa-f626e78400a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3ea5e9343bb49bdbbc931b4fbe90a65'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:17.064457 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-72a83f40-eaff-443b-bbaa-f626e78400a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3ea5e9343bb49bdbbc931b4fbe90a65'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:17.084597 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1317/2648] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:36:16 2022] DELETE /identity/v3/users/c3ea5e9343bb49bdbbc931b4fbe90a65 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:36:17.583426 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f3200-724a-451d-a7f7-ee39fb22875b None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:17.584790 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f3200-724a-451d-a7f7-ee39fb22875b None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:17.584790 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f3200-724a-451d-a7f7-ee39fb22875b None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:17.585548 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1332/2649] 10.222.0.62 () {54 vars in 921 bytes} [Fri May 27 16:36:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:36:17.588041 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a83f40-eaff-443b-bbaa-f626e78400a6 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:17.589849 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-72a83f40-eaff-443b-bbaa-f626e78400a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:17.595400 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5c526-c0f6-4bfd-a51f-83005fcb5eca None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:17.595706 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5c526-c0f6-4bfd-a51f-83005fcb5eca None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:17.596183 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5c526-c0f6-4bfd-a51f-83005fcb5eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:17.625610 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-1ed5c526-c0f6-4bfd-a51f-83005fcb5eca None None] MFA Rules not processed for user `b367ccea28d540a0b24ec4e42ebfef65`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:36:17.626873 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-1ed5c526-c0f6-4bfd-a51f-83005fcb5eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:17.668806 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a83f40-eaff-443b-bbaa-f626e78400a6 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:17.675247 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10abdc2-c38a-400e-b712-4aa1ee3e161d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:17.676171 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10abdc2-c38a-400e-b712-4aa1ee3e161d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:17.676454 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10abdc2-c38a-400e-b712-4aa1ee3e161d admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:17.676733 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10abdc2-c38a-400e-b712-4aa1ee3e161d admin admin] PATH_INFO: `/v3/projects/062b89cd99484f0786f4937d47d4dcdf` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:17.677918 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10abdc2-c38a-400e-b712-4aa1ee3e161d admin admin] RBAC: Authorizing `identity:delete_project(project_id=062b89cd99484f0786f4937d47d4dcdf)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:17.680631 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10abdc2-c38a-400e-b712-4aa1ee3e161d admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:17.685305 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1333/2650] 10.222.0.62 () {58 vars in 1018 bytes} [Fri May 27 16:36:17 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:36:17.693233 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:17.697576 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed5c526-c0f6-4bfd-a51f-83005fcb5eca None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:17.699589 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-1ed5c526-c0f6-4bfd-a51f-83005fcb5eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:17.711029 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed5c526-c0f6-4bfd-a51f-83005fcb5eca None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:17.715632 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7e5a1e-c4dd-49fd-8cbc-c448b93af289 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:17.716323 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e5a1e-c4dd-49fd-8cbc-c448b93af289 service neutron] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:17.716608 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e5a1e-c4dd-49fd-8cbc-c448b93af289 service neutron] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:17.716913 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e5a1e-c4dd-49fd-8cbc-c448b93af289 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:17.726442 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7e5a1e-c4dd-49fd-8cbc-c448b93af289 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:17.726442 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7e5a1e-c4dd-49fd-8cbc-c448b93af289 service neutron] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:17.734343 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1334/2651] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:36:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:36:17.815215 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f49523-91ec-40d8-9c02-7ae134e5aa59 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:17.815518 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f49523-91ec-40d8-9c02-7ae134e5aa59 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:17.815805 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f49523-91ec-40d8-9c02-7ae134e5aa59 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:17.817204 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1335/2652] 10.222.0.62 () {54 vars in 921 bytes} [Fri May 27 16:36:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 16:36:17.823326 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6382014-405f-402c-995b-3840d29d2793 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:17.823618 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6382014-405f-402c-995b-3840d29d2793 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:17.824026 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6382014-405f-402c-995b-3840d29d2793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:17.831540 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b10abdc2-c38a-400e-b712-4aa1ee3e161d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '062b89cd99484f0786f4937d47d4dcdf', 'request_id': 'req-b10abdc2-c38a-400e-b712-4aa1ee3e161d'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:17.837726 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b10abdc2-c38a-400e-b712-4aa1ee3e161d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '062b89cd99484f0786f4937d47d4dcdf', 'request_id': 'req-b10abdc2-c38a-400e-b712-4aa1ee3e161d'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:17.845045 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-e6382014-405f-402c-995b-3840d29d2793 None None] MFA Rules not processed for user `cb13ad6d8b1e46029262556bff398796`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:36:17.846343 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-e6382014-405f-402c-995b-3840d29d2793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:17.885800 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:17.923015 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1336/2653] 10.222.0.62 () {58 vars in 1018 bytes} [Fri May 27 16:36:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:36:17.934933 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6382014-405f-402c-995b-3840d29d2793 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:17.995537 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6382014-405f-402c-995b-3840d29d2793 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:17.999399 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380cfe01-21f1-441f-9c18-77b408b9c57e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:18.000067 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380cfe01-21f1-441f-9c18-77b408b9c57e service neutron] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:18.000634 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380cfe01-21f1-441f-9c18-77b408b9c57e service neutron] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:18.000905 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380cfe01-21f1-441f-9c18-77b408b9c57e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:18.007862 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b10abdc2-c38a-400e-b712-4aa1ee3e161d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '062b89cd99484f0786f4937d47d4dcdf', 'request_id': 'req-b10abdc2-c38a-400e-b712-4aa1ee3e161d'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:18.022710 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380cfe01-21f1-441f-9c18-77b408b9c57e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:18.024609 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380cfe01-21f1-441f-9c18-77b408b9c57e service neutron] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:18.025573 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b10abdc2-c38a-400e-b712-4aa1ee3e161d admin admin] The token cache is being invalidate because project 062b89cd99484f0786f4937d47d4dcdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:36:18.026136 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b10abdc2-c38a-400e-b712-4aa1ee3e161d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:18.027252 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b10abdc2-c38a-400e-b712-4aa1ee3e161d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:18.029999 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1318/2654] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:36:17 2022] DELETE /identity/v3/projects/062b89cd99484f0786f4937d47d4dcdf => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:36:18.036103 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10abdc2-c38a-400e-b712-4aa1ee3e161d admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:18.036383 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-b10abdc2-c38a-400e-b712-4aa1ee3e161d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:18.037702 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1337/2655] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:36:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 16:36:18.132434 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10abdc2-c38a-400e-b712-4aa1ee3e161d admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:18.137554 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a3520-184a-478f-bfde-451b3320b655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:18.144257 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a3520-184a-478f-bfde-451b3320b655 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:18.144257 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a3520-184a-478f-bfde-451b3320b655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:18.144257 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a3520-184a-478f-bfde-451b3320b655 admin admin] PATH_INFO: `/v3/users/d983ba269f2b454dbcfaaa9eeeb8c540` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:18.144257 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13a3520-184a-478f-bfde-451b3320b655 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d983ba269f2b454dbcfaaa9eeeb8c540)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:18.144257 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13a3520-184a-478f-bfde-451b3320b655 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:18.440638 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-d13a3520-184a-478f-bfde-451b3320b655 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd983ba269f2b454dbcfaaa9eeeb8c540'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:18.448320 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-d13a3520-184a-478f-bfde-451b3320b655 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd983ba269f2b454dbcfaaa9eeeb8c540'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:18.449027 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-d13a3520-184a-478f-bfde-451b3320b655 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd983ba269f2b454dbcfaaa9eeeb8c540'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:18.449640 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-d13a3520-184a-478f-bfde-451b3320b655 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd983ba269f2b454dbcfaaa9eeeb8c540'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:18.527427 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-d13a3520-184a-478f-bfde-451b3320b655 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd983ba269f2b454dbcfaaa9eeeb8c540'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:18.547792 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1319/2656] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:36:18 2022] DELETE /identity/v3/users/d983ba269f2b454dbcfaaa9eeeb8c540 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:36:19.039562 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380cfe01-21f1-441f-9c18-77b408b9c57e service neutron] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:19.061813 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380cfe01-21f1-441f-9c18-77b408b9c57e service neutron] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:19.135688 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082dfc46-32f2-4870-9d80-229029976dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:19.136570 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082dfc46-32f2-4870-9d80-229029976dac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:19.136873 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082dfc46-32f2-4870-9d80-229029976dac admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:19.137146 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082dfc46-32f2-4870-9d80-229029976dac admin admin] PATH_INFO: `/v3/projects/3308f459696e456892402a4a27006c7e` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:19.145885 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082dfc46-32f2-4870-9d80-229029976dac admin admin] RBAC: Authorizing `identity:delete_project(project_id=3308f459696e456892402a4a27006c7e)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:19.147893 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082dfc46-32f2-4870-9d80-229029976dac admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:19.397152 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-082dfc46-32f2-4870-9d80-229029976dac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3308f459696e456892402a4a27006c7e', 'request_id': 'req-082dfc46-32f2-4870-9d80-229029976dac'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:19.403708 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-082dfc46-32f2-4870-9d80-229029976dac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3308f459696e456892402a4a27006c7e', 'request_id': 'req-082dfc46-32f2-4870-9d80-229029976dac'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:19.410441 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-082dfc46-32f2-4870-9d80-229029976dac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3308f459696e456892402a4a27006c7e', 'request_id': 'req-082dfc46-32f2-4870-9d80-229029976dac'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:19.577023 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:19.581647 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-082dfc46-32f2-4870-9d80-229029976dac admin admin] The token cache is being invalidate because project 3308f459696e456892402a4a27006c7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80288) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:36:19.582107 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-082dfc46-32f2-4870-9d80-229029976dac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:19.582945 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-082dfc46-32f2-4870-9d80-229029976dac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:19.584969 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1338/2657] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:36:19 2022] DELETE /identity/v3/projects/3308f459696e456892402a4a27006c7e => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:36:19.591951 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ed1b5-a44d-4cd9-8d5b-b790a9e53c9d None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:19.595511 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ed1b5-a44d-4cd9-8d5b-b790a9e53c9d None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:19.595511 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ed1b5-a44d-4cd9-8d5b-b790a9e53c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:19.614624 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-663ed1b5-a44d-4cd9-8d5b-b790a9e53c9d None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:36:19.615911 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-663ed1b5-a44d-4cd9-8d5b-b790a9e53c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:19.632686 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:19.682219 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1320/2658] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:36:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:36:19.690993 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eaf76d-08b6-45dd-a37e-79acad7463ae None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:19.691308 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eaf76d-08b6-45dd-a37e-79acad7463ae None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:19.691812 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eaf76d-08b6-45dd-a37e-79acad7463ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:19.711269 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-08eaf76d-08b6-45dd-a37e-79acad7463ae None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:36:19.712585 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-08eaf76d-08b6-45dd-a37e-79acad7463ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:19.720620 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1339/2659] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:36:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:36:19.724911 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663ed1b5-a44d-4cd9-8d5b-b790a9e53c9d None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:19.735231 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663ed1b5-a44d-4cd9-8d5b-b790a9e53c9d None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:19.739837 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c6291-6403-4962-bf10-accb123d5523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:19.740504 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c6291-6403-4962-bf10-accb123d5523 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:19.740791 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c6291-6403-4962-bf10-accb123d5523 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:19.741071 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c6291-6403-4962-bf10-accb123d5523 admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:19.741832 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6c6291-6403-4962-bf10-accb123d5523 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:36:19.742143 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6c6291-6403-4962-bf10-accb123d5523 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:19.744391 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6c6291-6403-4962-bf10-accb123d5523 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:19.762610 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1321/2660] 10.222.0.62 () {58 vars in 1152 bytes} [Fri May 27 16:36:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:36:19.763781 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eaf76d-08b6-45dd-a37e-79acad7463ae None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:19.774187 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eaf76d-08b6-45dd-a37e-79acad7463ae None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:19.779164 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d404ad78-477e-47b3-bc7b-659c4d8f688b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:19.783196 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d404ad78-477e-47b3-bc7b-659c4d8f688b admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:19.783196 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d404ad78-477e-47b3-bc7b-659c4d8f688b admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:19.783196 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d404ad78-477e-47b3-bc7b-659c4d8f688b admin admin] PATH_INFO: `/v3/projects` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:19.783196 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d404ad78-477e-47b3-bc7b-659c4d8f688b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:19.783196 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d404ad78-477e-47b3-bc7b-659c4d8f688b admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:19.922661 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1340/2661] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:36:19 2022] POST /identity/v3/projects => generated 361 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:36:19.926693 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c6291-6403-4962-bf10-accb123d5523 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:19.939848 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c6291-6403-4962-bf10-accb123d5523 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:20.002100 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea200b8-a988-4116-9854-7d64e44c7d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:20.003059 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea200b8-a988-4116-9854-7d64e44c7d99 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:20.003544 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea200b8-a988-4116-9854-7d64e44c7d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:20.003768 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea200b8-a988-4116-9854-7d64e44c7d99 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:20.004475 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea200b8-a988-4116-9854-7d64e44c7d99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:20.006495 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea200b8-a988-4116-9854-7d64e44c7d99 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:20.127060 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1322/2662] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:36:19 2022] POST /identity/v3/users => generated 281 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:36:20.131568 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d404ad78-477e-47b3-bc7b-659c4d8f688b admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:20.144208 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d404ad78-477e-47b3-bc7b-659c4d8f688b admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:20.149942 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4e1ec0-b934-4c5e-9f2a-b22d0964b600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:20.151170 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e1ec0-b934-4c5e-9f2a-b22d0964b600 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:20.151593 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e1ec0-b934-4c5e-9f2a-b22d0964b600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:20.152022 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e1ec0-b934-4c5e-9f2a-b22d0964b600 admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:20.153009 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4e1ec0-b934-4c5e-9f2a-b22d0964b600 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:20.155612 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4e1ec0-b934-4c5e-9f2a-b22d0964b600 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:20.175839 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea200b8-a988-4116-9854-7d64e44c7d99 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:20.177007 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1341/2663] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:36:20 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:36:20.178004 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-0ea200b8-a988-4116-9854-7d64e44c7d99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:20.181000 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4e1ec0-b934-4c5e-9f2a-b22d0964b600 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:20.195768 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4e1ec0-b934-4c5e-9f2a-b22d0964b600 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:20.201642 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83d7166-791f-4602-a3fb-cc666df50892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:20.202860 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d7166-791f-4602-a3fb-cc666df50892 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:20.203407 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d7166-791f-4602-a3fb-cc666df50892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:20.203789 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d7166-791f-4602-a3fb-cc666df50892 admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:20.204621 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83d7166-791f-4602-a3fb-cc666df50892 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:20.207430 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83d7166-791f-4602-a3fb-cc666df50892 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:20.220311 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1342/2664] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:36:20 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:36:20.224708 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83d7166-791f-4602-a3fb-cc666df50892 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:20.246062 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83d7166-791f-4602-a3fb-cc666df50892 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:20.256203 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8143c5-6681-4726-978d-2f5eb0385ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:20.257828 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8143c5-6681-4726-978d-2f5eb0385ff3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:20.258582 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8143c5-6681-4726-978d-2f5eb0385ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:20.259089 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8143c5-6681-4726-978d-2f5eb0385ff3 admin admin] PATH_INFO: `/v3/projects/0e0d356bb236463eb8f4e10cd7ddca3a/users/5e3dacdf66934875be33fba2361b6926/roles/c8ce6d197f654598ac45f6016ecccabd` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:20.283228 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8143c5-6681-4726-978d-2f5eb0385ff3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e0d356bb236463eb8f4e10cd7ddca3a, user_id=5e3dacdf66934875be33fba2361b6926, role_id=c8ce6d197f654598ac45f6016ecccabd)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:20.286781 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8143c5-6681-4726-978d-2f5eb0385ff3 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:20.307114 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea200b8-a988-4116-9854-7d64e44c7d99 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:20.313990 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377edf63-7621-45f7-b671-bfd174b945a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb13ad6d8b1e46029262556bff398796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:20.315038 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377edf63-7621-45f7-b671-bfd174b945a4 service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:20.315532 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377edf63-7621-45f7-b671-bfd174b945a4 service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:20.316012 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377edf63-7621-45f7-b671-bfd174b945a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:20.318289 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-377edf63-7621-45f7-b671-bfd174b945a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:20.338408 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377edf63-7621-45f7-b671-bfd174b945a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:20.342933 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377edf63-7621-45f7-b671-bfd174b945a4 service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:20.360031 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1323/2665] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:36:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:36:20.382444 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1343/2666] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:36:20 2022] PUT /identity/v3/projects/0e0d356bb236463eb8f4e10cd7ddca3a/users/5e3dacdf66934875be33fba2361b6926/roles/c8ce6d197f654598ac45f6016ecccabd => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:36:20.397877 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a56b2-3cc7-47b4-8231-db30ca773666 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:20.398100 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a56b2-3cc7-47b4-8231-db30ca773666 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:20.399216 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a56b2-3cc7-47b4-8231-db30ca773666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:20.446788 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-6c6a56b2-3cc7-47b4-8231-db30ca773666 None None] MFA Rules not processed for user `5e3dacdf66934875be33fba2361b6926`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:36:20.447932 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-6c6a56b2-3cc7-47b4-8231-db30ca773666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:20.459220 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:20.573763 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1324/2667] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:36:20 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:36:20.625686 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8143c5-6681-4726-978d-2f5eb0385ff3 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:20.627492 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-7d8143c5-6681-4726-978d-2f5eb0385ff3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:20.742856 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8143c5-6681-4726-978d-2f5eb0385ff3 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:20.746785 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210922fb-e9b8-4b76-836a-99a7529fe0dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8693a1e72f14fdfb383f11e96330726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:20.747540 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210922fb-e9b8-4b76-836a-99a7529fe0dc service cinder] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:20.747898 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210922fb-e9b8-4b76-836a-99a7529fe0dc service cinder] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:20.748392 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210922fb-e9b8-4b76-836a-99a7529fe0dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:20.770268 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210922fb-e9b8-4b76-836a-99a7529fe0dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:20.770268 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210922fb-e9b8-4b76-836a-99a7529fe0dc service cinder] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:20.779943 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1344/2668] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:36:20 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:36:20.796604 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6a56b2-3cc7-47b4-8231-db30ca773666 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:20.876636 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6a56b2-3cc7-47b4-8231-db30ca773666 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:20.882207 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50c29ad-2ed3-43a1-9998-8caa0ae9e8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:20.883763 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c29ad-2ed3-43a1-9998-8caa0ae9e8b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:20.884105 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c29ad-2ed3-43a1-9998-8caa0ae9e8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:20.884445 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c29ad-2ed3-43a1-9998-8caa0ae9e8b9 admin admin] PATH_INFO: `/v3/users/5e3dacdf66934875be33fba2361b6926` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:20.885839 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50c29ad-2ed3-43a1-9998-8caa0ae9e8b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e3dacdf66934875be33fba2361b6926)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:20.888044 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50c29ad-2ed3-43a1-9998-8caa0ae9e8b9 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:21.193598 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-c50c29ad-2ed3-43a1-9998-8caa0ae9e8b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e3dacdf66934875be33fba2361b6926'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:21.201038 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-c50c29ad-2ed3-43a1-9998-8caa0ae9e8b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e3dacdf66934875be33fba2361b6926'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:21.201865 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-c50c29ad-2ed3-43a1-9998-8caa0ae9e8b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e3dacdf66934875be33fba2361b6926'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:21.202515 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-c50c29ad-2ed3-43a1-9998-8caa0ae9e8b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e3dacdf66934875be33fba2361b6926'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:21.354170 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-c50c29ad-2ed3-43a1-9998-8caa0ae9e8b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e3dacdf66934875be33fba2361b6926'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:21.373781 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1325/2669] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:36:20 2022] DELETE /identity/v3/users/5e3dacdf66934875be33fba2361b6926 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:36:21.378697 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaff68b-fd17-4999-a942-7040e7a90469 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:21.379189 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaff68b-fd17-4999-a942-7040e7a90469 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:21.379321 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaff68b-fd17-4999-a942-7040e7a90469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:21.397567 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-4eaff68b-fd17-4999-a942-7040e7a90469 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:36:21.398837 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-4eaff68b-fd17-4999-a942-7040e7a90469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:21.471145 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1345/2670] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:36:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:36:21.483407 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50c29ad-2ed3-43a1-9998-8caa0ae9e8b9 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:21.488265 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-c50c29ad-2ed3-43a1-9998-8caa0ae9e8b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:21.530423 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:21.561071 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50c29ad-2ed3-43a1-9998-8caa0ae9e8b9 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:21.565368 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eda9bd9-370c-41bc-a5a0-2cfc2e683c20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:21.566189 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda9bd9-370c-41bc-a5a0-2cfc2e683c20 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:21.566866 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda9bd9-370c-41bc-a5a0-2cfc2e683c20 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:21.567253 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda9bd9-370c-41bc-a5a0-2cfc2e683c20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:21.591619 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eda9bd9-370c-41bc-a5a0-2cfc2e683c20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:21.593080 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eda9bd9-370c-41bc-a5a0-2cfc2e683c20 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:21.603932 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1326/2671] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:36:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:36:21.754277 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaff68b-fd17-4999-a942-7040e7a90469 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:21.757042 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-4eaff68b-fd17-4999-a942-7040e7a90469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:21.772836 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaff68b-fd17-4999-a942-7040e7a90469 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:21.780616 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c636ae8-aee5-4264-8316-345af825daee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:21.781503 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c636ae8-aee5-4264-8316-345af825daee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:21.781790 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c636ae8-aee5-4264-8316-345af825daee admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:21.782071 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c636ae8-aee5-4264-8316-345af825daee admin admin] PATH_INFO: `/v3/users/a239c638f1724839898cae77cf8e83df` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:21.783329 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c636ae8-aee5-4264-8316-345af825daee admin admin] RBAC: Authorizing `identity:delete_user(user_id=a239c638f1724839898cae77cf8e83df)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:21.785392 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c636ae8-aee5-4264-8316-345af825daee admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:21.815454 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:21.995313 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-8c636ae8-aee5-4264-8316-345af825daee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a239c638f1724839898cae77cf8e83df'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:22.010142 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-8c636ae8-aee5-4264-8316-345af825daee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a239c638f1724839898cae77cf8e83df'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:22.011038 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-8c636ae8-aee5-4264-8316-345af825daee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a239c638f1724839898cae77cf8e83df'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:22.011712 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-8c636ae8-aee5-4264-8316-345af825daee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a239c638f1724839898cae77cf8e83df'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:22.116488 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-8c636ae8-aee5-4264-8316-345af825daee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a239c638f1724839898cae77cf8e83df'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:22.130683 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1346/2672] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:36:21 2022] DELETE /identity/v3/users/a239c638f1724839898cae77cf8e83df => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:36:22.135808 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4563a0ff-c0e1-44c2-9a15-f1aef911e35a None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:22.136307 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4563a0ff-c0e1-44c2-9a15-f1aef911e35a None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:22.136444 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4563a0ff-c0e1-44c2-9a15-f1aef911e35a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:22.160182 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-4563a0ff-c0e1-44c2-9a15-f1aef911e35a None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:36:22.161670 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-4563a0ff-c0e1-44c2-9a15-f1aef911e35a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:22.234851 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1327/2673] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:36:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:36:22.245586 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c636ae8-aee5-4264-8316-345af825daee admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:22.247130 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-8c636ae8-aee5-4264-8316-345af825daee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:22.329492 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4563a0ff-c0e1-44c2-9a15-f1aef911e35a None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:22.331441 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-4563a0ff-c0e1-44c2-9a15-f1aef911e35a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:22.337365 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c636ae8-aee5-4264-8316-345af825daee admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:22.345160 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59bedaa-7061-4b8c-a1f8-3e288a3a6804 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:22.345160 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59bedaa-7061-4b8c-a1f8-3e288a3a6804 service neutron] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:22.345603 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59bedaa-7061-4b8c-a1f8-3e288a3a6804 service neutron] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:22.345683 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59bedaa-7061-4b8c-a1f8-3e288a3a6804 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:22.350705 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4563a0ff-c0e1-44c2-9a15-f1aef911e35a None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:22.359658 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15509f26-3f77-4d21-8726-0dbdc18b0700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:22.360922 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15509f26-3f77-4d21-8726-0dbdc18b0700 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:22.361405 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15509f26-3f77-4d21-8726-0dbdc18b0700 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:22.361871 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15509f26-3f77-4d21-8726-0dbdc18b0700 admin admin] PATH_INFO: `/v3/projects/0e0d356bb236463eb8f4e10cd7ddca3a` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:22.364375 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15509f26-3f77-4d21-8726-0dbdc18b0700 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e0d356bb236463eb8f4e10cd7ddca3a)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:22.366796 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15509f26-3f77-4d21-8726-0dbdc18b0700 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:22.382439 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59bedaa-7061-4b8c-a1f8-3e288a3a6804 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:22.382439 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59bedaa-7061-4b8c-a1f8-3e288a3a6804 service neutron] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:22.398519 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1347/2674] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:36:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:36:22.550509 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-15509f26-3f77-4d21-8726-0dbdc18b0700 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e0d356bb236463eb8f4e10cd7ddca3a', 'request_id': 'req-15509f26-3f77-4d21-8726-0dbdc18b0700'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:22.570173 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-15509f26-3f77-4d21-8726-0dbdc18b0700 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e0d356bb236463eb8f4e10cd7ddca3a', 'request_id': 'req-15509f26-3f77-4d21-8726-0dbdc18b0700'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:22.658558 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-15509f26-3f77-4d21-8726-0dbdc18b0700 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e0d356bb236463eb8f4e10cd7ddca3a', 'request_id': 'req-15509f26-3f77-4d21-8726-0dbdc18b0700'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:22.675674 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-15509f26-3f77-4d21-8726-0dbdc18b0700 admin admin] The token cache is being invalidate because project 0e0d356bb236463eb8f4e10cd7ddca3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:36:22.676177 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-15509f26-3f77-4d21-8726-0dbdc18b0700 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:22.680805 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-15509f26-3f77-4d21-8726-0dbdc18b0700 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:22.683229 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1328/2675] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:36:22 2022] DELETE /identity/v3/projects/0e0d356bb236463eb8f4e10cd7ddca3a => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:36:22.690853 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2971fbf7-9de3-4f5b-8aef-3a94365f691b None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:22.691076 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2971fbf7-9de3-4f5b-8aef-3a94365f691b None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:22.692035 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2971fbf7-9de3-4f5b-8aef-3a94365f691b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:22.722183 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-2971fbf7-9de3-4f5b-8aef-3a94365f691b None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:36:22.724056 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-2971fbf7-9de3-4f5b-8aef-3a94365f691b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:22.809953 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1348/2676] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:36:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:36:22.819533 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e6cb8e-d0de-4008-8c8e-b9bc93e97772 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:22.819831 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e6cb8e-d0de-4008-8c8e-b9bc93e97772 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:22.820123 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e6cb8e-d0de-4008-8c8e-b9bc93e97772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:22.873809 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-57e6cb8e-d0de-4008-8c8e-b9bc93e97772 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:36:22.875355 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-57e6cb8e-d0de-4008-8c8e-b9bc93e97772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:22.893251 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1329/2677] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:36:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:36:22.894685 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2971fbf7-9de3-4f5b-8aef-3a94365f691b None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:22.910228 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2971fbf7-9de3-4f5b-8aef-3a94365f691b None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:22.916726 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a539f-3321-41d9-834c-09cef79a51dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:22.917482 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a539f-3321-41d9-834c-09cef79a51dd admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:22.917840 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a539f-3321-41d9-834c-09cef79a51dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:22.918226 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a539f-3321-41d9-834c-09cef79a51dd admin admin] PATH_INFO: `/v3/domains` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:22.919099 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339a539f-3321-41d9-834c-09cef79a51dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:36:22.919511 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339a539f-3321-41d9-834c-09cef79a51dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:22.921401 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339a539f-3321-41d9-834c-09cef79a51dd admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:22.937643 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1349/2678] 10.222.0.62 () {58 vars in 1152 bytes} [Fri May 27 16:36:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:36:22.939380 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e6cb8e-d0de-4008-8c8e-b9bc93e97772 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:22.948923 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e6cb8e-d0de-4008-8c8e-b9bc93e97772 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:22.953731 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c3331-9bf2-4e53-8195-5700778137b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:22.954605 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c3331-9bf2-4e53-8195-5700778137b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:22.954985 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c3331-9bf2-4e53-8195-5700778137b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:22.955340 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c3331-9bf2-4e53-8195-5700778137b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:22.956111 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1c3331-9bf2-4e53-8195-5700778137b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:22.958088 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1c3331-9bf2-4e53-8195-5700778137b8 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:22.976212 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a539f-3321-41d9-834c-09cef79a51dd admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:22.981511 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-339a539f-3321-41d9-834c-09cef79a51dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:23.003143 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a539f-3321-41d9-834c-09cef79a51dd admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:23.008437 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834deb61-eb4d-4a9b-918a-2f72cf08b309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:23.009313 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834deb61-eb4d-4a9b-918a-2f72cf08b309 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:23.009607 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834deb61-eb4d-4a9b-918a-2f72cf08b309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:23.010034 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834deb61-eb4d-4a9b-918a-2f72cf08b309 admin admin] PATH_INFO: `/v3/projects/b7ea13bf0cb3479585e59d092cba8294` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:23.011436 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834deb61-eb4d-4a9b-918a-2f72cf08b309 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7ea13bf0cb3479585e59d092cba8294)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:23.017164 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834deb61-eb4d-4a9b-918a-2f72cf08b309 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:23.087080 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1330/2679] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:36:22 2022] POST /identity/v3/projects => generated 373 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:36:23.088707 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c3331-9bf2-4e53-8195-5700778137b8 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:23.121775 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:23.157546 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c3331-9bf2-4e53-8195-5700778137b8 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:23.162394 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb076757-4ae0-41d2-8d75-171963b042fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:23.163142 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb076757-4ae0-41d2-8d75-171963b042fc admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:23.163507 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb076757-4ae0-41d2-8d75-171963b042fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:23.163869 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb076757-4ae0-41d2-8d75-171963b042fc admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:23.165300 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb076757-4ae0-41d2-8d75-171963b042fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:23.167419 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb076757-4ae0-41d2-8d75-171963b042fc admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:23.195847 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-834deb61-eb4d-4a9b-918a-2f72cf08b309 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7ea13bf0cb3479585e59d092cba8294', 'request_id': 'req-834deb61-eb4d-4a9b-918a-2f72cf08b309'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:23.202668 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-834deb61-eb4d-4a9b-918a-2f72cf08b309 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7ea13bf0cb3479585e59d092cba8294', 'request_id': 'req-834deb61-eb4d-4a9b-918a-2f72cf08b309'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:23.208950 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-834deb61-eb4d-4a9b-918a-2f72cf08b309 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7ea13bf0cb3479585e59d092cba8294', 'request_id': 'req-834deb61-eb4d-4a9b-918a-2f72cf08b309'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:23.300599 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-834deb61-eb4d-4a9b-918a-2f72cf08b309 admin admin] The token cache is being invalidate because project b7ea13bf0cb3479585e59d092cba8294 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80288) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:36:23.300896 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-834deb61-eb4d-4a9b-918a-2f72cf08b309 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:23.301278 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1331/2680] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:36:23 2022] POST /identity/v3/users => generated 287 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:36:23.301672 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-834deb61-eb4d-4a9b-918a-2f72cf08b309 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:23.305784 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb076757-4ae0-41d2-8d75-171963b042fc admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:23.306679 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1350/2681] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:36:22 2022] DELETE /identity/v3/projects/b7ea13bf0cb3479585e59d092cba8294 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:36:23.308343 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-bb076757-4ae0-41d2-8d75-171963b042fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:23.322792 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb076757-4ae0-41d2-8d75-171963b042fc admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:23.323701 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ebb3bd-68ae-4ee7-ba37-947e0a8d1b64 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:23.324147 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ebb3bd-68ae-4ee7-ba37-947e0a8d1b64 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:23.327506 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ebb3bd-68ae-4ee7-ba37-947e0a8d1b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:23.345978 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-44ebb3bd-68ae-4ee7-ba37-947e0a8d1b64 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:36:23.347289 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-44ebb3bd-68ae-4ee7-ba37-947e0a8d1b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:23.385279 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:23.389059 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b78ff9c-cb07-4e59-8429-92c9ef8ca9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:23.389753 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b78ff9c-cb07-4e59-8429-92c9ef8ca9e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:23.390041 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b78ff9c-cb07-4e59-8429-92c9ef8ca9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:23.390354 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b78ff9c-cb07-4e59-8429-92c9ef8ca9e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:23.391151 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b78ff9c-cb07-4e59-8429-92c9ef8ca9e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:23.392772 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b78ff9c-cb07-4e59-8429-92c9ef8ca9e9 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:23.403646 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1332/2682] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:36:23 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 16:36:23.407464 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b78ff9c-cb07-4e59-8429-92c9ef8ca9e9 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:23.416894 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1351/2683] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:36:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:36:23.418090 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b78ff9c-cb07-4e59-8429-92c9ef8ca9e9 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:23.423142 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e78a7b-be55-4c72-8b94-1a4f5eb57457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:23.424043 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e78a7b-be55-4c72-8b94-1a4f5eb57457 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:23.424504 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e78a7b-be55-4c72-8b94-1a4f5eb57457 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:23.424955 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e78a7b-be55-4c72-8b94-1a4f5eb57457 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:23.425993 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e78a7b-be55-4c72-8b94-1a4f5eb57457 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:23.426127 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b195fd5c-dbba-45f8-8ad0-519548f7eecf None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:23.426342 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b195fd5c-dbba-45f8-8ad0-519548f7eecf None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:23.426795 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b195fd5c-dbba-45f8-8ad0-519548f7eecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:23.427672 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e78a7b-be55-4c72-8b94-1a4f5eb57457 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:23.438087 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1333/2684] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:36:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 16:36:23.442078 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e78a7b-be55-4c72-8b94-1a4f5eb57457 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:23.448914 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-b195fd5c-dbba-45f8-8ad0-519548f7eecf None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:36:23.450119 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-b195fd5c-dbba-45f8-8ad0-519548f7eecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:23.454684 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e78a7b-be55-4c72-8b94-1a4f5eb57457 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:23.458809 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1352/2685] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:36:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:36:23.463095 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a8de52-de59-4dd8-904c-34f694ebcb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:23.464045 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a8de52-de59-4dd8-904c-34f694ebcb77 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:23.464500 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a8de52-de59-4dd8-904c-34f694ebcb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:23.465969 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b195fd5c-dbba-45f8-8ad0-519548f7eecf None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:23.471482 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a8de52-de59-4dd8-904c-34f694ebcb77 admin admin] PATH_INFO: `/v3/projects/20671359994d468897f9be90e9e15252/users/efc54a5a5cf74f178793b0f0d96d54a8/roles/c8ce6d197f654598ac45f6016ecccabd` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:23.476258 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b195fd5c-dbba-45f8-8ad0-519548f7eecf None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:23.481162 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c594deda-7729-4422-bf2f-15087927dc30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:23.482008 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594deda-7729-4422-bf2f-15087927dc30 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:23.482479 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594deda-7729-4422-bf2f-15087927dc30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:23.482936 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594deda-7729-4422-bf2f-15087927dc30 admin admin] PATH_INFO: `/v3/domains` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:23.483837 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c594deda-7729-4422-bf2f-15087927dc30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:36:23.484307 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c594deda-7729-4422-bf2f-15087927dc30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:23.486068 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c594deda-7729-4422-bf2f-15087927dc30 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:23.489914 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a8de52-de59-4dd8-904c-34f694ebcb77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20671359994d468897f9be90e9e15252, user_id=efc54a5a5cf74f178793b0f0d96d54a8, role_id=c8ce6d197f654598ac45f6016ecccabd)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:23.493111 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a8de52-de59-4dd8-904c-34f694ebcb77 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:23.498736 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1353/2686] 10.222.0.62 () {58 vars in 1152 bytes} [Fri May 27 16:36:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:36:23.503491 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c594deda-7729-4422-bf2f-15087927dc30 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:23.514611 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c594deda-7729-4422-bf2f-15087927dc30 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:23.519464 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ab6fd7-8cb2-4dc1-a47f-5accfba2f2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:23.520168 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab6fd7-8cb2-4dc1-a47f-5accfba2f2c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:23.520459 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab6fd7-8cb2-4dc1-a47f-5accfba2f2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:23.520734 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab6fd7-8cb2-4dc1-a47f-5accfba2f2c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:23.521427 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ab6fd7-8cb2-4dc1-a47f-5accfba2f2c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:23.523359 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ab6fd7-8cb2-4dc1-a47f-5accfba2f2c3 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:23.583584 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1334/2687] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:36:23 2022] PUT /identity/v3/projects/20671359994d468897f9be90e9e15252/users/efc54a5a5cf74f178793b0f0d96d54a8/roles/c8ce6d197f654598ac45f6016ecccabd => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:36:23.589798 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ebdb6e-f8aa-4ee5-b52d-e8a12c83b303 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:23.590141 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ebdb6e-f8aa-4ee5-b52d-e8a12c83b303 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:23.590499 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ebdb6e-f8aa-4ee5-b52d-e8a12c83b303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:23.608865 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-b7ebdb6e-f8aa-4ee5-b52d-e8a12c83b303 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:36:23.610079 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-b7ebdb6e-f8aa-4ee5-b52d-e8a12c83b303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:23.627011 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1354/2688] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:36:23 2022] POST /identity/v3/projects => generated 377 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:36:23.629016 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ab6fd7-8cb2-4dc1-a47f-5accfba2f2c3 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:23.681217 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1335/2689] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:36:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:36:23.688258 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ebdb6e-f8aa-4ee5-b52d-e8a12c83b303 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:23.690446 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-b7ebdb6e-f8aa-4ee5-b52d-e8a12c83b303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:23.719986 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ab6fd7-8cb2-4dc1-a47f-5accfba2f2c3 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:23.733317 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4d561-d141-4401-9823-c12557d077ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:23.734008 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4d561-d141-4401-9823-c12557d077ff admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:23.734357 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4d561-d141-4401-9823-c12557d077ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:23.734604 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4d561-d141-4401-9823-c12557d077ff admin admin] PATH_INFO: `/v3/users` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:23.735327 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea4d561-d141-4401-9823-c12557d077ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:23.737245 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea4d561-d141-4401-9823-c12557d077ff admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:23.772418 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ebdb6e-f8aa-4ee5-b52d-e8a12c83b303 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:23.821734 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89afe32d-8b25-4ebe-a617-df0d7fb2f1c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:23.822492 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89afe32d-8b25-4ebe-a617-df0d7fb2f1c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:23.822777 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89afe32d-8b25-4ebe-a617-df0d7fb2f1c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:23.823058 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89afe32d-8b25-4ebe-a617-df0d7fb2f1c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:23.832741 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89afe32d-8b25-4ebe-a617-df0d7fb2f1c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:23.834322 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89afe32d-8b25-4ebe-a617-df0d7fb2f1c2 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:23.845825 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1336/2690] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:36:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 16:36:23.878073 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1355/2691] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:36:23 2022] POST /identity/v3/users => generated 289 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:36:23.882891 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89afe32d-8b25-4ebe-a617-df0d7fb2f1c2 service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:23.893349 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89afe32d-8b25-4ebe-a617-df0d7fb2f1c2 service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:23.901104 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db31bcb-830e-4dd1-a985-fc3f9fc91dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:23.901834 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db31bcb-830e-4dd1-a985-fc3f9fc91dce admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:23.902140 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db31bcb-830e-4dd1-a985-fc3f9fc91dce admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:23.902438 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db31bcb-830e-4dd1-a985-fc3f9fc91dce admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:23.903221 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db31bcb-830e-4dd1-a985-fc3f9fc91dce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:23.904895 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db31bcb-830e-4dd1-a985-fc3f9fc91dce admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:23.919952 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1337/2692] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:36:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:36:23.921322 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4d561-d141-4401-9823-c12557d077ff admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:23.936941 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4d561-d141-4401-9823-c12557d077ff admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:23.946971 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f88fc6-d4f6-4455-9948-fc57e22eb0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:23.948235 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f88fc6-d4f6-4455-9948-fc57e22eb0c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:23.948839 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f88fc6-d4f6-4455-9948-fc57e22eb0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:23.949524 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f88fc6-d4f6-4455-9948-fc57e22eb0c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:23.951164 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f88fc6-d4f6-4455-9948-fc57e22eb0c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:23.955102 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f88fc6-d4f6-4455-9948-fc57e22eb0c8 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:23.970027 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1356/2693] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:36:23 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 16:36:23.971806 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db31bcb-830e-4dd1-a985-fc3f9fc91dce admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:23.983052 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db31bcb-830e-4dd1-a985-fc3f9fc91dce admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:23.988222 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7173c186-4a15-43f0-88e8-c673c3e978a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:23.989338 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7173c186-4a15-43f0-88e8-c673c3e978a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:23.989740 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7173c186-4a15-43f0-88e8-c673c3e978a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:23.990115 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7173c186-4a15-43f0-88e8-c673c3e978a9 admin admin] PATH_INFO: `/v3/projects/95f2d5d88bfa443890f8f38ed44a3a9e/users/08d289dfb8ba4836b77449364907fd6e/roles/c8ce6d197f654598ac45f6016ecccabd` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:24.015132 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7173c186-4a15-43f0-88e8-c673c3e978a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95f2d5d88bfa443890f8f38ed44a3a9e, user_id=08d289dfb8ba4836b77449364907fd6e, role_id=c8ce6d197f654598ac45f6016ecccabd)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:24.018151 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7173c186-4a15-43f0-88e8-c673c3e978a9 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:24.124903 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1338/2694] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:36:23 2022] PUT /identity/v3/projects/95f2d5d88bfa443890f8f38ed44a3a9e/users/08d289dfb8ba4836b77449364907fd6e/roles/c8ce6d197f654598ac45f6016ecccabd => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:36:24.135401 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de589e-24bc-4d85-95cd-98e0377969b7 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:24.135702 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de589e-24bc-4d85-95cd-98e0377969b7 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:24.135984 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de589e-24bc-4d85-95cd-98e0377969b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:24.164941 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-b1de589e-24bc-4d85-95cd-98e0377969b7 None None] MFA Rules not processed for user `08d289dfb8ba4836b77449364907fd6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:36:24.166211 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-b1de589e-24bc-4d85-95cd-98e0377969b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:24.288932 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1357/2695] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:36:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:36:24.289758 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:24.294305 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7173c186-4a15-43f0-88e8-c673c3e978a9 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:24.368342 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7173c186-4a15-43f0-88e8-c673c3e978a9 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:24.383957 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85f256e-d38a-4b99-aec9-4a0cee13f650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:24.385217 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f256e-d38a-4b99-aec9-4a0cee13f650 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:24.386024 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f256e-d38a-4b99-aec9-4a0cee13f650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:24.386463 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f256e-d38a-4b99-aec9-4a0cee13f650 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:24.387308 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85f256e-d38a-4b99-aec9-4a0cee13f650 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:24.389444 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85f256e-d38a-4b99-aec9-4a0cee13f650 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:24.518301 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1339/2696] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:36:24 2022] POST /identity/v3/projects => generated 377 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:36:24.522372 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1de589e-24bc-4d85-95cd-98e0377969b7 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:24.534628 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1de589e-24bc-4d85-95cd-98e0377969b7 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:24.613262 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d32bb49-34ce-4374-8e08-2e411d489542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:24.614340 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d32bb49-34ce-4374-8e08-2e411d489542 admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:24.614814 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d32bb49-34ce-4374-8e08-2e411d489542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:24.615249 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d32bb49-34ce-4374-8e08-2e411d489542 admin admin] PATH_INFO: `/v3/users` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:24.616116 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d32bb49-34ce-4374-8e08-2e411d489542 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:24.618454 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d32bb49-34ce-4374-8e08-2e411d489542 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:24.729128 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:24.771442 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85f256e-d38a-4b99-aec9-4a0cee13f650 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:24.777845 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1358/2697] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:36:24 2022] POST /identity/v3/users => generated 289 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:36:24.784063 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85f256e-d38a-4b99-aec9-4a0cee13f650 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:24.789948 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e85398c-1d6a-4ab7-888e-47f183585492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:24.790662 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e85398c-1d6a-4ab7-888e-47f183585492 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:24.791533 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e85398c-1d6a-4ab7-888e-47f183585492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:24.791831 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e85398c-1d6a-4ab7-888e-47f183585492 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:24.792835 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e85398c-1d6a-4ab7-888e-47f183585492 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:24.795934 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e85398c-1d6a-4ab7-888e-47f183585492 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:24.814766 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d32bb49-34ce-4374-8e08-2e411d489542 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:24.824789 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1340/2698] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:36:24 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:36:24.826568 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d32bb49-34ce-4374-8e08-2e411d489542 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:24.831800 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb19dce-0f53-4cd0-94fb-1f46c9bfbb5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:24.832488 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb19dce-0f53-4cd0-94fb-1f46c9bfbb5d admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:24.832784 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb19dce-0f53-4cd0-94fb-1f46c9bfbb5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:24.833071 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb19dce-0f53-4cd0-94fb-1f46c9bfbb5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:24.834148 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb19dce-0f53-4cd0-94fb-1f46c9bfbb5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:24.836765 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb19dce-0f53-4cd0-94fb-1f46c9bfbb5d admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:24.853214 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e85398c-1d6a-4ab7-888e-47f183585492 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:24.860723 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1359/2699] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:36:24 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:36:24.865286 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e85398c-1d6a-4ab7-888e-47f183585492 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:24.872412 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97abe06-474d-4832-9bb8-d081e667d064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:24.873420 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97abe06-474d-4832-9bb8-d081e667d064 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:24.873898 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97abe06-474d-4832-9bb8-d081e667d064 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:24.874394 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97abe06-474d-4832-9bb8-d081e667d064 admin admin] PATH_INFO: `/v3/projects/f328dd953d9d4359825e0a4dcd2f4d5a/users/761ab270e65b45bfa04f0a5ea19084e4/roles/c8ce6d197f654598ac45f6016ecccabd` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:24.895170 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97abe06-474d-4832-9bb8-d081e667d064 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f328dd953d9d4359825e0a4dcd2f4d5a, user_id=761ab270e65b45bfa04f0a5ea19084e4, role_id=c8ce6d197f654598ac45f6016ecccabd)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:24.897916 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97abe06-474d-4832-9bb8-d081e667d064 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:24.993975 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1341/2700] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:36:24 2022] PUT /identity/v3/projects/f328dd953d9d4359825e0a4dcd2f4d5a/users/761ab270e65b45bfa04f0a5ea19084e4/roles/c8ce6d197f654598ac45f6016ecccabd => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:36:24.996415 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e2397-267f-401c-aae9-5c2f4a243940 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:24.997116 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e2397-267f-401c-aae9-5c2f4a243940 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:24.997561 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e2397-267f-401c-aae9-5c2f4a243940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:25.049314 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-2b4e2397-267f-401c-aae9-5c2f4a243940 None None] MFA Rules not processed for user `761ab270e65b45bfa04f0a5ea19084e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:36:25.051764 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-2b4e2397-267f-401c-aae9-5c2f4a243940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:25.119519 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1360/2701] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:36:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:36:25.124323 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97abe06-474d-4832-9bb8-d081e667d064 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:25.190437 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97abe06-474d-4832-9bb8-d081e667d064 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:25.196304 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c4779a-0ac7-45ae-a547-d8896a53ecb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:25.197007 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c4779a-0ac7-45ae-a547-d8896a53ecb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:25.197297 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c4779a-0ac7-45ae-a547-d8896a53ecb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:25.197579 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c4779a-0ac7-45ae-a547-d8896a53ecb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:25.198322 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c4779a-0ac7-45ae-a547-d8896a53ecb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:25.200931 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c4779a-0ac7-45ae-a547-d8896a53ecb1 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:25.333392 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1342/2702] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:36:25 2022] POST /identity/v3/projects => generated 377 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:36:25.335402 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4e2397-267f-401c-aae9-5c2f4a243940 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:25.348261 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4e2397-267f-401c-aae9-5c2f4a243940 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:25.508733 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2005c07c-6044-4cbe-95ed-e3e3c4709cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:25.509018 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bfca5b-9e0e-4108-8266-0be6c442a926 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:25.509289 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bfca5b-9e0e-4108-8266-0be6c442a926 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:25.509576 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bfca5b-9e0e-4108-8266-0be6c442a926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:25.510783 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2005c07c-6044-4cbe-95ed-e3e3c4709cef admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:25.512167 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2005c07c-6044-4cbe-95ed-e3e3c4709cef admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:25.512931 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2005c07c-6044-4cbe-95ed-e3e3c4709cef admin admin] PATH_INFO: `/v3/users` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:25.513942 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2005c07c-6044-4cbe-95ed-e3e3c4709cef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:25.516296 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2005c07c-6044-4cbe-95ed-e3e3c4709cef admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:25.540147 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-38bfca5b-9e0e-4108-8266-0be6c442a926 None None] MFA Rules not processed for user `efc54a5a5cf74f178793b0f0d96d54a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:36:25.547547 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-38bfca5b-9e0e-4108-8266-0be6c442a926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:25.634428 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1343/2703] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:36:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:36:25.642332 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bfca5b-9e0e-4108-8266-0be6c442a926 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:25.644051 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-38bfca5b-9e0e-4108-8266-0be6c442a926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:25.681870 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:25.681994 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1361/2704] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:36:25 2022] POST /identity/v3/users => generated 295 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:36:25.682946 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2005c07c-6044-4cbe-95ed-e3e3c4709cef admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:25.694417 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2005c07c-6044-4cbe-95ed-e3e3c4709cef admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:25.700932 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa06384-78d2-464e-af64-4b666f7486be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:25.701654 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa06384-78d2-464e-af64-4b666f7486be admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:25.701945 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa06384-78d2-464e-af64-4b666f7486be admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:25.702227 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa06384-78d2-464e-af64-4b666f7486be admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:25.703052 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa06384-78d2-464e-af64-4b666f7486be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:25.705707 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa06384-78d2-464e-af64-4b666f7486be admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:25.718276 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1362/2705] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:36:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:36:25.718899 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bfca5b-9e0e-4108-8266-0be6c442a926 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:25.722561 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa06384-78d2-464e-af64-4b666f7486be admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:25.724982 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28f3480-db4c-4027-9ec2-299ece33c1c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8693a1e72f14fdfb383f11e96330726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:25.725917 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f3480-db4c-4027-9ec2-299ece33c1c8 service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:25.726980 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f3480-db4c-4027-9ec2-299ece33c1c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:25.727464 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f3480-db4c-4027-9ec2-299ece33c1c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:25.734164 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa06384-78d2-464e-af64-4b666f7486be admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:25.738574 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28f3480-db4c-4027-9ec2-299ece33c1c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:25.739835 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daf3482-b081-4546-8cf2-a30ce43ef106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:25.740533 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28f3480-db4c-4027-9ec2-299ece33c1c8 service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:25.740935 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daf3482-b081-4546-8cf2-a30ce43ef106 admin admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:25.741322 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daf3482-b081-4546-8cf2-a30ce43ef106 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:25.741868 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daf3482-b081-4546-8cf2-a30ce43ef106 admin admin] PATH_INFO: `/v3/projects/9626147c6edc4cffbe5d023fd568c511/users/3becc810b1d14ef49505ddc1d7c667c3/roles/e04fe3eb1f714d74901ac83e33ea8a16` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:25.758540 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1344/2706] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:36:25 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:36:25.760610 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daf3482-b081-4546-8cf2-a30ce43ef106 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9626147c6edc4cffbe5d023fd568c511, user_id=3becc810b1d14ef49505ddc1d7c667c3, role_id=e04fe3eb1f714d74901ac83e33ea8a16)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:25.764798 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daf3482-b081-4546-8cf2-a30ce43ef106 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:25.912488 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1363/2707] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:36:25 2022] PUT /identity/v3/projects/9626147c6edc4cffbe5d023fd568c511/users/3becc810b1d14ef49505ddc1d7c667c3/roles/e04fe3eb1f714d74901ac83e33ea8a16 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:36:25.916715 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28f3480-db4c-4027-9ec2-299ece33c1c8 service cinder] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:25.928075 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28f3480-db4c-4027-9ec2-299ece33c1c8 service cinder] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:26.011682 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6f4ae9-1abf-41a8-a669-76986e8b88a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:26.013057 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f4ae9-1abf-41a8-a669-76986e8b88a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:26.013465 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f4ae9-1abf-41a8-a669-76986e8b88a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:26.013855 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f4ae9-1abf-41a8-a669-76986e8b88a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:26.014990 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6f4ae9-1abf-41a8-a669-76986e8b88a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:26.016738 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6f4ae9-1abf-41a8-a669-76986e8b88a4 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:26.028933 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1345/2708] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:36:25 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:36:26.031974 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daf3482-b081-4546-8cf2-a30ce43ef106 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:26.042508 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daf3482-b081-4546-8cf2-a30ce43ef106 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:26.071162 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10d2395-092f-4cf0-82f9-eb622ce4659a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:26.071775 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d2395-092f-4cf0-82f9-eb622ce4659a admin admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:26.072061 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d2395-092f-4cf0-82f9-eb622ce4659a admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:26.072334 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d2395-092f-4cf0-82f9-eb622ce4659a admin admin] PATH_INFO: `/v3/projects/9626147c6edc4cffbe5d023fd568c511/users/3becc810b1d14ef49505ddc1d7c667c3/roles/e04fe3eb1f714d74901ac83e33ea8a16` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:26.075467 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10d2395-092f-4cf0-82f9-eb622ce4659a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9626147c6edc4cffbe5d023fd568c511, user_id=3becc810b1d14ef49505ddc1d7c667c3, role_id=e04fe3eb1f714d74901ac83e33ea8a16)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:26.079823 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10d2395-092f-4cf0-82f9-eb622ce4659a admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:26.097924 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1364/2709] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:36:26 2022] PUT /identity/v3/projects/9626147c6edc4cffbe5d023fd568c511/users/3becc810b1d14ef49505ddc1d7c667c3/roles/e04fe3eb1f714d74901ac83e33ea8a16 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:36:26.107878 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f027d63-4e9f-4aee-9094-2b1cacf23062 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:26.108080 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f027d63-4e9f-4aee-9094-2b1cacf23062 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:26.108349 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f027d63-4e9f-4aee-9094-2b1cacf23062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:26.137641 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-7f027d63-4e9f-4aee-9094-2b1cacf23062 None None] MFA Rules not processed for user `3becc810b1d14ef49505ddc1d7c667c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:36:26.139283 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-7f027d63-4e9f-4aee-9094-2b1cacf23062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:26.239656 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1346/2710] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:36:26 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:36:26.255043 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10d2395-092f-4cf0-82f9-eb622ce4659a admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:26.259148 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-b10d2395-092f-4cf0-82f9-eb622ce4659a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:26.390622 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10d2395-092f-4cf0-82f9-eb622ce4659a admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:26.407361 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb38c1aa-038c-4173-bf5b-88a38114e2e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8693a1e72f14fdfb383f11e96330726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:26.408111 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38c1aa-038c-4173-bf5b-88a38114e2e3 service cinder] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:26.408464 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38c1aa-038c-4173-bf5b-88a38114e2e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:26.409648 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38c1aa-038c-4173-bf5b-88a38114e2e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:26.555852 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb38c1aa-038c-4173-bf5b-88a38114e2e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:26.564350 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb38c1aa-038c-4173-bf5b-88a38114e2e3 service cinder] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:26.582978 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1365/2711] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:36:26 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:36:26.929571 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff0bb0f-95af-4592-b08a-2460d3dff291 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:26.930792 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff0bb0f-95af-4592-b08a-2460d3dff291 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:26.931443 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff0bb0f-95af-4592-b08a-2460d3dff291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:26.983178 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-2ff0bb0f-95af-4592-b08a-2460d3dff291 None None] MFA Rules not processed for user `eb50bf5f39b04ab689b55f46d3dd2640`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:36:26.984628 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-2ff0bb0f-95af-4592-b08a-2460d3dff291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:27.057250 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1347/2712] 10.222.0.62 () {58 vars in 1009 bytes} [Fri May 27 16:36:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:36:27.069338 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb38c1aa-038c-4173-bf5b-88a38114e2e3 service cinder] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:27.070884 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-eb38c1aa-038c-4173-bf5b-88a38114e2e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:27.154097 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb38c1aa-038c-4173-bf5b-88a38114e2e3 service cinder] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:27.159659 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c573cf37-8299-4e45-a02b-63987b25ecfd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8e6ec55445045fcac5623b9b6ffa9ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:27.160314 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573cf37-8299-4e45-a02b-63987b25ecfd service swift] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:27.160596 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573cf37-8299-4e45-a02b-63987b25ecfd service swift] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:27.160875 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573cf37-8299-4e45-a02b-63987b25ecfd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:27.170456 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c573cf37-8299-4e45-a02b-63987b25ecfd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:27.172650 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c573cf37-8299-4e45-a02b-63987b25ecfd service swift] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:27.182820 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1366/2713] 10.222.0.62 () {60 vars in 1384 bytes} [Fri May 27 16:36:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 16:36:27.526400 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:27.589386 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:27.926271 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f1f4ad-d20c-4e90-bb38-6b5db8b9582e None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:27.926477 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f1f4ad-d20c-4e90-bb38-6b5db8b9582e None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:27.926685 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f1f4ad-d20c-4e90-bb38-6b5db8b9582e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:27.948795 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-e1f1f4ad-d20c-4e90-bb38-6b5db8b9582e None None] MFA Rules not processed for user `efc54a5a5cf74f178793b0f0d96d54a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:36:27.954934 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-e1f1f4ad-d20c-4e90-bb38-6b5db8b9582e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:28.046453 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1348/2714] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:36:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:36:28.543475 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c573cf37-8299-4e45-a02b-63987b25ecfd service swift] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:28.628921 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c573cf37-8299-4e45-a02b-63987b25ecfd service swift] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:28.665532 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15987e05-e681-4873-99cd-139a1f7e6b78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:28.666360 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15987e05-e681-4873-99cd-139a1f7e6b78 service neutron] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:28.666666 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15987e05-e681-4873-99cd-139a1f7e6b78 service neutron] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:28.667030 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15987e05-e681-4873-99cd-139a1f7e6b78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:28.676535 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-15987e05-e681-4873-99cd-139a1f7e6b78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:28.691108 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15987e05-e681-4873-99cd-139a1f7e6b78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:28.692570 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15987e05-e681-4873-99cd-139a1f7e6b78 service neutron] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:28.702575 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1367/2715] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:36:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:36:28.816058 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f1f4ad-d20c-4e90-bb38-6b5db8b9582e None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:28.822611 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-e1f1f4ad-d20c-4e90-bb38-6b5db8b9582e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:28.944123 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f1f4ad-d20c-4e90-bb38-6b5db8b9582e None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:28.968099 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585275b7-d6e1-4979-9138-6f29daaea4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:28.969809 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585275b7-d6e1-4979-9138-6f29daaea4af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:28.971682 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585275b7-d6e1-4979-9138-6f29daaea4af admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:28.975759 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585275b7-d6e1-4979-9138-6f29daaea4af admin admin] PATH_INFO: `/v3/users/4203b914b8bd40249d70dc77fb7c56f1` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:28.982454 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585275b7-d6e1-4979-9138-6f29daaea4af admin admin] RBAC: Authorizing `identity:delete_user(user_id=4203b914b8bd40249d70dc77fb7c56f1)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:28.982454 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585275b7-d6e1-4979-9138-6f29daaea4af admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:29.077001 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:29.086416 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15987e05-e681-4873-99cd-139a1f7e6b78 service neutron] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:29.099616 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15987e05-e681-4873-99cd-139a1f7e6b78 service neutron] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:29.110047 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16bbcc4-e718-4aa5-b85f-f7f96d445122 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8693a1e72f14fdfb383f11e96330726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:29.112995 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:29.113938 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16bbcc4-e718-4aa5-b85f-f7f96d445122 service cinder] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:29.114959 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16bbcc4-e718-4aa5-b85f-f7f96d445122 service cinder] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:29.115798 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16bbcc4-e718-4aa5-b85f-f7f96d445122 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:29.197778 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16bbcc4-e718-4aa5-b85f-f7f96d445122 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:29.199501 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16bbcc4-e718-4aa5-b85f-f7f96d445122 service cinder] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:29.210997 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1368/2716] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:36:29 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 16:36:29.245468 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-585275b7-d6e1-4979-9138-6f29daaea4af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4203b914b8bd40249d70dc77fb7c56f1'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:29.256360 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-585275b7-d6e1-4979-9138-6f29daaea4af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4203b914b8bd40249d70dc77fb7c56f1'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:29.257516 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-585275b7-d6e1-4979-9138-6f29daaea4af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4203b914b8bd40249d70dc77fb7c56f1'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:29.258877 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-585275b7-d6e1-4979-9138-6f29daaea4af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4203b914b8bd40249d70dc77fb7c56f1'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:29.400065 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-585275b7-d6e1-4979-9138-6f29daaea4af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4203b914b8bd40249d70dc77fb7c56f1'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:29.434823 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1349/2717] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:36:28 2022] DELETE /identity/v3/users/4203b914b8bd40249d70dc77fb7c56f1 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:36:29.850365 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16bbcc4-e718-4aa5-b85f-f7f96d445122 service cinder] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:29.881143 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16bbcc4-e718-4aa5-b85f-f7f96d445122 service cinder] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:29.965192 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608b9d03-260b-4ecd-83d5-a4f1df6a150a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:29.966073 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b9d03-260b-4ecd-83d5-a4f1df6a150a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:29.966396 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b9d03-260b-4ecd-83d5-a4f1df6a150a admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:29.966693 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b9d03-260b-4ecd-83d5-a4f1df6a150a admin admin] PATH_INFO: `/v3/projects/8162d445bdab4e14abeaae6242eece45` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:29.967889 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608b9d03-260b-4ecd-83d5-a4f1df6a150a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8162d445bdab4e14abeaae6242eece45)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:29.969797 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608b9d03-260b-4ecd-83d5-a4f1df6a150a admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:30.091180 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-608b9d03-260b-4ecd-83d5-a4f1df6a150a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8162d445bdab4e14abeaae6242eece45', 'request_id': 'req-608b9d03-260b-4ecd-83d5-a4f1df6a150a'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:30.102579 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-608b9d03-260b-4ecd-83d5-a4f1df6a150a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8162d445bdab4e14abeaae6242eece45', 'request_id': 'req-608b9d03-260b-4ecd-83d5-a4f1df6a150a'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:30.109398 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-608b9d03-260b-4ecd-83d5-a4f1df6a150a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8162d445bdab4e14abeaae6242eece45', 'request_id': 'req-608b9d03-260b-4ecd-83d5-a4f1df6a150a'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:30.245103 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-608b9d03-260b-4ecd-83d5-a4f1df6a150a admin admin] The token cache is being invalidate because project 8162d445bdab4e14abeaae6242eece45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80288) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:36:30.245507 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-608b9d03-260b-4ecd-83d5-a4f1df6a150a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:30.250343 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-608b9d03-260b-4ecd-83d5-a4f1df6a150a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:30.252160 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1369/2718] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:36:29 2022] DELETE /identity/v3/projects/8162d445bdab4e14abeaae6242eece45 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:36:30.256224 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585275b7-d6e1-4979-9138-6f29daaea4af admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:30.257744 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-585275b7-d6e1-4979-9138-6f29daaea4af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:30.275103 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585275b7-d6e1-4979-9138-6f29daaea4af admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:30.345974 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5d0040-eb24-4450-89ed-a353b99e2d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:30.347320 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d0040-eb24-4450-89ed-a353b99e2d20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:30.347588 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d0040-eb24-4450-89ed-a353b99e2d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:30.347869 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d0040-eb24-4450-89ed-a353b99e2d20 admin admin] PATH_INFO: `/v3/users/9c61e98233b54b87b35317dda4d78510` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:30.349490 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5d0040-eb24-4450-89ed-a353b99e2d20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c61e98233b54b87b35317dda4d78510)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:30.352246 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5d0040-eb24-4450-89ed-a353b99e2d20 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:30.365343 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:30.574018 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-3f5d0040-eb24-4450-89ed-a353b99e2d20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c61e98233b54b87b35317dda4d78510'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:30.584477 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-3f5d0040-eb24-4450-89ed-a353b99e2d20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c61e98233b54b87b35317dda4d78510'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:30.585486 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-3f5d0040-eb24-4450-89ed-a353b99e2d20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c61e98233b54b87b35317dda4d78510'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:30.586708 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-3f5d0040-eb24-4450-89ed-a353b99e2d20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c61e98233b54b87b35317dda4d78510'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:30.670570 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-3f5d0040-eb24-4450-89ed-a353b99e2d20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c61e98233b54b87b35317dda4d78510'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:30.696555 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1350/2719] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:36:30 2022] DELETE /identity/v3/users/9c61e98233b54b87b35317dda4d78510 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:36:31.459713 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=100 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:31.552127 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608b9d03-260b-4ecd-83d5-a4f1df6a150a admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:31.553696 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-608b9d03-260b-4ecd-83d5-a4f1df6a150a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:31.566994 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608b9d03-260b-4ecd-83d5-a4f1df6a150a admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:31.642935 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cb9d56-9417-473b-8af2-26bb392a0ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:31.643811 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb9d56-9417-473b-8af2-26bb392a0ef9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:31.644102 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb9d56-9417-473b-8af2-26bb392a0ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:31.644408 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb9d56-9417-473b-8af2-26bb392a0ef9 admin admin] PATH_INFO: `/v3/projects/588ffca2fc234f978ed9c7a49380a3a3` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:31.645948 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cb9d56-9417-473b-8af2-26bb392a0ef9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=588ffca2fc234f978ed9c7a49380a3a3)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:31.647893 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cb9d56-9417-473b-8af2-26bb392a0ef9 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:31.753893 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5d0040-eb24-4450-89ed-a353b99e2d20 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:31.756110 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-3f5d0040-eb24-4450-89ed-a353b99e2d20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:31.786170 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-48cb9d56-9417-473b-8af2-26bb392a0ef9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '588ffca2fc234f978ed9c7a49380a3a3', 'request_id': 'req-48cb9d56-9417-473b-8af2-26bb392a0ef9'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:31.794875 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-48cb9d56-9417-473b-8af2-26bb392a0ef9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '588ffca2fc234f978ed9c7a49380a3a3', 'request_id': 'req-48cb9d56-9417-473b-8af2-26bb392a0ef9'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:31.802555 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-48cb9d56-9417-473b-8af2-26bb392a0ef9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '588ffca2fc234f978ed9c7a49380a3a3', 'request_id': 'req-48cb9d56-9417-473b-8af2-26bb392a0ef9'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:31.858483 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5d0040-eb24-4450-89ed-a353b99e2d20 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:31.922757 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-48cb9d56-9417-473b-8af2-26bb392a0ef9 admin admin] The token cache is being invalidate because project 588ffca2fc234f978ed9c7a49380a3a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80288) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:36:31.923059 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-48cb9d56-9417-473b-8af2-26bb392a0ef9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:31.923705 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-48cb9d56-9417-473b-8af2-26bb392a0ef9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:31.938608 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1370/2720] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:36:31 2022] DELETE /identity/v3/projects/588ffca2fc234f978ed9c7a49380a3a3 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:36:31.941521 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce07be-57e5-46ad-9299-ce3d7e57aa16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8693a1e72f14fdfb383f11e96330726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:31.943217 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce07be-57e5-46ad-9299-ce3d7e57aa16 service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:31.943217 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce07be-57e5-46ad-9299-ce3d7e57aa16 service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:31.943217 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce07be-57e5-46ad-9299-ce3d7e57aa16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:31.945167 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-d5ce07be-57e5-46ad-9299-ce3d7e57aa16 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:32.141784 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ce07be-57e5-46ad-9299-ce3d7e57aa16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:32.143664 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ce07be-57e5-46ad-9299-ce3d7e57aa16 service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:32.159491 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1351/2721] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:36:31 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 16:36:32.320215 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:32.619706 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:38.607797 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cb9d56-9417-473b-8af2-26bb392a0ef9 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:38.609290 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-48cb9d56-9417-473b-8af2-26bb392a0ef9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:38.673848 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cb9d56-9417-473b-8af2-26bb392a0ef9 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:38.678968 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412844bc-df76-4568-9837-0f698727d8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:38.679384 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412844bc-df76-4568-9837-0f698727d8d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:38.679670 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412844bc-df76-4568-9837-0f698727d8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:38.679946 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412844bc-df76-4568-9837-0f698727d8d5 admin admin] PATH_INFO: `/v3/users/08d289dfb8ba4836b77449364907fd6e` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:38.681836 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412844bc-df76-4568-9837-0f698727d8d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08d289dfb8ba4836b77449364907fd6e)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:38.683791 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412844bc-df76-4568-9837-0f698727d8d5 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:38.917471 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-412844bc-df76-4568-9837-0f698727d8d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08d289dfb8ba4836b77449364907fd6e'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:38.941381 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-412844bc-df76-4568-9837-0f698727d8d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08d289dfb8ba4836b77449364907fd6e'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:38.942137 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-412844bc-df76-4568-9837-0f698727d8d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08d289dfb8ba4836b77449364907fd6e'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:38.944120 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-412844bc-df76-4568-9837-0f698727d8d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08d289dfb8ba4836b77449364907fd6e'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:39.036001 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-412844bc-df76-4568-9837-0f698727d8d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08d289dfb8ba4836b77449364907fd6e'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:39.055228 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1371/2722] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:36:38 2022] DELETE /identity/v3/users/08d289dfb8ba4836b77449364907fd6e => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:36:39.060244 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824349cc-609d-4af7-ae77-482d068175cb None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:39.060767 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824349cc-609d-4af7-ae77-482d068175cb None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:39.060855 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824349cc-609d-4af7-ae77-482d068175cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:39.080105 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-824349cc-609d-4af7-ae77-482d068175cb None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:36:39.082019 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-824349cc-609d-4af7-ae77-482d068175cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:39.151954 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1352/2723] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:36:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:36:39.162166 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412844bc-df76-4568-9837-0f698727d8d5 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:39.163727 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-412844bc-df76-4568-9837-0f698727d8d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:39.232231 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412844bc-df76-4568-9837-0f698727d8d5 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:39.236044 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56f9ef3-8e44-4e63-8950-4ee2bd3a8cd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:39.236673 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f9ef3-8e44-4e63-8950-4ee2bd3a8cd2 service neutron] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:39.236955 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f9ef3-8e44-4e63-8950-4ee2bd3a8cd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:39.237386 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f9ef3-8e44-4e63-8950-4ee2bd3a8cd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:39.247385 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56f9ef3-8e44-4e63-8950-4ee2bd3a8cd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:39.248852 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56f9ef3-8e44-4e63-8950-4ee2bd3a8cd2 service neutron] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:39.253170 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:39.260040 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1372/2724] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:36:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 16:36:39.947102 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824349cc-609d-4af7-ae77-482d068175cb None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:39.948503 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-824349cc-609d-4af7-ae77-482d068175cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:39.961605 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824349cc-609d-4af7-ae77-482d068175cb None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:39.967431 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a323f1b-75cd-4055-a6df-dc4d34bfe9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:39.968473 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a323f1b-75cd-4055-a6df-dc4d34bfe9af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:39.969323 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a323f1b-75cd-4055-a6df-dc4d34bfe9af admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:39.969323 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a323f1b-75cd-4055-a6df-dc4d34bfe9af admin admin] PATH_INFO: `/v3/projects/95f2d5d88bfa443890f8f38ed44a3a9e` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:39.970548 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a323f1b-75cd-4055-a6df-dc4d34bfe9af admin admin] RBAC: Authorizing `identity:delete_project(project_id=95f2d5d88bfa443890f8f38ed44a3a9e)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:39.972895 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a323f1b-75cd-4055-a6df-dc4d34bfe9af admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:40.136727 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-4a323f1b-75cd-4055-a6df-dc4d34bfe9af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95f2d5d88bfa443890f8f38ed44a3a9e', 'request_id': 'req-4a323f1b-75cd-4055-a6df-dc4d34bfe9af'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:40.143971 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-4a323f1b-75cd-4055-a6df-dc4d34bfe9af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95f2d5d88bfa443890f8f38ed44a3a9e', 'request_id': 'req-4a323f1b-75cd-4055-a6df-dc4d34bfe9af'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:40.241710 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-4a323f1b-75cd-4055-a6df-dc4d34bfe9af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95f2d5d88bfa443890f8f38ed44a3a9e', 'request_id': 'req-4a323f1b-75cd-4055-a6df-dc4d34bfe9af'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:40.253526 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-4a323f1b-75cd-4055-a6df-dc4d34bfe9af admin admin] The token cache is being invalidate because project 95f2d5d88bfa443890f8f38ed44a3a9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:36:40.253816 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-4a323f1b-75cd-4055-a6df-dc4d34bfe9af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:40.254469 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-4a323f1b-75cd-4055-a6df-dc4d34bfe9af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:40.255998 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1353/2725] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:36:39 2022] DELETE /identity/v3/projects/95f2d5d88bfa443890f8f38ed44a3a9e => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:36:40.260644 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56f9ef3-8e44-4e63-8950-4ee2bd3a8cd2 service neutron] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:40.270787 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56f9ef3-8e44-4e63-8950-4ee2bd3a8cd2 service neutron] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:40.329888 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473bd9e2-971a-404f-babc-a6f70abf98d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:40.330858 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473bd9e2-971a-404f-babc-a6f70abf98d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:40.331289 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473bd9e2-971a-404f-babc-a6f70abf98d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:40.331554 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473bd9e2-971a-404f-babc-a6f70abf98d6 admin admin] PATH_INFO: `/v3/users/761ab270e65b45bfa04f0a5ea19084e4` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:40.333025 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473bd9e2-971a-404f-babc-a6f70abf98d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=761ab270e65b45bfa04f0a5ea19084e4)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:40.335006 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473bd9e2-971a-404f-babc-a6f70abf98d6 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:40.519536 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-473bd9e2-971a-404f-babc-a6f70abf98d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '761ab270e65b45bfa04f0a5ea19084e4'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:40.533104 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-473bd9e2-971a-404f-babc-a6f70abf98d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '761ab270e65b45bfa04f0a5ea19084e4'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:40.533845 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-473bd9e2-971a-404f-babc-a6f70abf98d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '761ab270e65b45bfa04f0a5ea19084e4'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:40.534510 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-473bd9e2-971a-404f-babc-a6f70abf98d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '761ab270e65b45bfa04f0a5ea19084e4'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:40.613482 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-473bd9e2-971a-404f-babc-a6f70abf98d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '761ab270e65b45bfa04f0a5ea19084e4'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:40.629710 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1373/2726] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:36:40 2022] DELETE /identity/v3/users/761ab270e65b45bfa04f0a5ea19084e4 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:36:41.334611 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a323f1b-75cd-4055-a6df-dc4d34bfe9af admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:41.336170 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-4a323f1b-75cd-4055-a6df-dc4d34bfe9af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:41.351388 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a323f1b-75cd-4055-a6df-dc4d34bfe9af admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:41.423767 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00bde0f-07b9-46da-862f-0fab1786e5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:41.424639 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00bde0f-07b9-46da-862f-0fab1786e5f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:41.424924 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00bde0f-07b9-46da-862f-0fab1786e5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:41.425202 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00bde0f-07b9-46da-862f-0fab1786e5f3 admin admin] PATH_INFO: `/v3/projects/f328dd953d9d4359825e0a4dcd2f4d5a` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:41.426439 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00bde0f-07b9-46da-862f-0fab1786e5f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f328dd953d9d4359825e0a4dcd2f4d5a)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:41.428344 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00bde0f-07b9-46da-862f-0fab1786e5f3 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:41.440460 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:41.538711 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-e00bde0f-07b9-46da-862f-0fab1786e5f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f328dd953d9d4359825e0a4dcd2f4d5a', 'request_id': 'req-e00bde0f-07b9-46da-862f-0fab1786e5f3'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:41.545325 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-e00bde0f-07b9-46da-862f-0fab1786e5f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f328dd953d9d4359825e0a4dcd2f4d5a', 'request_id': 'req-e00bde0f-07b9-46da-862f-0fab1786e5f3'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:41.652674 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-e00bde0f-07b9-46da-862f-0fab1786e5f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f328dd953d9d4359825e0a4dcd2f4d5a', 'request_id': 'req-e00bde0f-07b9-46da-862f-0fab1786e5f3'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:41.663269 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-e00bde0f-07b9-46da-862f-0fab1786e5f3 admin admin] The token cache is being invalidate because project f328dd953d9d4359825e0a4dcd2f4d5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:36:41.663586 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-e00bde0f-07b9-46da-862f-0fab1786e5f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:41.664214 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-e00bde0f-07b9-46da-862f-0fab1786e5f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:41.666359 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1354/2727] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:36:41 2022] DELETE /identity/v3/projects/f328dd953d9d4359825e0a4dcd2f4d5a => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:36:41.670436 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473bd9e2-971a-404f-babc-a6f70abf98d6 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:41.671848 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-473bd9e2-971a-404f-babc-a6f70abf98d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:41.685345 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473bd9e2-971a-404f-babc-a6f70abf98d6 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:41.744425 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad94322c-b1d4-411b-9cbe-fa07cd7bc2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:41.745301 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad94322c-b1d4-411b-9cbe-fa07cd7bc2eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:41.745580 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad94322c-b1d4-411b-9cbe-fa07cd7bc2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:41.745854 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad94322c-b1d4-411b-9cbe-fa07cd7bc2eb admin admin] PATH_INFO: `/v3/users/3becc810b1d14ef49505ddc1d7c667c3` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:41.747107 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad94322c-b1d4-411b-9cbe-fa07cd7bc2eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=3becc810b1d14ef49505ddc1d7c667c3)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:41.749024 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad94322c-b1d4-411b-9cbe-fa07cd7bc2eb admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:41.771717 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:41.986968 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-ad94322c-b1d4-411b-9cbe-fa07cd7bc2eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3becc810b1d14ef49505ddc1d7c667c3'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:41.998428 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-ad94322c-b1d4-411b-9cbe-fa07cd7bc2eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3becc810b1d14ef49505ddc1d7c667c3'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:41.999091 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-ad94322c-b1d4-411b-9cbe-fa07cd7bc2eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3becc810b1d14ef49505ddc1d7c667c3'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:41.999952 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-ad94322c-b1d4-411b-9cbe-fa07cd7bc2eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3becc810b1d14ef49505ddc1d7c667c3'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:42.131051 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-ad94322c-b1d4-411b-9cbe-fa07cd7bc2eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3becc810b1d14ef49505ddc1d7c667c3'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:42.144563 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1374/2728] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:36:41 2022] DELETE /identity/v3/users/3becc810b1d14ef49505ddc1d7c667c3 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:36:42.704871 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00bde0f-07b9-46da-862f-0fab1786e5f3 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:42.707434 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-e00bde0f-07b9-46da-862f-0fab1786e5f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:42.719417 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00bde0f-07b9-46da-862f-0fab1786e5f3 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:42.777831 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5d6864-7ebd-4472-9c99-dd13243f7b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:42.778743 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d6864-7ebd-4472-9c99-dd13243f7b77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:42.779030 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d6864-7ebd-4472-9c99-dd13243f7b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:42.779309 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d6864-7ebd-4472-9c99-dd13243f7b77 admin admin] PATH_INFO: `/v3/projects/9626147c6edc4cffbe5d023fd568c511` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:42.780495 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5d6864-7ebd-4472-9c99-dd13243f7b77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9626147c6edc4cffbe5d023fd568c511)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:42.782441 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5d6864-7ebd-4472-9c99-dd13243f7b77 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:42.926232 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-7f5d6864-7ebd-4472-9c99-dd13243f7b77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9626147c6edc4cffbe5d023fd568c511', 'request_id': 'req-7f5d6864-7ebd-4472-9c99-dd13243f7b77'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:42.932863 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-7f5d6864-7ebd-4472-9c99-dd13243f7b77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9626147c6edc4cffbe5d023fd568c511', 'request_id': 'req-7f5d6864-7ebd-4472-9c99-dd13243f7b77'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:43.042408 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-7f5d6864-7ebd-4472-9c99-dd13243f7b77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9626147c6edc4cffbe5d023fd568c511', 'request_id': 'req-7f5d6864-7ebd-4472-9c99-dd13243f7b77'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:43.053601 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-7f5d6864-7ebd-4472-9c99-dd13243f7b77 admin admin] The token cache is being invalidate because project 9626147c6edc4cffbe5d023fd568c511 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:36:43.053899 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-7f5d6864-7ebd-4472-9c99-dd13243f7b77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:43.055304 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-7f5d6864-7ebd-4472-9c99-dd13243f7b77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:43.057813 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1355/2729] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:36:42 2022] DELETE /identity/v3/projects/9626147c6edc4cffbe5d023fd568c511 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:36:43.065594 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c1ee7d-1b41-4b88-99f1-20ddd56dcc22 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:43.066270 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c1ee7d-1b41-4b88-99f1-20ddd56dcc22 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:43.066270 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c1ee7d-1b41-4b88-99f1-20ddd56dcc22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:43.088947 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-e2c1ee7d-1b41-4b88-99f1-20ddd56dcc22 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:36:43.090393 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-e2c1ee7d-1b41-4b88-99f1-20ddd56dcc22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:43.167734 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1375/2730] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:36:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:36:43.175629 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c4c8c-01e2-459e-a745-8dbd88b28724 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:43.175891 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c4c8c-01e2-459e-a745-8dbd88b28724 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:43.176178 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c4c8c-01e2-459e-a745-8dbd88b28724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:43.194395 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-b88c4c8c-01e2-459e-a745-8dbd88b28724 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:36:43.195601 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-b88c4c8c-01e2-459e-a745-8dbd88b28724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:43.204002 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1356/2731] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:36:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:36:43.207821 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c1ee7d-1b41-4b88-99f1-20ddd56dcc22 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:43.218237 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c1ee7d-1b41-4b88-99f1-20ddd56dcc22 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:43.222961 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8340a4a2-87d3-46dd-8f6e-468dd343ec22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:43.223620 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8340a4a2-87d3-46dd-8f6e-468dd343ec22 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:43.223914 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8340a4a2-87d3-46dd-8f6e-468dd343ec22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:43.224198 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8340a4a2-87d3-46dd-8f6e-468dd343ec22 admin admin] PATH_INFO: `/v3/domains` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:43.224929 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8340a4a2-87d3-46dd-8f6e-468dd343ec22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:36:43.225243 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8340a4a2-87d3-46dd-8f6e-468dd343ec22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:43.226959 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8340a4a2-87d3-46dd-8f6e-468dd343ec22 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:43.239763 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1376/2732] 10.222.0.62 () {58 vars in 1152 bytes} [Fri May 27 16:36:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:36:43.243995 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88c4c8c-01e2-459e-a745-8dbd88b28724 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:43.253442 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88c4c8c-01e2-459e-a745-8dbd88b28724 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:43.258451 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c9f33d-80a7-4662-b9f4-fa1f7eecc009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:43.266115 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c9f33d-80a7-4662-b9f4-fa1f7eecc009 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:43.266115 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c9f33d-80a7-4662-b9f4-fa1f7eecc009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:43.266115 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c9f33d-80a7-4662-b9f4-fa1f7eecc009 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:43.266115 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c9f33d-80a7-4662-b9f4-fa1f7eecc009 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:43.266115 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c9f33d-80a7-4662-b9f4-fa1f7eecc009 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:43.348674 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1357/2733] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:36:43 2022] POST /identity/v3/projects => generated 369 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:36:43.352870 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8340a4a2-87d3-46dd-8f6e-468dd343ec22 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:43.363641 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8340a4a2-87d3-46dd-8f6e-468dd343ec22 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:43.421241 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef8ae7e-dbcf-4378-8e45-7063e526d6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:43.421917 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef8ae7e-dbcf-4378-8e45-7063e526d6d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:43.422203 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef8ae7e-dbcf-4378-8e45-7063e526d6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:43.422522 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef8ae7e-dbcf-4378-8e45-7063e526d6d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:43.423278 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef8ae7e-dbcf-4378-8e45-7063e526d6d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:43.425245 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef8ae7e-dbcf-4378-8e45-7063e526d6d1 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:43.520268 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1377/2734] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:36:43 2022] POST /identity/v3/users => generated 285 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:36:43.524265 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c9f33d-80a7-4662-b9f4-fa1f7eecc009 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:43.530431 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:43.535488 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c9f33d-80a7-4662-b9f4-fa1f7eecc009 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:43.540467 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620380de-bfde-4cb2-a426-e31d77c876c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:43.541236 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620380de-bfde-4cb2-a426-e31d77c876c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:43.541630 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620380de-bfde-4cb2-a426-e31d77c876c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:43.541910 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620380de-bfde-4cb2-a426-e31d77c876c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:43.542711 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620380de-bfde-4cb2-a426-e31d77c876c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:43.544349 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620380de-bfde-4cb2-a426-e31d77c876c8 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:43.554986 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1358/2735] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:36:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 16:36:43.559087 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef8ae7e-dbcf-4378-8e45-7063e526d6d1 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:43.569050 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef8ae7e-dbcf-4378-8e45-7063e526d6d1 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:43.574368 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d3bbe-ba52-417d-b00f-b7fe6a042687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:43.575076 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d3bbe-ba52-417d-b00f-b7fe6a042687 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:43.575366 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d3bbe-ba52-417d-b00f-b7fe6a042687 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:43.575648 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d3bbe-ba52-417d-b00f-b7fe6a042687 admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:43.576407 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820d3bbe-ba52-417d-b00f-b7fe6a042687 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:43.577994 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820d3bbe-ba52-417d-b00f-b7fe6a042687 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:43.587937 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1378/2736] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:36:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:36:43.592619 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620380de-bfde-4cb2-a426-e31d77c876c8 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:43.602511 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620380de-bfde-4cb2-a426-e31d77c876c8 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:43.607163 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0609cd-373f-4435-9a12-a245d6378b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:43.608032 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0609cd-373f-4435-9a12-a245d6378b14 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:43.608319 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0609cd-373f-4435-9a12-a245d6378b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:43.608596 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0609cd-373f-4435-9a12-a245d6378b14 admin admin] PATH_INFO: `/v3/projects/8a3dd21ae57c44e3a4421ea5859ba081/users/dced58ea2093405c8155c5946699c485/roles/c8ce6d197f654598ac45f6016ecccabd` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:43.622738 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0609cd-373f-4435-9a12-a245d6378b14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a3dd21ae57c44e3a4421ea5859ba081, user_id=dced58ea2093405c8155c5946699c485, role_id=c8ce6d197f654598ac45f6016ecccabd)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:43.625620 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0609cd-373f-4435-9a12-a245d6378b14 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:43.730970 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1359/2737] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:36:43 2022] PUT /identity/v3/projects/8a3dd21ae57c44e3a4421ea5859ba081/users/dced58ea2093405c8155c5946699c485/roles/c8ce6d197f654598ac45f6016ecccabd => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:36:43.745056 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c41ca8-6ac6-42ad-b398-8299341da094 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:43.745056 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c41ca8-6ac6-42ad-b398-8299341da094 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:43.745056 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c41ca8-6ac6-42ad-b398-8299341da094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:43.749284 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:43.772077 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-d5c41ca8-6ac6-42ad-b398-8299341da094 None None] MFA Rules not processed for user `dced58ea2093405c8155c5946699c485`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:36:43.773372 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-d5c41ca8-6ac6-42ad-b398-8299341da094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:43.836110 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1379/2738] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:36:43 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:36:43.848083 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0609cd-373f-4435-9a12-a245d6378b14 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:43.849772 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-9f0609cd-373f-4435-9a12-a245d6378b14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:43.909769 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0609cd-373f-4435-9a12-a245d6378b14 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:43.913392 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7528711b-9040-4031-b2a1-46292269086f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b072079733049e8ac204ebe5cc635ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:43.914036 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7528711b-9040-4031-b2a1-46292269086f service glance] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:43.914430 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7528711b-9040-4031-b2a1-46292269086f service glance] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:43.914718 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7528711b-9040-4031-b2a1-46292269086f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:43.923588 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7528711b-9040-4031-b2a1-46292269086f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:43.924975 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7528711b-9040-4031-b2a1-46292269086f service glance] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:43.934723 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1360/2739] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:36:43 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:36:48.146668 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e22e23-c051-45a6-a041-5e47258c2eb3 None None] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:48.146668 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e22e23-c051-45a6-a041-5e47258c2eb3 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:48.146668 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e22e23-c051-45a6-a041-5e47258c2eb3 None None] PATH_INFO: `/` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:48.146668 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1380/2740] 10.222.0.62 () {54 vars in 921 bytes} [Fri May 27 16:36:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:36:48.148330 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c66ab-cebe-4931-876c-71507b7babb7 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:48.148780 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c66ab-cebe-4931-876c-71507b7babb7 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:48.148956 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c66ab-cebe-4931-876c-71507b7babb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:48.170392 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-8c5c66ab-cebe-4931-876c-71507b7babb7 None None] MFA Rules not processed for user `cb13ad6d8b1e46029262556bff398796`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:36:48.170392 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-8c5c66ab-cebe-4931-876c-71507b7babb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:48.248779 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1361/2741] 10.222.0.62 () {58 vars in 1018 bytes} [Fri May 27 16:36:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:36:48.261433 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e22e23-c051-45a6-a041-5e47258c2eb3 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:48.274849 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e22e23-c051-45a6-a041-5e47258c2eb3 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:48.278840 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f971b1-4580-4523-bdcc-fd507001f2d4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b072079733049e8ac204ebe5cc635ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:48.280346 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f971b1-4580-4523-bdcc-fd507001f2d4 service glance] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:48.280662 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f971b1-4580-4523-bdcc-fd507001f2d4 service glance] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:48.280951 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f971b1-4580-4523-bdcc-fd507001f2d4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:48.292215 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f971b1-4580-4523-bdcc-fd507001f2d4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:48.293669 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f971b1-4580-4523-bdcc-fd507001f2d4 service glance] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:48.305451 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1381/2742] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:36:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:36:48.837814 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3221946e-e4f3-4770-8e24-3cfbbb20e465 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:48.838124 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3221946e-e4f3-4770-8e24-3cfbbb20e465 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:48.838922 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3221946e-e4f3-4770-8e24-3cfbbb20e465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:48.862622 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-3221946e-e4f3-4770-8e24-3cfbbb20e465 None None] MFA Rules not processed for user `efc54a5a5cf74f178793b0f0d96d54a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:36:48.864058 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-3221946e-e4f3-4770-8e24-3cfbbb20e465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:48.922492 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1362/2743] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:36:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:36:51.021213 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3549a92-2fe7-4cd5-a70b-407ee9790079 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:51.021856 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3549a92-2fe7-4cd5-a70b-407ee9790079 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:51.021856 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3549a92-2fe7-4cd5-a70b-407ee9790079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:51.040410 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-f3549a92-2fe7-4cd5-a70b-407ee9790079 None None] MFA Rules not processed for user `eb50bf5f39b04ab689b55f46d3dd2640`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:36:51.041642 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-f3549a92-2fe7-4cd5-a70b-407ee9790079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:51.099436 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1382/2744] 10.222.0.62 () {58 vars in 1009 bytes} [Fri May 27 16:36:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:36:51.114970 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3221946e-e4f3-4770-8e24-3cfbbb20e465 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:51.116397 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-3221946e-e4f3-4770-8e24-3cfbbb20e465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:51.128537 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:51.193072 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3221946e-e4f3-4770-8e24-3cfbbb20e465 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:51.198577 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dccbf8-ed22-4156-aa19-424bcc305822 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8e6ec55445045fcac5623b9b6ffa9ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:51.199499 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dccbf8-ed22-4156-aa19-424bcc305822 service swift] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:51.199802 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dccbf8-ed22-4156-aa19-424bcc305822 service swift] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:51.200285 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dccbf8-ed22-4156-aa19-424bcc305822 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:51.209671 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dccbf8-ed22-4156-aa19-424bcc305822 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:51.211289 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dccbf8-ed22-4156-aa19-424bcc305822 service swift] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:51.219934 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1363/2745] 10.222.0.62 () {60 vars in 1384 bytes} [Fri May 27 16:36:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 16:37:01.092494 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=62 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:37:01.282103 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=29 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:37:06.876528 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c467661-16de-4deb-9dac-b3cb05958e01 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:37:06.876528 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c467661-16de-4deb-9dac-b3cb05958e01 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:37:06.877127 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c467661-16de-4deb-9dac-b3cb05958e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:37:06.899340 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-0c467661-16de-4deb-9dac-b3cb05958e01 None None] MFA Rules not processed for user `eb50bf5f39b04ab689b55f46d3dd2640`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:37:06.900564 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-0c467661-16de-4deb-9dac-b3cb05958e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:37:06.908112 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1383/2746] 10.222.0.62 () {58 vars in 967 bytes} [Fri May 27 16:37:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:37:06.920812 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dccbf8-ed22-4156-aa19-424bcc305822 service swift] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:37:06.931423 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dccbf8-ed22-4156-aa19-424bcc305822 service swift] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:37:06.937231 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74603052-0565-4ca8-b542-653bbc3da4e0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8e6ec55445045fcac5623b9b6ffa9ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:37:06.937866 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74603052-0565-4ca8-b542-653bbc3da4e0 service swift] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:37:06.938153 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74603052-0565-4ca8-b542-653bbc3da4e0 service swift] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:37:06.938461 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74603052-0565-4ca8-b542-653bbc3da4e0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:37:06.946636 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74603052-0565-4ca8-b542-653bbc3da4e0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:37:06.948212 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74603052-0565-4ca8-b542-653bbc3da4e0 service swift] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:37:06.956315 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1364/2747] 10.222.0.62 () {60 vars in 1384 bytes} [Fri May 27 16:37:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 16:37:12.136751 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c467661-16de-4deb-9dac-b3cb05958e01 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:37:12.198948 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c467661-16de-4deb-9dac-b3cb05958e01 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:37:12.203765 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d425b232-3206-473d-97ca-8a3e0ee800e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:37:12.204634 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425b232-3206-473d-97ca-8a3e0ee800e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:37:12.204916 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425b232-3206-473d-97ca-8a3e0ee800e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:37:12.205190 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425b232-3206-473d-97ca-8a3e0ee800e6 admin admin] PATH_INFO: `/v3/users/dced58ea2093405c8155c5946699c485` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:37:12.206594 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d425b232-3206-473d-97ca-8a3e0ee800e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dced58ea2093405c8155c5946699c485)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:37:12.208484 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d425b232-3206-473d-97ca-8a3e0ee800e6 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:37:12.409862 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-d425b232-3206-473d-97ca-8a3e0ee800e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dced58ea2093405c8155c5946699c485'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:37:12.423814 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-d425b232-3206-473d-97ca-8a3e0ee800e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dced58ea2093405c8155c5946699c485'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:37:12.424594 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-d425b232-3206-473d-97ca-8a3e0ee800e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dced58ea2093405c8155c5946699c485'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:37:12.425168 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-d425b232-3206-473d-97ca-8a3e0ee800e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dced58ea2093405c8155c5946699c485'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:37:12.503913 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-d425b232-3206-473d-97ca-8a3e0ee800e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dced58ea2093405c8155c5946699c485'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:37:12.516998 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1384/2748] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:37:12 2022] DELETE /identity/v3/users/dced58ea2093405c8155c5946699c485 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:37:12.523180 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad1e8a-2052-4fe2-baae-89a1a6571cdf None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:37:12.523682 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad1e8a-2052-4fe2-baae-89a1a6571cdf None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:37:12.523788 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad1e8a-2052-4fe2-baae-89a1a6571cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:37:12.550086 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-45ad1e8a-2052-4fe2-baae-89a1a6571cdf None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:37:12.552251 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-45ad1e8a-2052-4fe2-baae-89a1a6571cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:37:12.612464 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1365/2749] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:37:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:37:12.622196 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d425b232-3206-473d-97ca-8a3e0ee800e6 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:37:12.623712 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-d425b232-3206-473d-97ca-8a3e0ee800e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:37:12.680773 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d425b232-3206-473d-97ca-8a3e0ee800e6 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:37:12.684514 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd42835d-1fa4-4622-aed6-6fe5ddbe847a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:37:12.685178 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42835d-1fa4-4622-aed6-6fe5ddbe847a service neutron] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:37:12.685480 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42835d-1fa4-4622-aed6-6fe5ddbe847a service neutron] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:37:12.685755 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42835d-1fa4-4622-aed6-6fe5ddbe847a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:37:12.694844 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd42835d-1fa4-4622-aed6-6fe5ddbe847a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:37:12.696270 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd42835d-1fa4-4622-aed6-6fe5ddbe847a service neutron] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:37:12.706481 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1385/2750] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:37:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:37:13.176230 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ad1e8a-2052-4fe2-baae-89a1a6571cdf None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:37:13.176230 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-45ad1e8a-2052-4fe2-baae-89a1a6571cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:37:13.188026 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ad1e8a-2052-4fe2-baae-89a1a6571cdf None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:37:13.192676 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8afc17b-5f13-4c64-b976-4ad3bf28f42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:37:13.193549 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8afc17b-5f13-4c64-b976-4ad3bf28f42b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:37:13.193831 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8afc17b-5f13-4c64-b976-4ad3bf28f42b admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:37:13.194111 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8afc17b-5f13-4c64-b976-4ad3bf28f42b admin admin] PATH_INFO: `/v3/projects/8a3dd21ae57c44e3a4421ea5859ba081` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:37:13.195335 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8afc17b-5f13-4c64-b976-4ad3bf28f42b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a3dd21ae57c44e3a4421ea5859ba081)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:37:13.197258 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8afc17b-5f13-4c64-b976-4ad3bf28f42b admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:37:13.334170 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-a8afc17b-5f13-4c64-b976-4ad3bf28f42b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a3dd21ae57c44e3a4421ea5859ba081', 'request_id': 'req-a8afc17b-5f13-4c64-b976-4ad3bf28f42b'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:37:13.340684 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-a8afc17b-5f13-4c64-b976-4ad3bf28f42b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a3dd21ae57c44e3a4421ea5859ba081', 'request_id': 'req-a8afc17b-5f13-4c64-b976-4ad3bf28f42b'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:37:13.429214 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-a8afc17b-5f13-4c64-b976-4ad3bf28f42b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a3dd21ae57c44e3a4421ea5859ba081', 'request_id': 'req-a8afc17b-5f13-4c64-b976-4ad3bf28f42b'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:37:13.440502 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-a8afc17b-5f13-4c64-b976-4ad3bf28f42b admin admin] The token cache is being invalidate because project 8a3dd21ae57c44e3a4421ea5859ba081 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:37:13.440800 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-a8afc17b-5f13-4c64-b976-4ad3bf28f42b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:37:13.441433 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-a8afc17b-5f13-4c64-b976-4ad3bf28f42b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:37:13.443031 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1366/2751] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:37:13 2022] DELETE /identity/v3/projects/8a3dd21ae57c44e3a4421ea5859ba081 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:37:20.501466 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9601c4d3-c19e-4c95-b5f7-00e7f67a5916 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:37:20.501984 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9601c4d3-c19e-4c95-b5f7-00e7f67a5916 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:37:20.502104 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9601c4d3-c19e-4c95-b5f7-00e7f67a5916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:37:20.521107 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-9601c4d3-c19e-4c95-b5f7-00e7f67a5916 None None] MFA Rules not processed for user `eb50bf5f39b04ab689b55f46d3dd2640`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:37:20.522362 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-9601c4d3-c19e-4c95-b5f7-00e7f67a5916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:37:20.532756 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:37:20.578416 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1386/2752] 10.222.0.62 () {58 vars in 1009 bytes} [Fri May 27 16:37:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:37:20.599690 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8afc17b-5f13-4c64-b976-4ad3bf28f42b admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:37:20.601236 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-a8afc17b-5f13-4c64-b976-4ad3bf28f42b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:37:20.676887 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8afc17b-5f13-4c64-b976-4ad3bf28f42b admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:37:20.681878 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d72691-8078-4edf-8da8-5a85289ec83f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8e6ec55445045fcac5623b9b6ffa9ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:37:20.682566 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d72691-8078-4edf-8da8-5a85289ec83f service swift] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:37:20.682859 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d72691-8078-4edf-8da8-5a85289ec83f service swift] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:37:20.683142 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d72691-8078-4edf-8da8-5a85289ec83f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:37:20.691901 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d72691-8078-4edf-8da8-5a85289ec83f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:37:20.693477 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d72691-8078-4edf-8da8-5a85289ec83f service swift] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:37:20.698012 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:37:20.701835 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1367/2753] 10.222.0.62 () {60 vars in 1384 bytes} [Fri May 27 16:37:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 16:37:31.083936 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=18 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:37:37.168901 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc215044-0c16-4b00-9b82-e9e5f81b35f7 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:37:37.169470 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc215044-0c16-4b00-9b82-e9e5f81b35f7 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:37:37.169470 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc215044-0c16-4b00-9b82-e9e5f81b35f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:37:37.187762 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-dc215044-0c16-4b00-9b82-e9e5f81b35f7 None None] MFA Rules not processed for user `eb50bf5f39b04ab689b55f46d3dd2640`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:37:37.188966 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-dc215044-0c16-4b00-9b82-e9e5f81b35f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:37:37.197171 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1387/2754] 10.222.0.62 () {58 vars in 967 bytes} [Fri May 27 16:37:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:37:37.209203 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d72691-8078-4edf-8da8-5a85289ec83f service swift] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:37:37.220199 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d72691-8078-4edf-8da8-5a85289ec83f service swift] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:37:37.225210 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452e52e6-c897-4db5-9f64-22ae9718f61f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8e6ec55445045fcac5623b9b6ffa9ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:37:37.225842 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452e52e6-c897-4db5-9f64-22ae9718f61f service swift] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:37:37.226125 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452e52e6-c897-4db5-9f64-22ae9718f61f service swift] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:37:37.226436 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452e52e6-c897-4db5-9f64-22ae9718f61f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:37:37.234446 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452e52e6-c897-4db5-9f64-22ae9718f61f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:37:37.236545 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452e52e6-c897-4db5-9f64-22ae9718f61f service swift] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:37:37.244500 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1368/2755] 10.222.0.62 () {60 vars in 1384 bytes} [Fri May 27 16:37:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 27 16:37:40.167658 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc215044-0c16-4b00-9b82-e9e5f81b35f7 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:37:40.169166 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-dc215044-0c16-4b00-9b82-e9e5f81b35f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:37:40.241653 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc215044-0c16-4b00-9b82-e9e5f81b35f7 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:37:40.246787 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e56b8d-bcb0-4364-98d2-0e5151ed8549 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35d98c4a2af546d8b655d649d655f447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:37:40.247437 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e56b8d-bcb0-4364-98d2-0e5151ed8549 service placement] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:37:40.247727 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e56b8d-bcb0-4364-98d2-0e5151ed8549 service placement] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:37:40.248011 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e56b8d-bcb0-4364-98d2-0e5151ed8549 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:37:40.250067 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-04e56b8d-bcb0-4364-98d2-0e5151ed8549 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:37:40.261915 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e56b8d-bcb0-4364-98d2-0e5151ed8549 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:37:40.263594 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e56b8d-bcb0-4364-98d2-0e5151ed8549 service placement] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:37:40.273777 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1388/2756] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:37:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:37:40.318384 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452e52e6-c897-4db5-9f64-22ae9718f61f service swift] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:37:40.318384 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-452e52e6-c897-4db5-9f64-22ae9718f61f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:37:40.384614 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452e52e6-c897-4db5-9f64-22ae9718f61f service swift] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:37:40.389157 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936aab9d-34b1-4e52-9e8b-5c055bc73b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:37:40.390024 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936aab9d-34b1-4e52-9e8b-5c055bc73b09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:37:40.390339 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936aab9d-34b1-4e52-9e8b-5c055bc73b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:37:40.390622 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936aab9d-34b1-4e52-9e8b-5c055bc73b09 admin admin] PATH_INFO: `/v3/users/efc54a5a5cf74f178793b0f0d96d54a8` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:37:40.391802 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936aab9d-34b1-4e52-9e8b-5c055bc73b09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=efc54a5a5cf74f178793b0f0d96d54a8)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:37:40.393749 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936aab9d-34b1-4e52-9e8b-5c055bc73b09 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:37:40.594266 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-936aab9d-34b1-4e52-9e8b-5c055bc73b09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efc54a5a5cf74f178793b0f0d96d54a8'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:37:40.606103 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-936aab9d-34b1-4e52-9e8b-5c055bc73b09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efc54a5a5cf74f178793b0f0d96d54a8'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:37:40.606828 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-936aab9d-34b1-4e52-9e8b-5c055bc73b09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efc54a5a5cf74f178793b0f0d96d54a8'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:37:40.607471 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-936aab9d-34b1-4e52-9e8b-5c055bc73b09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efc54a5a5cf74f178793b0f0d96d54a8'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:37:40.683050 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-936aab9d-34b1-4e52-9e8b-5c055bc73b09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efc54a5a5cf74f178793b0f0d96d54a8'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:37:40.701400 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1369/2757] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:37:40 2022] DELETE /identity/v3/users/efc54a5a5cf74f178793b0f0d96d54a8 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:37:40.941663 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e56b8d-bcb0-4364-98d2-0e5151ed8549 service placement] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:37:40.953746 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e56b8d-bcb0-4364-98d2-0e5151ed8549 service placement] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:37:41.011920 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc847f4-2df7-405e-b0c5-fe3bccfc43be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:37:41.012782 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc847f4-2df7-405e-b0c5-fe3bccfc43be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:37:41.013066 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc847f4-2df7-405e-b0c5-fe3bccfc43be admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:37:41.013420 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc847f4-2df7-405e-b0c5-fe3bccfc43be admin admin] PATH_INFO: `/v3/projects/20671359994d468897f9be90e9e15252` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:37:41.014650 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc847f4-2df7-405e-b0c5-fe3bccfc43be admin admin] RBAC: Authorizing `identity:delete_project(project_id=20671359994d468897f9be90e9e15252)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:37:41.016567 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc847f4-2df7-405e-b0c5-fe3bccfc43be admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:37:41.122955 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-1dc847f4-2df7-405e-b0c5-fe3bccfc43be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20671359994d468897f9be90e9e15252', 'request_id': 'req-1dc847f4-2df7-405e-b0c5-fe3bccfc43be'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:37:41.129423 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-1dc847f4-2df7-405e-b0c5-fe3bccfc43be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20671359994d468897f9be90e9e15252', 'request_id': 'req-1dc847f4-2df7-405e-b0c5-fe3bccfc43be'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:37:41.134915 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-1dc847f4-2df7-405e-b0c5-fe3bccfc43be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20671359994d468897f9be90e9e15252', 'request_id': 'req-1dc847f4-2df7-405e-b0c5-fe3bccfc43be'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:37:41.217137 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-1dc847f4-2df7-405e-b0c5-fe3bccfc43be admin admin] The token cache is being invalidate because project 20671359994d468897f9be90e9e15252 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80288) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:37:41.217745 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-1dc847f4-2df7-405e-b0c5-fe3bccfc43be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:37:41.218078 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-1dc847f4-2df7-405e-b0c5-fe3bccfc43be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:37:41.219676 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1389/2758] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:37:40 2022] DELETE /identity/v3/projects/20671359994d468897f9be90e9e15252 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:37:49.295153 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936aab9d-34b1-4e52-9e8b-5c055bc73b09 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:37:49.296766 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-936aab9d-34b1-4e52-9e8b-5c055bc73b09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:37:49.358481 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936aab9d-34b1-4e52-9e8b-5c055bc73b09 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:37:49.377414 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:37:49.408662 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f6a59e-ea48-4beb-b44c-59c402994b24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:37:49.409325 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f6a59e-ea48-4beb-b44c-59c402994b24 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:37:49.409613 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f6a59e-ea48-4beb-b44c-59c402994b24 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:37:49.409895 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f6a59e-ea48-4beb-b44c-59c402994b24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:37:49.411815 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-d8f6a59e-ea48-4beb-b44c-59c402994b24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:37:49.477454 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f6a59e-ea48-4beb-b44c-59c402994b24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:37:49.479000 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f6a59e-ea48-4beb-b44c-59c402994b24 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:37:49.489535 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1370/2759] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:37:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:37:51.213969 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:37:53.801294 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc847f4-2df7-405e-b0c5-fe3bccfc43be admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:37:53.802961 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-1dc847f4-2df7-405e-b0c5-fe3bccfc43be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:37:53.820001 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc847f4-2df7-405e-b0c5-fe3bccfc43be admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:37:53.825582 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb9262f-d2ad-4aab-9720-32642842c85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:37:53.827162 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9262f-d2ad-4aab-9720-32642842c85a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:37:53.827457 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9262f-d2ad-4aab-9720-32642842c85a admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:37:53.827743 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9262f-d2ad-4aab-9720-32642842c85a admin admin] PATH_INFO: `/v3/users/9eb9fb33e55a4b80b04c6462403195c0` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:37:53.828958 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb9262f-d2ad-4aab-9720-32642842c85a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9eb9fb33e55a4b80b04c6462403195c0)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:37:53.831201 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb9262f-d2ad-4aab-9720-32642842c85a admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:37:54.125711 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-3cb9262f-d2ad-4aab-9720-32642842c85a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9eb9fb33e55a4b80b04c6462403195c0'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:37:54.137469 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-3cb9262f-d2ad-4aab-9720-32642842c85a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9eb9fb33e55a4b80b04c6462403195c0'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:37:54.138135 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-3cb9262f-d2ad-4aab-9720-32642842c85a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9eb9fb33e55a4b80b04c6462403195c0'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:37:54.138845 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-3cb9262f-d2ad-4aab-9720-32642842c85a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9eb9fb33e55a4b80b04c6462403195c0'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:37:54.175305 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f6a59e-ea48-4beb-b44c-59c402994b24 service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:37:54.176714 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-d8f6a59e-ea48-4beb-b44c-59c402994b24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:37:54.187318 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f6a59e-ea48-4beb-b44c-59c402994b24 service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:37:54.191054 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31df74a-c57b-4728-8a0e-f6fdc7d79ecb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:37:54.191702 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31df74a-c57b-4728-8a0e-f6fdc7d79ecb service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:37:54.191991 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31df74a-c57b-4728-8a0e-f6fdc7d79ecb service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:37:54.192271 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31df74a-c57b-4728-8a0e-f6fdc7d79ecb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:37:54.194006 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-d31df74a-c57b-4728-8a0e-f6fdc7d79ecb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:37:54.206392 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31df74a-c57b-4728-8a0e-f6fdc7d79ecb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:37:54.207830 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31df74a-c57b-4728-8a0e-f6fdc7d79ecb service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:37:54.219108 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1371/2760] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:37:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 16:37:54.409142 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-3cb9262f-d2ad-4aab-9720-32642842c85a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9eb9fb33e55a4b80b04c6462403195c0'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:37:54.434818 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1390/2761] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:37:53 2022] DELETE /identity/v3/users/9eb9fb33e55a4b80b04c6462403195c0 => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:37:54.776660 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31df74a-c57b-4728-8a0e-f6fdc7d79ecb service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:37:54.778193 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-d31df74a-c57b-4728-8a0e-f6fdc7d79ecb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:37:54.790732 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31df74a-c57b-4728-8a0e-f6fdc7d79ecb service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:37:54.865717 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9013fb85-227e-4e2c-b4f8-04766833cc1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:37:54.866663 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013fb85-227e-4e2c-b4f8-04766833cc1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:37:54.866973 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013fb85-227e-4e2c-b4f8-04766833cc1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:37:54.867276 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013fb85-227e-4e2c-b4f8-04766833cc1c admin admin] PATH_INFO: `/v3/projects/bd3b2626feb248e0849e7f9ca68a4f4d` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:37:54.868519 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9013fb85-227e-4e2c-b4f8-04766833cc1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd3b2626feb248e0849e7f9ca68a4f4d)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:37:54.870551 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9013fb85-227e-4e2c-b4f8-04766833cc1c admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:37:55.032341 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-9013fb85-227e-4e2c-b4f8-04766833cc1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd3b2626feb248e0849e7f9ca68a4f4d', 'request_id': 'req-9013fb85-227e-4e2c-b4f8-04766833cc1c'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:37:55.039226 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-9013fb85-227e-4e2c-b4f8-04766833cc1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd3b2626feb248e0849e7f9ca68a4f4d', 'request_id': 'req-9013fb85-227e-4e2c-b4f8-04766833cc1c'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:37:55.103776 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-9013fb85-227e-4e2c-b4f8-04766833cc1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd3b2626feb248e0849e7f9ca68a4f4d', 'request_id': 'req-9013fb85-227e-4e2c-b4f8-04766833cc1c'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:37:55.105435 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:37:55.116730 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-9013fb85-227e-4e2c-b4f8-04766833cc1c admin admin] The token cache is being invalidate because project bd3b2626feb248e0849e7f9ca68a4f4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:37:55.116961 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-9013fb85-227e-4e2c-b4f8-04766833cc1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:37:55.117591 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-9013fb85-227e-4e2c-b4f8-04766833cc1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:37:55.119168 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1372/2762] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:37:54 2022] DELETE /identity/v3/projects/bd3b2626feb248e0849e7f9ca68a4f4d => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:37:55.124300 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392275f-e070-4aca-91b7-dba8c8d5ad36 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:37:55.124777 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392275f-e070-4aca-91b7-dba8c8d5ad36 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:37:55.124875 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392275f-e070-4aca-91b7-dba8c8d5ad36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:37:55.144201 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-4392275f-e070-4aca-91b7-dba8c8d5ad36 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:37:55.151750 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-4392275f-e070-4aca-91b7-dba8c8d5ad36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:37:55.209543 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1391/2763] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:37:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:37:55.217412 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee3b15-c65a-4a38-86b7-63fc0d52d5ce None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:37:55.217929 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee3b15-c65a-4a38-86b7-63fc0d52d5ce None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:37:55.218034 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee3b15-c65a-4a38-86b7-63fc0d52d5ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:37:55.238941 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-44ee3b15-c65a-4a38-86b7-63fc0d52d5ce None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:37:55.240164 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-44ee3b15-c65a-4a38-86b7-63fc0d52d5ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:37:55.248731 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1373/2764] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:37:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:37:55.253771 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392275f-e070-4aca-91b7-dba8c8d5ad36 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:37:55.267886 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392275f-e070-4aca-91b7-dba8c8d5ad36 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:37:55.270117 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f1aab6-2859-4610-a66e-11124702d425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:37:55.271091 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f1aab6-2859-4610-a66e-11124702d425 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:37:55.271591 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f1aab6-2859-4610-a66e-11124702d425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:37:55.271942 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f1aab6-2859-4610-a66e-11124702d425 admin admin] PATH_INFO: `/v3/domains` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:37:55.272764 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f1aab6-2859-4610-a66e-11124702d425 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:37:55.273212 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f1aab6-2859-4610-a66e-11124702d425 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:37:55.278357 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f1aab6-2859-4610-a66e-11124702d425 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:37:55.304151 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1392/2765] 10.222.0.62 () {58 vars in 1152 bytes} [Fri May 27 16:37:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:37:55.309418 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ee3b15-c65a-4a38-86b7-63fc0d52d5ce None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:37:55.320559 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ee3b15-c65a-4a38-86b7-63fc0d52d5ce None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:37:55.325641 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1641c298-ddea-4d7a-9616-8a2475bb3f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:37:55.330924 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1641c298-ddea-4d7a-9616-8a2475bb3f12 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:37:55.330924 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1641c298-ddea-4d7a-9616-8a2475bb3f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:37:55.330924 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1641c298-ddea-4d7a-9616-8a2475bb3f12 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:37:55.330924 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1641c298-ddea-4d7a-9616-8a2475bb3f12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:37:55.330924 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1641c298-ddea-4d7a-9616-8a2475bb3f12 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:37:55.430130 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1374/2766] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:37:55 2022] POST /identity/v3/projects => generated 385 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:37:55.434789 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f1aab6-2859-4610-a66e-11124702d425 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:37:55.447435 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f1aab6-2859-4610-a66e-11124702d425 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:37:55.518162 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490de584-34de-4ed4-ba09-e12c8b429213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:37:55.518880 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490de584-34de-4ed4-ba09-e12c8b429213 admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:37:55.520149 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490de584-34de-4ed4-ba09-e12c8b429213 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:37:55.520149 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490de584-34de-4ed4-ba09-e12c8b429213 admin admin] PATH_INFO: `/v3/users` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:37:55.520149 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490de584-34de-4ed4-ba09-e12c8b429213 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:37:55.522065 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490de584-34de-4ed4-ba09-e12c8b429213 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:37:55.528999 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:37:55.592392 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1393/2767] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:37:55 2022] POST /identity/v3/users => generated 293 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:37:55.597240 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1641c298-ddea-4d7a-9616-8a2475bb3f12 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:37:55.608947 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1641c298-ddea-4d7a-9616-8a2475bb3f12 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:37:55.615174 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8872b29f-4771-4327-942d-0829006555d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:37:55.626324 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8872b29f-4771-4327-942d-0829006555d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:37:55.626324 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8872b29f-4771-4327-942d-0829006555d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:37:55.626324 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8872b29f-4771-4327-942d-0829006555d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:37:55.626324 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8872b29f-4771-4327-942d-0829006555d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:37:55.626324 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8872b29f-4771-4327-942d-0829006555d7 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:37:55.631698 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1375/2768] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:37:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:37:55.635440 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490de584-34de-4ed4-ba09-e12c8b429213 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:37:55.646324 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490de584-34de-4ed4-ba09-e12c8b429213 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:37:55.651288 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97dd7e2-9702-4ef3-a605-da57f0b0bc2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:37:55.654938 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97dd7e2-9702-4ef3-a605-da57f0b0bc2a admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:37:55.654938 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97dd7e2-9702-4ef3-a605-da57f0b0bc2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:37:55.654938 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97dd7e2-9702-4ef3-a605-da57f0b0bc2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:37:55.654938 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97dd7e2-9702-4ef3-a605-da57f0b0bc2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:37:55.655314 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97dd7e2-9702-4ef3-a605-da57f0b0bc2a admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:37:55.669040 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1394/2769] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:37:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:37:55.670468 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8872b29f-4771-4327-942d-0829006555d7 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:37:55.681294 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8872b29f-4771-4327-942d-0829006555d7 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:37:55.686011 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296dd829-1377-41a6-928c-8249ff285f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:37:55.687308 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296dd829-1377-41a6-928c-8249ff285f5b admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:37:55.687308 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296dd829-1377-41a6-928c-8249ff285f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:37:55.687538 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296dd829-1377-41a6-928c-8249ff285f5b admin admin] PATH_INFO: `/v3/projects/88c9bfdfc141417ba922c9cabb8fec83/users/6e0dce1bbbc44a5481ed3285a0f6209b/roles/c8ce6d197f654598ac45f6016ecccabd` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:37:55.708557 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296dd829-1377-41a6-928c-8249ff285f5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=88c9bfdfc141417ba922c9cabb8fec83, user_id=6e0dce1bbbc44a5481ed3285a0f6209b, role_id=c8ce6d197f654598ac45f6016ecccabd)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:37:55.712099 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296dd829-1377-41a6-928c-8249ff285f5b admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:37:55.813120 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1376/2770] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:37:55 2022] PUT /identity/v3/projects/88c9bfdfc141417ba922c9cabb8fec83/users/6e0dce1bbbc44a5481ed3285a0f6209b/roles/c8ce6d197f654598ac45f6016ecccabd => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:37:55.818284 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a215595-7f69-4bdd-9f77-413a47604c2f None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:37:55.818712 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a215595-7f69-4bdd-9f77-413a47604c2f None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:37:55.818955 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a215595-7f69-4bdd-9f77-413a47604c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:37:55.842344 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-8a215595-7f69-4bdd-9f77-413a47604c2f None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:37:55.842344 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-8a215595-7f69-4bdd-9f77-413a47604c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:37:55.915213 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1395/2771] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:37:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:37:55.925595 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296dd829-1377-41a6-928c-8249ff285f5b admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:37:55.928059 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-296dd829-1377-41a6-928c-8249ff285f5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:37:55.995783 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296dd829-1377-41a6-928c-8249ff285f5b admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:37:55.999903 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6315ab5-ceb5-4a83-bccc-4d1e7ebf525a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:37:56.000652 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6315ab5-ceb5-4a83-bccc-4d1e7ebf525a service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:37:56.000886 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6315ab5-ceb5-4a83-bccc-4d1e7ebf525a service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:37:56.001734 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6315ab5-ceb5-4a83-bccc-4d1e7ebf525a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:37:56.012056 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6315ab5-ceb5-4a83-bccc-4d1e7ebf525a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:37:56.013513 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6315ab5-ceb5-4a83-bccc-4d1e7ebf525a service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:37:56.024200 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1377/2772] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:37:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 16:38:03.724980 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a215595-7f69-4bdd-9f77-413a47604c2f None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:38:03.727224 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-8a215595-7f69-4bdd-9f77-413a47604c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:38:03.741464 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a215595-7f69-4bdd-9f77-413a47604c2f None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:38:03.746559 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f3f920-6dda-4837-839e-1248792e9822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:38:03.747732 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f3f920-6dda-4837-839e-1248792e9822 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:38:03.748173 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f3f920-6dda-4837-839e-1248792e9822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:38:03.748467 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f3f920-6dda-4837-839e-1248792e9822 admin admin] PATH_INFO: `/v3/users/20c8836936334236b2f889c0d322ffb3` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:38:03.749792 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f3f920-6dda-4837-839e-1248792e9822 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20c8836936334236b2f889c0d322ffb3)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:38:03.751838 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f3f920-6dda-4837-839e-1248792e9822 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:38:03.960499 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43fbadb-0a93-4151-b408-8333fee9bd8e None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:38:03.961004 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43fbadb-0a93-4151-b408-8333fee9bd8e None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:38:03.961132 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43fbadb-0a93-4151-b408-8333fee9bd8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:38:03.987693 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-e43fbadb-0a93-4151-b408-8333fee9bd8e None None] MFA Rules not processed for user `6e0dce1bbbc44a5481ed3285a0f6209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:38:03.988902 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-e43fbadb-0a93-4151-b408-8333fee9bd8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:38:04.053311 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1378/2773] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:38:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:38:04.066011 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-b8f3f920-6dda-4837-839e-1248792e9822 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20c8836936334236b2f889c0d322ffb3'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:38:04.069748 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43fbadb-0a93-4151-b408-8333fee9bd8e None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:38:04.071164 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-e43fbadb-0a93-4151-b408-8333fee9bd8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:38:04.079574 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-b8f3f920-6dda-4837-839e-1248792e9822 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20c8836936334236b2f889c0d322ffb3'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:38:04.080262 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-b8f3f920-6dda-4837-839e-1248792e9822 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20c8836936334236b2f889c0d322ffb3'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:38:04.080860 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-b8f3f920-6dda-4837-839e-1248792e9822 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20c8836936334236b2f889c0d322ffb3'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:38:04.092138 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:38:04.145812 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43fbadb-0a93-4151-b408-8333fee9bd8e None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:38:04.151245 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1549c5-4aaf-4f89-b6d9-2fcac195224e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb13ad6d8b1e46029262556bff398796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:38:04.151884 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1549c5-4aaf-4f89-b6d9-2fcac195224e service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:38:04.152166 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1549c5-4aaf-4f89-b6d9-2fcac195224e service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:38:04.152441 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1549c5-4aaf-4f89-b6d9-2fcac195224e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:38:04.154328 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-ca1549c5-4aaf-4f89-b6d9-2fcac195224e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:38:04.165170 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1549c5-4aaf-4f89-b6d9-2fcac195224e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:38:04.166805 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1549c5-4aaf-4f89-b6d9-2fcac195224e service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:38:04.175520 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1379/2774] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:38:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:38:04.229593 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-b8f3f920-6dda-4837-839e-1248792e9822 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20c8836936334236b2f889c0d322ffb3'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:38:04.243301 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1396/2775] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:38:03 2022] DELETE /identity/v3/users/20c8836936334236b2f889c0d322ffb3 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:38:04.580406 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1549c5-4aaf-4f89-b6d9-2fcac195224e service nova] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:38:04.580406 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-ca1549c5-4aaf-4f89-b6d9-2fcac195224e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:38:04.594532 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1549c5-4aaf-4f89-b6d9-2fcac195224e service nova] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:38:04.661442 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809542a2-6b5b-4562-a39e-cc7b02773a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:38:04.662455 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809542a2-6b5b-4562-a39e-cc7b02773a6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:38:04.662811 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809542a2-6b5b-4562-a39e-cc7b02773a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:38:04.663175 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809542a2-6b5b-4562-a39e-cc7b02773a6a admin admin] PATH_INFO: `/v3/projects/6747dc5934974552927a9d9098e83048` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:38:04.664648 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809542a2-6b5b-4562-a39e-cc7b02773a6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6747dc5934974552927a9d9098e83048)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:38:04.666696 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809542a2-6b5b-4562-a39e-cc7b02773a6a admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:38:04.843801 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-809542a2-6b5b-4562-a39e-cc7b02773a6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6747dc5934974552927a9d9098e83048', 'request_id': 'req-809542a2-6b5b-4562-a39e-cc7b02773a6a'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:38:04.854328 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-809542a2-6b5b-4562-a39e-cc7b02773a6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6747dc5934974552927a9d9098e83048', 'request_id': 'req-809542a2-6b5b-4562-a39e-cc7b02773a6a'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:38:05.019789 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-809542a2-6b5b-4562-a39e-cc7b02773a6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6747dc5934974552927a9d9098e83048', 'request_id': 'req-809542a2-6b5b-4562-a39e-cc7b02773a6a'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:38:05.031412 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-809542a2-6b5b-4562-a39e-cc7b02773a6a admin admin] The token cache is being invalidate because project 6747dc5934974552927a9d9098e83048 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:38:05.031665 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-809542a2-6b5b-4562-a39e-cc7b02773a6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:38:05.032303 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-809542a2-6b5b-4562-a39e-cc7b02773a6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:38:05.033878 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1380/2776] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:38:04 2022] DELETE /identity/v3/projects/6747dc5934974552927a9d9098e83048 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:38:05.037944 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f3f920-6dda-4837-839e-1248792e9822 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:38:05.049150 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f3f920-6dda-4837-839e-1248792e9822 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:38:05.127492 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:38:05.138030 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4162a9-0bea-4785-991d-3864d4905567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:38:05.138954 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4162a9-0bea-4785-991d-3864d4905567 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:38:05.139242 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4162a9-0bea-4785-991d-3864d4905567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:38:05.139523 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4162a9-0bea-4785-991d-3864d4905567 admin admin] PATH_INFO: `/v3/users/ec615a366b004bbba3128c6f18cdaac4` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:38:05.140712 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4162a9-0bea-4785-991d-3864d4905567 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec615a366b004bbba3128c6f18cdaac4)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:38:05.144740 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4162a9-0bea-4785-991d-3864d4905567 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:38:05.404729 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-7a4162a9-0bea-4785-991d-3864d4905567 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec615a366b004bbba3128c6f18cdaac4'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:38:05.416710 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-7a4162a9-0bea-4785-991d-3864d4905567 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec615a366b004bbba3128c6f18cdaac4'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:38:05.417372 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-7a4162a9-0bea-4785-991d-3864d4905567 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec615a366b004bbba3128c6f18cdaac4'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:38:05.418001 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-7a4162a9-0bea-4785-991d-3864d4905567 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec615a366b004bbba3128c6f18cdaac4'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:38:05.570675 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-7a4162a9-0bea-4785-991d-3864d4905567 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec615a366b004bbba3128c6f18cdaac4'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:38:05.601264 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1397/2777] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:38:05 2022] DELETE /identity/v3/users/ec615a366b004bbba3128c6f18cdaac4 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:38:05.930707 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809542a2-6b5b-4562-a39e-cc7b02773a6a admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:38:05.934025 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-809542a2-6b5b-4562-a39e-cc7b02773a6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:38:05.948737 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809542a2-6b5b-4562-a39e-cc7b02773a6a admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:38:05.995349 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:38:06.039585 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bf961e-96ec-4dd2-bfd9-05b12a6b6477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:38:06.040582 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf961e-96ec-4dd2-bfd9-05b12a6b6477 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:38:06.041080 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf961e-96ec-4dd2-bfd9-05b12a6b6477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:38:06.041529 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf961e-96ec-4dd2-bfd9-05b12a6b6477 admin admin] PATH_INFO: `/v3/projects/656050d58806482184a6d637ac8381d2` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:38:06.043032 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bf961e-96ec-4dd2-bfd9-05b12a6b6477 admin admin] RBAC: Authorizing `identity:delete_project(project_id=656050d58806482184a6d637ac8381d2)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:38:06.045787 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bf961e-96ec-4dd2-bfd9-05b12a6b6477 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:38:06.172233 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-40bf961e-96ec-4dd2-bfd9-05b12a6b6477 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '656050d58806482184a6d637ac8381d2', 'request_id': 'req-40bf961e-96ec-4dd2-bfd9-05b12a6b6477'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:38:06.179989 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-40bf961e-96ec-4dd2-bfd9-05b12a6b6477 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '656050d58806482184a6d637ac8381d2', 'request_id': 'req-40bf961e-96ec-4dd2-bfd9-05b12a6b6477'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:38:06.266081 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-40bf961e-96ec-4dd2-bfd9-05b12a6b6477 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '656050d58806482184a6d637ac8381d2', 'request_id': 'req-40bf961e-96ec-4dd2-bfd9-05b12a6b6477'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:38:06.280136 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-40bf961e-96ec-4dd2-bfd9-05b12a6b6477 admin admin] The token cache is being invalidate because project 656050d58806482184a6d637ac8381d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:38:06.280781 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-40bf961e-96ec-4dd2-bfd9-05b12a6b6477 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:38:06.281727 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-40bf961e-96ec-4dd2-bfd9-05b12a6b6477 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:38:06.300001 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1381/2778] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:38:05 2022] DELETE /identity/v3/projects/656050d58806482184a6d637ac8381d2 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:38:07.143552 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c550f55-7260-4441-9893-1f93c105a1d0 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:38:07.150457 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c550f55-7260-4441-9893-1f93c105a1d0 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:38:07.150457 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c550f55-7260-4441-9893-1f93c105a1d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:38:07.163126 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-3c550f55-7260-4441-9893-1f93c105a1d0 None None] MFA Rules not processed for user `6e0dce1bbbc44a5481ed3285a0f6209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:38:07.164345 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-3c550f55-7260-4441-9893-1f93c105a1d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:38:07.228017 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1398/2779] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:38:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:38:16.556014 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=36,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:38:17.221773 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=55,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:39:01.744299 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49fb9b5-e145-417a-8ebb-887e22680567 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:39:01.744806 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49fb9b5-e145-417a-8ebb-887e22680567 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:39:01.744914 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49fb9b5-e145-417a-8ebb-887e22680567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:39:01.763501 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-a49fb9b5-e145-417a-8ebb-887e22680567 None None] MFA Rules not processed for user `6e0dce1bbbc44a5481ed3285a0f6209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:39:01.764691 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-a49fb9b5-e145-417a-8ebb-887e22680567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:39:01.771491 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1382/2780] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:39:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:39:03.633561 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c550f55-7260-4441-9893-1f93c105a1d0 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:39:03.641396 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-3c550f55-7260-4441-9893-1f93c105a1d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:39:03.713232 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c550f55-7260-4441-9893-1f93c105a1d0 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:39:03.718297 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fd0d13-8445-4cd3-ad90-de03221fcc1a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35d98c4a2af546d8b655d649d655f447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:39:03.718952 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd0d13-8445-4cd3-ad90-de03221fcc1a service placement] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:39:03.719253 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd0d13-8445-4cd3-ad90-de03221fcc1a service placement] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:39:03.719534 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd0d13-8445-4cd3-ad90-de03221fcc1a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:39:03.721320 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-40fd0d13-8445-4cd3-ad90-de03221fcc1a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:39:03.733420 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fd0d13-8445-4cd3-ad90-de03221fcc1a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:39:03.735061 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fd0d13-8445-4cd3-ad90-de03221fcc1a service placement] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:39:03.744959 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1399/2781] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:39:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:39:11.757895 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:39:13.740749 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=32 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:39:57.060712 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49fb9b5-e145-417a-8ebb-887e22680567 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:39:57.062132 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-a49fb9b5-e145-417a-8ebb-887e22680567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:39:57.119062 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49fb9b5-e145-417a-8ebb-887e22680567 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:39:57.123528 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afecfdb9-ace2-4ad6-8c4d-1ee0cd4a4e25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:39:57.124194 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afecfdb9-ace2-4ad6-8c4d-1ee0cd4a4e25 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:39:57.124480 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afecfdb9-ace2-4ad6-8c4d-1ee0cd4a4e25 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:39:57.124761 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afecfdb9-ace2-4ad6-8c4d-1ee0cd4a4e25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:39:57.126528 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-afecfdb9-ace2-4ad6-8c4d-1ee0cd4a4e25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:39:57.194541 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afecfdb9-ace2-4ad6-8c4d-1ee0cd4a4e25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:39:57.195957 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afecfdb9-ace2-4ad6-8c4d-1ee0cd4a4e25 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:39:57.207352 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1383/2782] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:39:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:39:58.381785 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fd0d13-8445-4cd3-ad90-de03221fcc1a service placement] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:39:58.383295 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-40fd0d13-8445-4cd3-ad90-de03221fcc1a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:39:58.395621 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fd0d13-8445-4cd3-ad90-de03221fcc1a service placement] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:39:58.399191 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e80d4-fbc8-4241-b4a8-e0916ffc0f20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:39:58.403024 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e80d4-fbc8-4241-b4a8-e0916ffc0f20 service neutron] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:39:58.403024 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e80d4-fbc8-4241-b4a8-e0916ffc0f20 service neutron] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:39:58.403024 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e80d4-fbc8-4241-b4a8-e0916ffc0f20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:39:58.403024 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-714e80d4-fbc8-4241-b4a8-e0916ffc0f20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:39:58.418089 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714e80d4-fbc8-4241-b4a8-e0916ffc0f20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:39:58.419573 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714e80d4-fbc8-4241-b4a8-e0916ffc0f20 service neutron] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:39:58.432628 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1400/2783] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:39:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:40:04.897517 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d89eb2-c92c-4f38-92f9-8b197f6bcc10 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:04.898571 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d89eb2-c92c-4f38-92f9-8b197f6bcc10 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:04.898571 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d89eb2-c92c-4f38-92f9-8b197f6bcc10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:04.915875 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-06d89eb2-c92c-4f38-92f9-8b197f6bcc10 None None] MFA Rules not processed for user `6e0dce1bbbc44a5481ed3285a0f6209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:40:04.917111 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-06d89eb2-c92c-4f38-92f9-8b197f6bcc10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:40:04.924075 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1384/2784] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:40:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:40:08.426068 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=6 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:40:14.910966 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=57 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:40:19.823763 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e80d4-fbc8-4241-b4a8-e0916ffc0f20 service neutron] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:19.832526 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e80d4-fbc8-4241-b4a8-e0916ffc0f20 service neutron] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:19.836169 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4e886b-012c-4dc3-a3b7-714c2de21680 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:19.836813 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e886b-012c-4dc3-a3b7-714c2de21680 service neutron] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:19.837104 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e886b-012c-4dc3-a3b7-714c2de21680 service neutron] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:19.837385 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e886b-012c-4dc3-a3b7-714c2de21680 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:19.839214 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-5f4e886b-012c-4dc3-a3b7-714c2de21680 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:40:19.849541 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4e886b-012c-4dc3-a3b7-714c2de21680 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:19.851180 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4e886b-012c-4dc3-a3b7-714c2de21680 service neutron] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:19.859829 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1401/2785] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:40:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:40:29.856038 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=6 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:41:03.190752 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d89eb2-c92c-4f38-92f9-8b197f6bcc10 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:03.192202 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-06d89eb2-c92c-4f38-92f9-8b197f6bcc10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:03.208632 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d89eb2-c92c-4f38-92f9-8b197f6bcc10 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:03.215048 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b703a4b-0f85-429b-ade8-621f0b8116aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb13ad6d8b1e46029262556bff398796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:03.215721 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b703a4b-0f85-429b-ade8-621f0b8116aa service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:03.216006 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b703a4b-0f85-429b-ade8-621f0b8116aa service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:03.216283 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b703a4b-0f85-429b-ade8-621f0b8116aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:03.218135 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-7b703a4b-0f85-429b-ade8-621f0b8116aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:03.231169 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b703a4b-0f85-429b-ade8-621f0b8116aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:03.232769 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b703a4b-0f85-429b-ade8-621f0b8116aa service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:03.244747 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1385/2786] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:41:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:41:08.518296 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515784a9-ffe0-4a58-9914-b2f6330f3971 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:08.518818 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515784a9-ffe0-4a58-9914-b2f6330f3971 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:08.518930 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515784a9-ffe0-4a58-9914-b2f6330f3971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:08.537438 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-515784a9-ffe0-4a58-9914-b2f6330f3971 None None] MFA Rules not processed for user `6e0dce1bbbc44a5481ed3285a0f6209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:41:08.539400 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-515784a9-ffe0-4a58-9914-b2f6330f3971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:08.545510 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1402/2787] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:41:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:41:08.843969 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b703a4b-0f85-429b-ade8-621f0b8116aa service nova] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:08.853323 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b703a4b-0f85-429b-ade8-621f0b8116aa service nova] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:08.857217 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a54666-66e9-4ead-8f21-3f7f430fddb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:08.857891 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a54666-66e9-4ead-8f21-3f7f430fddb6 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:08.858179 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a54666-66e9-4ead-8f21-3f7f430fddb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:08.858495 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a54666-66e9-4ead-8f21-3f7f430fddb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:08.860304 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-66a54666-66e9-4ead-8f21-3f7f430fddb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:08.880557 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a54666-66e9-4ead-8f21-3f7f430fddb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:08.881999 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a54666-66e9-4ead-8f21-3f7f430fddb6 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:08.890582 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1386/2788] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:41:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:41:10.314446 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515784a9-ffe0-4a58-9914-b2f6330f3971 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:10.315885 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-515784a9-ffe0-4a58-9914-b2f6330f3971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:10.331039 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515784a9-ffe0-4a58-9914-b2f6330f3971 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:10.335943 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60d4f0f-b043-405c-8c83-faa89e2fe21a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35d98c4a2af546d8b655d649d655f447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:10.336657 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d4f0f-b043-405c-8c83-faa89e2fe21a service placement] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:10.336942 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d4f0f-b043-405c-8c83-faa89e2fe21a service placement] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:10.337219 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d4f0f-b043-405c-8c83-faa89e2fe21a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:10.339847 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-d60d4f0f-b043-405c-8c83-faa89e2fe21a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:10.351596 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60d4f0f-b043-405c-8c83-faa89e2fe21a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:10.353169 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60d4f0f-b043-405c-8c83-faa89e2fe21a service placement] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:10.363383 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1403/2789] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:41:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:41:18.886946 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=12 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:41:20.358918 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=9 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:41:21.816785 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a54666-66e9-4ead-8f21-3f7f430fddb6 service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:21.818201 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-66a54666-66e9-4ead-8f21-3f7f430fddb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:21.833912 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a54666-66e9-4ead-8f21-3f7f430fddb6 service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:21.839523 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17efddfe-643f-4708-a403-9c4fcfac5b8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb13ad6d8b1e46029262556bff398796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:21.840167 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17efddfe-643f-4708-a403-9c4fcfac5b8e service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:21.840459 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17efddfe-643f-4708-a403-9c4fcfac5b8e service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:21.840739 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17efddfe-643f-4708-a403-9c4fcfac5b8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:21.843343 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-17efddfe-643f-4708-a403-9c4fcfac5b8e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:21.855842 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17efddfe-643f-4708-a403-9c4fcfac5b8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:21.857468 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17efddfe-643f-4708-a403-9c4fcfac5b8e service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:21.869842 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1387/2790] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:41:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:41:31.864325 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=6 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:42:19.532423 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60d4f0f-b043-405c-8c83-faa89e2fe21a service placement] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:19.533920 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-d60d4f0f-b043-405c-8c83-faa89e2fe21a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:42:19.660789 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60d4f0f-b043-405c-8c83-faa89e2fe21a service placement] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:19.666031 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4b58de-842e-4908-abff-cfc9e1510c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:19.666947 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b58de-842e-4908-abff-cfc9e1510c4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:19.667237 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b58de-842e-4908-abff-cfc9e1510c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:19.667518 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b58de-842e-4908-abff-cfc9e1510c4a admin admin] PATH_INFO: `/v3/users/6e0dce1bbbc44a5481ed3285a0f6209b` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:19.668749 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4b58de-842e-4908-abff-cfc9e1510c4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e0dce1bbbc44a5481ed3285a0f6209b)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:19.670729 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4b58de-842e-4908-abff-cfc9e1510c4a admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:19.846794 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-3f4b58de-842e-4908-abff-cfc9e1510c4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e0dce1bbbc44a5481ed3285a0f6209b'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:19.859174 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-3f4b58de-842e-4908-abff-cfc9e1510c4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e0dce1bbbc44a5481ed3285a0f6209b'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:19.859934 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-3f4b58de-842e-4908-abff-cfc9e1510c4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e0dce1bbbc44a5481ed3285a0f6209b'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:19.860559 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-3f4b58de-842e-4908-abff-cfc9e1510c4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e0dce1bbbc44a5481ed3285a0f6209b'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:19.918497 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-3f4b58de-842e-4908-abff-cfc9e1510c4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e0dce1bbbc44a5481ed3285a0f6209b'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:19.931067 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1404/2791] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:42:19 2022] DELETE /identity/v3/users/6e0dce1bbbc44a5481ed3285a0f6209b => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:42:20.177305 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17efddfe-643f-4708-a403-9c4fcfac5b8e service nova] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:20.217376 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17efddfe-643f-4708-a403-9c4fcfac5b8e service nova] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:20.272154 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65794a3a-5f4f-4535-b801-949689b03a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:20.273003 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65794a3a-5f4f-4535-b801-949689b03a5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:20.273291 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65794a3a-5f4f-4535-b801-949689b03a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:20.273568 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65794a3a-5f4f-4535-b801-949689b03a5e admin admin] PATH_INFO: `/v3/projects/88c9bfdfc141417ba922c9cabb8fec83` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:20.274774 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65794a3a-5f4f-4535-b801-949689b03a5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=88c9bfdfc141417ba922c9cabb8fec83)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:20.276682 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65794a3a-5f4f-4535-b801-949689b03a5e admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:20.423552 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-65794a3a-5f4f-4535-b801-949689b03a5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88c9bfdfc141417ba922c9cabb8fec83', 'request_id': 'req-65794a3a-5f4f-4535-b801-949689b03a5e'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:20.429953 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-65794a3a-5f4f-4535-b801-949689b03a5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88c9bfdfc141417ba922c9cabb8fec83', 'request_id': 'req-65794a3a-5f4f-4535-b801-949689b03a5e'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:20.522119 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-65794a3a-5f4f-4535-b801-949689b03a5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88c9bfdfc141417ba922c9cabb8fec83', 'request_id': 'req-65794a3a-5f4f-4535-b801-949689b03a5e'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:20.535461 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-65794a3a-5f4f-4535-b801-949689b03a5e admin admin] The token cache is being invalidate because project 88c9bfdfc141417ba922c9cabb8fec83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:42:20.536028 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-65794a3a-5f4f-4535-b801-949689b03a5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:20.538001 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-65794a3a-5f4f-4535-b801-949689b03a5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:20.538773 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1388/2792] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:42:20 2022] DELETE /identity/v3/projects/88c9bfdfc141417ba922c9cabb8fec83 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:42:20.543792 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459d455-e7fb-4c36-ba15-1f82d7d8ef65 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:20.544281 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459d455-e7fb-4c36-ba15-1f82d7d8ef65 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:20.544382 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459d455-e7fb-4c36-ba15-1f82d7d8ef65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:20.569300 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:42:20.604143 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-6459d455-e7fb-4c36-ba15-1f82d7d8ef65 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:42:20.605367 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-6459d455-e7fb-4c36-ba15-1f82d7d8ef65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:42:20.667429 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1405/2793] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:42:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:42:20.681225 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e5599-7678-47af-8669-6a348df8e8ba None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:20.681225 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e5599-7678-47af-8669-6a348df8e8ba None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:20.681225 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e5599-7678-47af-8669-6a348df8e8ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:20.695445 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-506e5599-7678-47af-8669-6a348df8e8ba None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:42:20.696662 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-506e5599-7678-47af-8669-6a348df8e8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:42:20.704696 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1389/2794] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:42:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:42:20.708866 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6459d455-e7fb-4c36-ba15-1f82d7d8ef65 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:20.718910 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6459d455-e7fb-4c36-ba15-1f82d7d8ef65 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:20.723588 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb1cd42-2f9a-4695-a8f8-9aafe017f67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:20.724239 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb1cd42-2f9a-4695-a8f8-9aafe017f67e admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:20.724522 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb1cd42-2f9a-4695-a8f8-9aafe017f67e admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:20.724796 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb1cd42-2f9a-4695-a8f8-9aafe017f67e admin admin] PATH_INFO: `/v3/domains` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:20.725519 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb1cd42-2f9a-4695-a8f8-9aafe017f67e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:42:20.725826 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb1cd42-2f9a-4695-a8f8-9aafe017f67e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:20.727450 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb1cd42-2f9a-4695-a8f8-9aafe017f67e admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:20.740627 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1406/2795] 10.222.0.62 () {58 vars in 1152 bytes} [Fri May 27 16:42:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:42:20.747621 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506e5599-7678-47af-8669-6a348df8e8ba None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:20.757607 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506e5599-7678-47af-8669-6a348df8e8ba None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:20.762172 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea6417-93b7-4d83-b27a-1ed47a215160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:20.762847 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea6417-93b7-4d83-b27a-1ed47a215160 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:20.763171 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea6417-93b7-4d83-b27a-1ed47a215160 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:20.763446 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea6417-93b7-4d83-b27a-1ed47a215160 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:20.764132 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ea6417-93b7-4d83-b27a-1ed47a215160 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:20.766002 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ea6417-93b7-4d83-b27a-1ed47a215160 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:20.892993 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1390/2796] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:42:20 2022] POST /identity/v3/projects => generated 381 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:42:20.896309 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb1cd42-2f9a-4695-a8f8-9aafe017f67e admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:20.906284 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb1cd42-2f9a-4695-a8f8-9aafe017f67e admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:20.964122 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8d2202-61f5-4039-afa8-ce17d11e1d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:20.964720 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d2202-61f5-4039-afa8-ce17d11e1d3f admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:20.965017 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d2202-61f5-4039-afa8-ce17d11e1d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:20.965300 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d2202-61f5-4039-afa8-ce17d11e1d3f admin admin] PATH_INFO: `/v3/users` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:20.965993 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8d2202-61f5-4039-afa8-ce17d11e1d3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:20.967957 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8d2202-61f5-4039-afa8-ce17d11e1d3f admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:21.072906 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1407/2797] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:42:20 2022] POST /identity/v3/users => generated 291 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:42:21.076974 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea6417-93b7-4d83-b27a-1ed47a215160 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:21.087310 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea6417-93b7-4d83-b27a-1ed47a215160 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:21.091963 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1252465-ca08-4f9f-a4f2-a09236750270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:21.092615 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1252465-ca08-4f9f-a4f2-a09236750270 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:21.092904 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1252465-ca08-4f9f-a4f2-a09236750270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:21.093185 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1252465-ca08-4f9f-a4f2-a09236750270 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:21.093908 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1252465-ca08-4f9f-a4f2-a09236750270 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:21.095547 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1252465-ca08-4f9f-a4f2-a09236750270 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:21.106724 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1391/2798] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:42:21.110550 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8d2202-61f5-4039-afa8-ce17d11e1d3f admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:21.121741 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8d2202-61f5-4039-afa8-ce17d11e1d3f admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:21.126444 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c8b5b0-526c-4520-9544-0d80451925fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:21.127098 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8b5b0-526c-4520-9544-0d80451925fa admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:21.127388 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8b5b0-526c-4520-9544-0d80451925fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:21.127671 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8b5b0-526c-4520-9544-0d80451925fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:21.128403 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c8b5b0-526c-4520-9544-0d80451925fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:21.130007 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c8b5b0-526c-4520-9544-0d80451925fa admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:21.140127 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1408/2799] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:42:21.143980 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1252465-ca08-4f9f-a4f2-a09236750270 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:21.153678 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1252465-ca08-4f9f-a4f2-a09236750270 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:21.158236 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e52b6bd-d4fe-4ccd-8a6e-c863fd617ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:21.159127 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e52b6bd-d4fe-4ccd-8a6e-c863fd617ce6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:21.159443 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e52b6bd-d4fe-4ccd-8a6e-c863fd617ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:21.159721 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e52b6bd-d4fe-4ccd-8a6e-c863fd617ce6 admin admin] PATH_INFO: `/v3/projects/eb2e7da2b7894d5cab1edd1303e1dc83/users/b8c19f70ed0f4ecfa9a3936303c522cc/roles/c8ce6d197f654598ac45f6016ecccabd` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:21.174505 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e52b6bd-d4fe-4ccd-8a6e-c863fd617ce6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb2e7da2b7894d5cab1edd1303e1dc83, user_id=b8c19f70ed0f4ecfa9a3936303c522cc, role_id=c8ce6d197f654598ac45f6016ecccabd)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:21.177133 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e52b6bd-d4fe-4ccd-8a6e-c863fd617ce6 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:21.252331 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1392/2800] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:42:21 2022] PUT /identity/v3/projects/eb2e7da2b7894d5cab1edd1303e1dc83/users/b8c19f70ed0f4ecfa9a3936303c522cc/roles/c8ce6d197f654598ac45f6016ecccabd => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:42:21.262548 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8840e9ee-0c82-4398-b5b7-b67a15234c45 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:21.262848 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8840e9ee-0c82-4398-b5b7-b67a15234c45 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:21.263152 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8840e9ee-0c82-4398-b5b7-b67a15234c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:21.290384 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-8840e9ee-0c82-4398-b5b7-b67a15234c45 None None] MFA Rules not processed for user `b8c19f70ed0f4ecfa9a3936303c522cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:42:21.291591 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-8840e9ee-0c82-4398-b5b7-b67a15234c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:42:21.331649 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:42:21.354798 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1409/2801] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:42:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:42:21.359351 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e52b6bd-d4fe-4ccd-8a6e-c863fd617ce6 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:21.363852 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:42:21.422659 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e52b6bd-d4fe-4ccd-8a6e-c863fd617ce6 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:21.428001 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740b60cb-8d63-46c7-b3ef-055b097a3cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:21.428680 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b60cb-8d63-46c7-b3ef-055b097a3cdc admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:21.428949 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b60cb-8d63-46c7-b3ef-055b097a3cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:21.429232 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b60cb-8d63-46c7-b3ef-055b097a3cdc admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:21.429960 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740b60cb-8d63-46c7-b3ef-055b097a3cdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:21.431938 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740b60cb-8d63-46c7-b3ef-055b097a3cdc admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:21.548921 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1393/2802] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:42:21 2022] POST /identity/v3/projects => generated 387 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:42:21.552974 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8840e9ee-0c82-4398-b5b7-b67a15234c45 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:21.563598 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8840e9ee-0c82-4398-b5b7-b67a15234c45 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:21.619832 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237d79e3-5beb-44d7-a275-92d021511508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:21.620494 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237d79e3-5beb-44d7-a275-92d021511508 admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:21.620780 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237d79e3-5beb-44d7-a275-92d021511508 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:21.621054 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237d79e3-5beb-44d7-a275-92d021511508 admin admin] PATH_INFO: `/v3/users` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:21.621756 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237d79e3-5beb-44d7-a275-92d021511508 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:21.623669 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237d79e3-5beb-44d7-a275-92d021511508 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:21.698634 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1410/2803] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:42:21 2022] POST /identity/v3/users => generated 300 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:42:21.702389 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740b60cb-8d63-46c7-b3ef-055b097a3cdc admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:21.713380 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740b60cb-8d63-46c7-b3ef-055b097a3cdc admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:21.718113 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcb2a29-a6ce-423c-8280-b21fd8c618cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:21.718813 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb2a29-a6ce-423c-8280-b21fd8c618cf admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:21.719103 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb2a29-a6ce-423c-8280-b21fd8c618cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:21.719387 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb2a29-a6ce-423c-8280-b21fd8c618cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:21.720116 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcb2a29-a6ce-423c-8280-b21fd8c618cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:21.721737 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcb2a29-a6ce-423c-8280-b21fd8c618cf admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:21.732188 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1394/2804] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:42:21.736156 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237d79e3-5beb-44d7-a275-92d021511508 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:21.746368 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237d79e3-5beb-44d7-a275-92d021511508 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:21.751056 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ce6626-5c63-4b79-a2df-c57638f111a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:21.751934 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce6626-5c63-4b79-a2df-c57638f111a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:21.752224 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce6626-5c63-4b79-a2df-c57638f111a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:21.752505 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce6626-5c63-4b79-a2df-c57638f111a0 admin admin] PATH_INFO: `/v3/projects/6376e28e32d1442f95decb0894260b83/users/28a63c1e2e6742e3a75774bd2198957a/roles/e04fe3eb1f714d74901ac83e33ea8a16` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:21.767595 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ce6626-5c63-4b79-a2df-c57638f111a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6376e28e32d1442f95decb0894260b83, user_id=28a63c1e2e6742e3a75774bd2198957a, role_id=e04fe3eb1f714d74901ac83e33ea8a16)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:21.770270 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ce6626-5c63-4b79-a2df-c57638f111a0 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:21.839174 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1411/2805] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:42:21 2022] PUT /identity/v3/projects/6376e28e32d1442f95decb0894260b83/users/28a63c1e2e6742e3a75774bd2198957a/roles/e04fe3eb1f714d74901ac83e33ea8a16 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:42:21.843912 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcb2a29-a6ce-423c-8280-b21fd8c618cf admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:21.854295 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcb2a29-a6ce-423c-8280-b21fd8c618cf admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:21.910783 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31354037-0e5c-4a3a-afe7-a3a6e3a58267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:21.911443 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31354037-0e5c-4a3a-afe7-a3a6e3a58267 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:21.911749 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31354037-0e5c-4a3a-afe7-a3a6e3a58267 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:21.912027 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31354037-0e5c-4a3a-afe7-a3a6e3a58267 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:21.912739 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31354037-0e5c-4a3a-afe7-a3a6e3a58267 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:21.914352 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31354037-0e5c-4a3a-afe7-a3a6e3a58267 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:21.923866 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1395/2806] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:42:21.928049 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ce6626-5c63-4b79-a2df-c57638f111a0 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:21.938269 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ce6626-5c63-4b79-a2df-c57638f111a0 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:21.943824 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e36a52a-a436-47b3-9792-5f8d1f7ed21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:21.944721 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e36a52a-a436-47b3-9792-5f8d1f7ed21d admin admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:21.945010 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e36a52a-a436-47b3-9792-5f8d1f7ed21d admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:21.945293 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e36a52a-a436-47b3-9792-5f8d1f7ed21d admin admin] PATH_INFO: `/v3/projects/6376e28e32d1442f95decb0894260b83/users/28a63c1e2e6742e3a75774bd2198957a/roles/e04fe3eb1f714d74901ac83e33ea8a16` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:21.947422 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e36a52a-a436-47b3-9792-5f8d1f7ed21d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6376e28e32d1442f95decb0894260b83, user_id=28a63c1e2e6742e3a75774bd2198957a, role_id=e04fe3eb1f714d74901ac83e33ea8a16)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:21.950074 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e36a52a-a436-47b3-9792-5f8d1f7ed21d admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:21.961225 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1412/2807] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:42:21 2022] PUT /identity/v3/projects/6376e28e32d1442f95decb0894260b83/users/28a63c1e2e6742e3a75774bd2198957a/roles/e04fe3eb1f714d74901ac83e33ea8a16 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:42:21.977145 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10cbc8b-20f7-4252-be88-9a4fab1a8fc6 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:21.977436 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10cbc8b-20f7-4252-be88-9a4fab1a8fc6 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:21.977716 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10cbc8b-20f7-4252-be88-9a4fab1a8fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:22.004480 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-f10cbc8b-20f7-4252-be88-9a4fab1a8fc6 None None] MFA Rules not processed for user `28a63c1e2e6742e3a75774bd2198957a`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:42:22.006187 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-f10cbc8b-20f7-4252-be88-9a4fab1a8fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:42:22.073106 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:42:22.078675 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1396/2808] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:42:21 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:42:22.090974 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e36a52a-a436-47b3-9792-5f8d1f7ed21d admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:22.092327 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-5e36a52a-a436-47b3-9792-5f8d1f7ed21d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:42:22.166977 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e36a52a-a436-47b3-9792-5f8d1f7ed21d admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:22.170773 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a1d89-3444-4690-981a-e2cdcde31a33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8693a1e72f14fdfb383f11e96330726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:22.171419 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a1d89-3444-4690-981a-e2cdcde31a33 service cinder] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:22.171705 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a1d89-3444-4690-981a-e2cdcde31a33 service cinder] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:22.171985 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a1d89-3444-4690-981a-e2cdcde31a33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:22.182841 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123a1d89-3444-4690-981a-e2cdcde31a33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:22.188553 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123a1d89-3444-4690-981a-e2cdcde31a33 service cinder] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:22.194396 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1413/2809] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:42:22 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:42:22.257166 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10cbc8b-20f7-4252-be88-9a4fab1a8fc6 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:22.317487 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10cbc8b-20f7-4252-be88-9a4fab1a8fc6 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:22.322690 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6c523c-8e20-455c-853a-7d901a579ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:22.323557 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c523c-8e20-455c-853a-7d901a579ed2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:22.323843 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c523c-8e20-455c-853a-7d901a579ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:22.324125 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c523c-8e20-455c-853a-7d901a579ed2 admin admin] PATH_INFO: `/v3/users/b8c19f70ed0f4ecfa9a3936303c522cc` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:22.325324 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6c523c-8e20-455c-853a-7d901a579ed2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8c19f70ed0f4ecfa9a3936303c522cc)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:22.327302 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6c523c-8e20-455c-853a-7d901a579ed2 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:22.551794 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-cd6c523c-8e20-455c-853a-7d901a579ed2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8c19f70ed0f4ecfa9a3936303c522cc'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:22.559308 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-cd6c523c-8e20-455c-853a-7d901a579ed2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8c19f70ed0f4ecfa9a3936303c522cc'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:22.559968 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-cd6c523c-8e20-455c-853a-7d901a579ed2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8c19f70ed0f4ecfa9a3936303c522cc'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:22.560695 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-cd6c523c-8e20-455c-853a-7d901a579ed2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8c19f70ed0f4ecfa9a3936303c522cc'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:22.632927 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-cd6c523c-8e20-455c-853a-7d901a579ed2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8c19f70ed0f4ecfa9a3936303c522cc'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:22.651029 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1397/2810] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:42:22 2022] DELETE /identity/v3/users/b8c19f70ed0f4ecfa9a3936303c522cc => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:42:22.655509 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb2a3b1-457e-4d26-bea5-1a9d31815f37 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:22.655995 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb2a3b1-457e-4d26-bea5-1a9d31815f37 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:22.656193 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb2a3b1-457e-4d26-bea5-1a9d31815f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:22.673791 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-6fb2a3b1-457e-4d26-bea5-1a9d31815f37 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:42:22.675025 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-6fb2a3b1-457e-4d26-bea5-1a9d31815f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:42:22.692045 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:42:22.734160 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1414/2811] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:42:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:42:22.744837 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6c523c-8e20-455c-853a-7d901a579ed2 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:22.746307 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-cd6c523c-8e20-455c-853a-7d901a579ed2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:42:22.823381 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6c523c-8e20-455c-853a-7d901a579ed2 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:22.827033 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed33bc04-ea84-4388-8a12-d5fbb044eab5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:22.827674 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed33bc04-ea84-4388-8a12-d5fbb044eab5 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:22.827964 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed33bc04-ea84-4388-8a12-d5fbb044eab5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:22.828243 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed33bc04-ea84-4388-8a12-d5fbb044eab5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:22.837639 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed33bc04-ea84-4388-8a12-d5fbb044eab5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:22.839101 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed33bc04-ea84-4388-8a12-d5fbb044eab5 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:22.844090 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:42:22.849618 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1398/2812] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:42:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:42:23.337972 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb2a3b1-457e-4d26-bea5-1a9d31815f37 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:23.339823 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-6fb2a3b1-457e-4d26-bea5-1a9d31815f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:42:23.355530 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb2a3b1-457e-4d26-bea5-1a9d31815f37 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:23.360208 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd04f0-b08b-4d1e-809f-778ffd41ffde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:23.361156 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd04f0-b08b-4d1e-809f-778ffd41ffde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:23.361564 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd04f0-b08b-4d1e-809f-778ffd41ffde admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:23.361753 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd04f0-b08b-4d1e-809f-778ffd41ffde admin admin] PATH_INFO: `/v3/projects/eb2e7da2b7894d5cab1edd1303e1dc83` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:23.362943 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdd04f0-b08b-4d1e-809f-778ffd41ffde admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb2e7da2b7894d5cab1edd1303e1dc83)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:23.365931 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdd04f0-b08b-4d1e-809f-778ffd41ffde admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:23.492033 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-6bdd04f0-b08b-4d1e-809f-778ffd41ffde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb2e7da2b7894d5cab1edd1303e1dc83', 'request_id': 'req-6bdd04f0-b08b-4d1e-809f-778ffd41ffde'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:23.498184 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-6bdd04f0-b08b-4d1e-809f-778ffd41ffde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb2e7da2b7894d5cab1edd1303e1dc83', 'request_id': 'req-6bdd04f0-b08b-4d1e-809f-778ffd41ffde'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:23.503725 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-6bdd04f0-b08b-4d1e-809f-778ffd41ffde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb2e7da2b7894d5cab1edd1303e1dc83', 'request_id': 'req-6bdd04f0-b08b-4d1e-809f-778ffd41ffde'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:23.587286 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-6bdd04f0-b08b-4d1e-809f-778ffd41ffde admin admin] The token cache is being invalidate because project eb2e7da2b7894d5cab1edd1303e1dc83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80288) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:42:23.587489 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-6bdd04f0-b08b-4d1e-809f-778ffd41ffde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:23.588097 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-6bdd04f0-b08b-4d1e-809f-778ffd41ffde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:23.589645 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1415/2813] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:42:23 2022] DELETE /identity/v3/projects/eb2e7da2b7894d5cab1edd1303e1dc83 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:42:23.593802 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed33bc04-ea84-4388-8a12-d5fbb044eab5 service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:23.604269 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed33bc04-ea84-4388-8a12-d5fbb044eab5 service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:23.659469 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c6177e-e58c-4682-90e2-601c5ab6a25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:23.660328 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c6177e-e58c-4682-90e2-601c5ab6a25a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:23.660614 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c6177e-e58c-4682-90e2-601c5ab6a25a admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:23.660891 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c6177e-e58c-4682-90e2-601c5ab6a25a admin admin] PATH_INFO: `/v3/users/28a63c1e2e6742e3a75774bd2198957a` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:23.662656 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c6177e-e58c-4682-90e2-601c5ab6a25a admin admin] RBAC: Authorizing `identity:delete_user(user_id=28a63c1e2e6742e3a75774bd2198957a)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:23.664570 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c6177e-e58c-4682-90e2-601c5ab6a25a admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:23.878000 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-e0c6177e-e58c-4682-90e2-601c5ab6a25a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28a63c1e2e6742e3a75774bd2198957a'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:23.885129 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-e0c6177e-e58c-4682-90e2-601c5ab6a25a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28a63c1e2e6742e3a75774bd2198957a'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:23.885973 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-e0c6177e-e58c-4682-90e2-601c5ab6a25a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28a63c1e2e6742e3a75774bd2198957a'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:23.886616 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-e0c6177e-e58c-4682-90e2-601c5ab6a25a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28a63c1e2e6742e3a75774bd2198957a'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:23.946815 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-e0c6177e-e58c-4682-90e2-601c5ab6a25a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28a63c1e2e6742e3a75774bd2198957a'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:23.965246 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1399/2814] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:42:23 2022] DELETE /identity/v3/users/28a63c1e2e6742e3a75774bd2198957a => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:42:24.372411 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd04f0-b08b-4d1e-809f-778ffd41ffde admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:24.382961 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-6bdd04f0-b08b-4d1e-809f-778ffd41ffde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:42:24.387720 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd04f0-b08b-4d1e-809f-778ffd41ffde admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:24.445828 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c126788-d416-4712-a482-7b965d35a844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:24.446718 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c126788-d416-4712-a482-7b965d35a844 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:24.447004 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c126788-d416-4712-a482-7b965d35a844 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:24.447284 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c126788-d416-4712-a482-7b965d35a844 admin admin] PATH_INFO: `/v3/projects/6376e28e32d1442f95decb0894260b83` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:24.448587 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c126788-d416-4712-a482-7b965d35a844 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6376e28e32d1442f95decb0894260b83)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:24.450448 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c126788-d416-4712-a482-7b965d35a844 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:24.575161 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:42:24.576365 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-7c126788-d416-4712-a482-7b965d35a844 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6376e28e32d1442f95decb0894260b83', 'request_id': 'req-7c126788-d416-4712-a482-7b965d35a844'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:24.582570 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-7c126788-d416-4712-a482-7b965d35a844 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6376e28e32d1442f95decb0894260b83', 'request_id': 'req-7c126788-d416-4712-a482-7b965d35a844'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:24.588011 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-7c126788-d416-4712-a482-7b965d35a844 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6376e28e32d1442f95decb0894260b83', 'request_id': 'req-7c126788-d416-4712-a482-7b965d35a844'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:24.657934 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-7c126788-d416-4712-a482-7b965d35a844 admin admin] The token cache is being invalidate because project 6376e28e32d1442f95decb0894260b83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80288) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:42:24.658188 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-7c126788-d416-4712-a482-7b965d35a844 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:24.658857 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-7c126788-d416-4712-a482-7b965d35a844 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:24.660453 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1416/2815] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:42:24 2022] DELETE /identity/v3/projects/6376e28e32d1442f95decb0894260b83 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:42:24.666271 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5036a50c-1ddd-47f7-bd6a-0207fbcbe7df None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:24.666752 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5036a50c-1ddd-47f7-bd6a-0207fbcbe7df None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:24.666855 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5036a50c-1ddd-47f7-bd6a-0207fbcbe7df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:24.684913 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-5036a50c-1ddd-47f7-bd6a-0207fbcbe7df None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:42:24.692261 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-5036a50c-1ddd-47f7-bd6a-0207fbcbe7df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:42:24.745530 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1400/2816] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:42:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:42:24.754469 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b951094d-f594-432e-a850-1c3ffe1bd45e None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:24.754762 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b951094d-f594-432e-a850-1c3ffe1bd45e None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:24.755042 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b951094d-f594-432e-a850-1c3ffe1bd45e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:24.773462 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-b951094d-f594-432e-a850-1c3ffe1bd45e None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:42:24.774697 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-b951094d-f594-432e-a850-1c3ffe1bd45e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:42:24.782760 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1417/2817] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:42:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:42:24.787365 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5036a50c-1ddd-47f7-bd6a-0207fbcbe7df None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:24.796849 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5036a50c-1ddd-47f7-bd6a-0207fbcbe7df None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:24.801371 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876f61fd-ebfa-4345-bb62-d5fa5f717949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:24.802075 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f61fd-ebfa-4345-bb62-d5fa5f717949 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:24.802870 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f61fd-ebfa-4345-bb62-d5fa5f717949 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:24.803154 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f61fd-ebfa-4345-bb62-d5fa5f717949 admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:24.803885 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876f61fd-ebfa-4345-bb62-d5fa5f717949 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:42:24.804199 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876f61fd-ebfa-4345-bb62-d5fa5f717949 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:24.805796 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876f61fd-ebfa-4345-bb62-d5fa5f717949 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:24.817281 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1401/2818] 10.222.0.62 () {58 vars in 1152 bytes} [Fri May 27 16:42:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:42:24.821415 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b951094d-f594-432e-a850-1c3ffe1bd45e None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:24.830473 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b951094d-f594-432e-a850-1c3ffe1bd45e None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:24.835113 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867b4afd-dfa4-4b5a-901f-e518bbc0fc2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:24.835750 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b4afd-dfa4-4b5a-901f-e518bbc0fc2b admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:24.836032 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b4afd-dfa4-4b5a-901f-e518bbc0fc2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:24.836308 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b4afd-dfa4-4b5a-901f-e518bbc0fc2b admin admin] PATH_INFO: `/v3/projects` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:24.836980 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867b4afd-dfa4-4b5a-901f-e518bbc0fc2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:24.838903 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867b4afd-dfa4-4b5a-901f-e518bbc0fc2b admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:24.957392 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1418/2819] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:42:24 2022] POST /identity/v3/projects => generated 383 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:42:24.961472 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876f61fd-ebfa-4345-bb62-d5fa5f717949 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:24.971473 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876f61fd-ebfa-4345-bb62-d5fa5f717949 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:24.975552 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:42:25.028751 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4777fe57-a1c0-4b42-a595-be755521fdc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:25.029433 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4777fe57-a1c0-4b42-a595-be755521fdc8 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:25.029720 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4777fe57-a1c0-4b42-a595-be755521fdc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:25.030005 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4777fe57-a1c0-4b42-a595-be755521fdc8 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:25.030735 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4777fe57-a1c0-4b42-a595-be755521fdc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:25.032665 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4777fe57-a1c0-4b42-a595-be755521fdc8 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:25.133348 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1402/2820] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:42:24 2022] POST /identity/v3/users => generated 292 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:42:25.137183 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867b4afd-dfa4-4b5a-901f-e518bbc0fc2b admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:25.148078 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867b4afd-dfa4-4b5a-901f-e518bbc0fc2b admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:25.152637 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbbf2f2-8e83-4661-a628-a1e38a92af68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:25.153295 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbbf2f2-8e83-4661-a628-a1e38a92af68 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:25.155487 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbbf2f2-8e83-4661-a628-a1e38a92af68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:25.155487 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbbf2f2-8e83-4661-a628-a1e38a92af68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:25.155487 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbbf2f2-8e83-4661-a628-a1e38a92af68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:25.156184 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbbf2f2-8e83-4661-a628-a1e38a92af68 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:25.167237 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1419/2821] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:42:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:42:25.171074 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4777fe57-a1c0-4b42-a595-be755521fdc8 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:25.181355 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4777fe57-a1c0-4b42-a595-be755521fdc8 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:25.186014 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e821c76-2eb3-4fe7-91b7-20f37122ffda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:25.186692 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e821c76-2eb3-4fe7-91b7-20f37122ffda admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:25.186977 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e821c76-2eb3-4fe7-91b7-20f37122ffda admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:25.187255 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e821c76-2eb3-4fe7-91b7-20f37122ffda admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:25.187976 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e821c76-2eb3-4fe7-91b7-20f37122ffda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:25.189615 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e821c76-2eb3-4fe7-91b7-20f37122ffda admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:25.199655 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1403/2822] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:42:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:42:25.203768 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbbf2f2-8e83-4661-a628-a1e38a92af68 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:25.214177 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbbf2f2-8e83-4661-a628-a1e38a92af68 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:25.218704 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df76643d-ee53-45c4-aaaa-662ad69f9161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:25.219570 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df76643d-ee53-45c4-aaaa-662ad69f9161 admin admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:25.219856 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df76643d-ee53-45c4-aaaa-662ad69f9161 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:25.220137 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df76643d-ee53-45c4-aaaa-662ad69f9161 admin admin] PATH_INFO: `/v3/projects/17652a18de014853b187316dce12bfc7/users/df11bf06a6d54ab28b6b5631ef5de18f/roles/c8ce6d197f654598ac45f6016ecccabd` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:25.235056 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df76643d-ee53-45c4-aaaa-662ad69f9161 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17652a18de014853b187316dce12bfc7, user_id=df11bf06a6d54ab28b6b5631ef5de18f, role_id=c8ce6d197f654598ac45f6016ecccabd)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:25.237689 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df76643d-ee53-45c4-aaaa-662ad69f9161 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:25.324370 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1420/2823] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:42:25 2022] PUT /identity/v3/projects/17652a18de014853b187316dce12bfc7/users/df11bf06a6d54ab28b6b5631ef5de18f/roles/c8ce6d197f654598ac45f6016ecccabd => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:42:25.335106 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35021c15-508a-45f7-ae15-1acd24a74a54 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:25.335399 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35021c15-508a-45f7-ae15-1acd24a74a54 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:25.335683 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35021c15-508a-45f7-ae15-1acd24a74a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:25.362303 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-35021c15-508a-45f7-ae15-1acd24a74a54 None None] MFA Rules not processed for user `df11bf06a6d54ab28b6b5631ef5de18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:42:25.363501 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-35021c15-508a-45f7-ae15-1acd24a74a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:42:25.425200 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1404/2824] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:42:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:42:25.429677 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df76643d-ee53-45c4-aaaa-662ad69f9161 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:25.494760 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df76643d-ee53-45c4-aaaa-662ad69f9161 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:25.499442 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c53ab-47de-4d65-a293-09b3514e0ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:25.500104 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c53ab-47de-4d65-a293-09b3514e0ec0 admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:25.500393 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c53ab-47de-4d65-a293-09b3514e0ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:25.500676 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c53ab-47de-4d65-a293-09b3514e0ec0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:25.501389 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4c53ab-47de-4d65-a293-09b3514e0ec0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:25.503730 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4c53ab-47de-4d65-a293-09b3514e0ec0 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:25.624030 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1421/2825] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:42:25 2022] POST /identity/v3/projects => generated 387 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:42:25.628087 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35021c15-508a-45f7-ae15-1acd24a74a54 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:25.638750 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35021c15-508a-45f7-ae15-1acd24a74a54 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:25.694117 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddde5bde-efaa-4fff-bdb8-6980a5a4d804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:25.694799 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde5bde-efaa-4fff-bdb8-6980a5a4d804 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:25.695076 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde5bde-efaa-4fff-bdb8-6980a5a4d804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:25.695355 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde5bde-efaa-4fff-bdb8-6980a5a4d804 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:25.696050 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddde5bde-efaa-4fff-bdb8-6980a5a4d804 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:25.697973 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddde5bde-efaa-4fff-bdb8-6980a5a4d804 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:25.810060 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1405/2826] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:42:25 2022] POST /identity/v3/users => generated 300 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:42:25.813934 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c53ab-47de-4d65-a293-09b3514e0ec0 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:25.824343 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c53ab-47de-4d65-a293-09b3514e0ec0 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:25.828967 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e3f235-5254-4eee-9c6b-0bca790ada23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:25.829625 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3f235-5254-4eee-9c6b-0bca790ada23 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:25.829915 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3f235-5254-4eee-9c6b-0bca790ada23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:25.830196 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3f235-5254-4eee-9c6b-0bca790ada23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:25.830963 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e3f235-5254-4eee-9c6b-0bca790ada23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:25.832557 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e3f235-5254-4eee-9c6b-0bca790ada23 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:25.843784 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1422/2827] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:42:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:42:25.847775 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddde5bde-efaa-4fff-bdb8-6980a5a4d804 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:25.854847 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:42:25.858444 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddde5bde-efaa-4fff-bdb8-6980a5a4d804 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:25.862943 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6533fc-0583-4aee-b29c-2cd61aca6ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:25.863815 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6533fc-0583-4aee-b29c-2cd61aca6ecd admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:25.867186 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6533fc-0583-4aee-b29c-2cd61aca6ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:25.867186 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6533fc-0583-4aee-b29c-2cd61aca6ecd admin admin] PATH_INFO: `/v3/projects/65b688b202da44dd9fa9c6cbaab6627f/users/3478d9c49d2243e992a6a3d5fff44602/roles/e04fe3eb1f714d74901ac83e33ea8a16` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:25.879065 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6533fc-0583-4aee-b29c-2cd61aca6ecd admin admin] RBAC: Authorizing `identity:create_grant(project_id=65b688b202da44dd9fa9c6cbaab6627f, user_id=3478d9c49d2243e992a6a3d5fff44602, role_id=e04fe3eb1f714d74901ac83e33ea8a16)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:25.881822 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6533fc-0583-4aee-b29c-2cd61aca6ecd admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:25.948981 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1406/2828] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:42:25 2022] PUT /identity/v3/projects/65b688b202da44dd9fa9c6cbaab6627f/users/3478d9c49d2243e992a6a3d5fff44602/roles/e04fe3eb1f714d74901ac83e33ea8a16 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:42:25.953047 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e3f235-5254-4eee-9c6b-0bca790ada23 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:25.963685 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e3f235-5254-4eee-9c6b-0bca790ada23 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:26.007022 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:42:26.019282 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb08328e-8432-4352-b4d3-7e95feeb35c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:26.019950 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb08328e-8432-4352-b4d3-7e95feeb35c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:26.020238 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb08328e-8432-4352-b4d3-7e95feeb35c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:26.020521 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb08328e-8432-4352-b4d3-7e95feeb35c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:26.021246 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb08328e-8432-4352-b4d3-7e95feeb35c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:26.023371 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb08328e-8432-4352-b4d3-7e95feeb35c7 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:26.032917 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1423/2829] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:42:25 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:42:26.037324 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6533fc-0583-4aee-b29c-2cd61aca6ecd admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:26.048472 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6533fc-0583-4aee-b29c-2cd61aca6ecd admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:26.053102 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c362655-e207-415c-966e-38b3466e08ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:26.056335 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c362655-e207-415c-966e-38b3466e08ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:26.056335 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c362655-e207-415c-966e-38b3466e08ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:26.056335 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c362655-e207-415c-966e-38b3466e08ed admin admin] PATH_INFO: `/v3/projects/65b688b202da44dd9fa9c6cbaab6627f/users/3478d9c49d2243e992a6a3d5fff44602/roles/e04fe3eb1f714d74901ac83e33ea8a16` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:26.057078 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c362655-e207-415c-966e-38b3466e08ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=65b688b202da44dd9fa9c6cbaab6627f, user_id=3478d9c49d2243e992a6a3d5fff44602, role_id=e04fe3eb1f714d74901ac83e33ea8a16)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:26.059767 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c362655-e207-415c-966e-38b3466e08ed admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:26.070612 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1407/2830] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:42:26 2022] PUT /identity/v3/projects/65b688b202da44dd9fa9c6cbaab6627f/users/3478d9c49d2243e992a6a3d5fff44602/roles/e04fe3eb1f714d74901ac83e33ea8a16 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:42:26.080610 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d0a696-3652-4a11-8c70-882b3c19a543 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:26.080909 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d0a696-3652-4a11-8c70-882b3c19a543 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:26.081197 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d0a696-3652-4a11-8c70-882b3c19a543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:26.107058 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-08d0a696-3652-4a11-8c70-882b3c19a543 None None] MFA Rules not processed for user `3478d9c49d2243e992a6a3d5fff44602`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:42:26.108268 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-08d0a696-3652-4a11-8c70-882b3c19a543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:42:26.176897 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1424/2831] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:42:26 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:42:26.188438 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c362655-e207-415c-966e-38b3466e08ed admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:26.190132 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-5c362655-e207-415c-966e-38b3466e08ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:42:26.248802 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c362655-e207-415c-966e-38b3466e08ed admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:26.252507 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c517ae4-0fad-4126-b75e-8e32b0faf5c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8693a1e72f14fdfb383f11e96330726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:26.253151 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c517ae4-0fad-4126-b75e-8e32b0faf5c3 service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:26.253440 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c517ae4-0fad-4126-b75e-8e32b0faf5c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:26.253729 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c517ae4-0fad-4126-b75e-8e32b0faf5c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:26.262740 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c517ae4-0fad-4126-b75e-8e32b0faf5c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:26.264180 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c517ae4-0fad-4126-b75e-8e32b0faf5c3 service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:26.273621 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1408/2832] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:42:26 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 16:42:27.340129 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d0a696-3652-4a11-8c70-882b3c19a543 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:27.402923 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d0a696-3652-4a11-8c70-882b3c19a543 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:27.407434 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd7512f-0940-4675-b06e-fd511bb4208c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:27.408289 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7512f-0940-4675-b06e-fd511bb4208c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:27.408574 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7512f-0940-4675-b06e-fd511bb4208c admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:27.408851 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7512f-0940-4675-b06e-fd511bb4208c admin admin] PATH_INFO: `/v3/users/df11bf06a6d54ab28b6b5631ef5de18f` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:27.410026 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd7512f-0940-4675-b06e-fd511bb4208c admin admin] RBAC: Authorizing `identity:delete_user(user_id=df11bf06a6d54ab28b6b5631ef5de18f)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:27.411994 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd7512f-0940-4675-b06e-fd511bb4208c admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:27.572371 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-ebd7512f-0940-4675-b06e-fd511bb4208c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df11bf06a6d54ab28b6b5631ef5de18f'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:27.584528 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-ebd7512f-0940-4675-b06e-fd511bb4208c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df11bf06a6d54ab28b6b5631ef5de18f'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:27.585187 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-ebd7512f-0940-4675-b06e-fd511bb4208c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df11bf06a6d54ab28b6b5631ef5de18f'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:27.585791 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-ebd7512f-0940-4675-b06e-fd511bb4208c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df11bf06a6d54ab28b6b5631ef5de18f'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:27.589401 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:42:27.660822 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-ebd7512f-0940-4675-b06e-fd511bb4208c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df11bf06a6d54ab28b6b5631ef5de18f'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:27.673926 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1425/2833] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:42:27 2022] DELETE /identity/v3/users/df11bf06a6d54ab28b6b5631ef5de18f => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:42:27.679015 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26250094-f46f-407d-b472-93d8941a64a3 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:27.679485 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26250094-f46f-407d-b472-93d8941a64a3 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:27.679602 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26250094-f46f-407d-b472-93d8941a64a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:27.696865 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-26250094-f46f-407d-b472-93d8941a64a3 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:42:27.699013 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-26250094-f46f-407d-b472-93d8941a64a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:42:27.756760 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1409/2834] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:42:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:42:27.766237 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd7512f-0940-4675-b06e-fd511bb4208c admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:27.767660 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-ebd7512f-0940-4675-b06e-fd511bb4208c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:42:27.824911 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd7512f-0940-4675-b06e-fd511bb4208c admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:27.828407 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584529b2-672b-4d3d-9e35-fc127130b65e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:27.837276 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584529b2-672b-4d3d-9e35-fc127130b65e service neutron] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:27.837276 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584529b2-672b-4d3d-9e35-fc127130b65e service neutron] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:27.837276 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584529b2-672b-4d3d-9e35-fc127130b65e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:27.838588 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584529b2-672b-4d3d-9e35-fc127130b65e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:27.840020 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584529b2-672b-4d3d-9e35-fc127130b65e service neutron] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:27.849586 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1426/2835] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:42:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:42:28.262703 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26250094-f46f-407d-b472-93d8941a64a3 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:28.264159 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-26250094-f46f-407d-b472-93d8941a64a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:42:28.279424 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26250094-f46f-407d-b472-93d8941a64a3 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:28.289047 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88028c7-c3b9-4086-b74a-10e41259a7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:28.289047 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88028c7-c3b9-4086-b74a-10e41259a7f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:28.289931 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88028c7-c3b9-4086-b74a-10e41259a7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:28.289931 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88028c7-c3b9-4086-b74a-10e41259a7f2 admin admin] PATH_INFO: `/v3/projects/17652a18de014853b187316dce12bfc7` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:28.294422 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88028c7-c3b9-4086-b74a-10e41259a7f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17652a18de014853b187316dce12bfc7)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:28.296392 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88028c7-c3b9-4086-b74a-10e41259a7f2 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:28.458916 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-c88028c7-c3b9-4086-b74a-10e41259a7f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17652a18de014853b187316dce12bfc7', 'request_id': 'req-c88028c7-c3b9-4086-b74a-10e41259a7f2'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:28.465597 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-c88028c7-c3b9-4086-b74a-10e41259a7f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17652a18de014853b187316dce12bfc7', 'request_id': 'req-c88028c7-c3b9-4086-b74a-10e41259a7f2'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:28.529698 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-c88028c7-c3b9-4086-b74a-10e41259a7f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17652a18de014853b187316dce12bfc7', 'request_id': 'req-c88028c7-c3b9-4086-b74a-10e41259a7f2'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:28.533808 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:42:28.540513 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-c88028c7-c3b9-4086-b74a-10e41259a7f2 admin admin] The token cache is being invalidate because project 17652a18de014853b187316dce12bfc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:42:28.540813 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-c88028c7-c3b9-4086-b74a-10e41259a7f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:28.541449 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-c88028c7-c3b9-4086-b74a-10e41259a7f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:28.543050 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1410/2836] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:42:28 2022] DELETE /identity/v3/projects/17652a18de014853b187316dce12bfc7 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:42:28.547093 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584529b2-672b-4d3d-9e35-fc127130b65e service neutron] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:28.557015 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584529b2-672b-4d3d-9e35-fc127130b65e service neutron] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:28.615016 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c8afdb-65d5-456e-8904-327f187c67dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:28.616193 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c8afdb-65d5-456e-8904-327f187c67dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:28.616483 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c8afdb-65d5-456e-8904-327f187c67dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:28.616764 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c8afdb-65d5-456e-8904-327f187c67dc admin admin] PATH_INFO: `/v3/users/3478d9c49d2243e992a6a3d5fff44602` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:28.617948 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c8afdb-65d5-456e-8904-327f187c67dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=3478d9c49d2243e992a6a3d5fff44602)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:28.620047 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c8afdb-65d5-456e-8904-327f187c67dc admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:28.808943 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-78c8afdb-65d5-456e-8904-327f187c67dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3478d9c49d2243e992a6a3d5fff44602'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:28.820845 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-78c8afdb-65d5-456e-8904-327f187c67dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3478d9c49d2243e992a6a3d5fff44602'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:28.821506 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-78c8afdb-65d5-456e-8904-327f187c67dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3478d9c49d2243e992a6a3d5fff44602'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:28.822107 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-78c8afdb-65d5-456e-8904-327f187c67dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3478d9c49d2243e992a6a3d5fff44602'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:28.919012 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-78c8afdb-65d5-456e-8904-327f187c67dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3478d9c49d2243e992a6a3d5fff44602'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:28.932829 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1427/2837] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:42:28 2022] DELETE /identity/v3/users/3478d9c49d2243e992a6a3d5fff44602 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:42:29.350727 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88028c7-c3b9-4086-b74a-10e41259a7f2 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:29.356351 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-c88028c7-c3b9-4086-b74a-10e41259a7f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:42:29.373644 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88028c7-c3b9-4086-b74a-10e41259a7f2 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:29.437786 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e452e2-62b4-4bdd-b917-89cfde7ff9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:29.438686 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e452e2-62b4-4bdd-b917-89cfde7ff9f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:29.438978 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e452e2-62b4-4bdd-b917-89cfde7ff9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:29.439262 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e452e2-62b4-4bdd-b917-89cfde7ff9f6 admin admin] PATH_INFO: `/v3/projects/65b688b202da44dd9fa9c6cbaab6627f` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:29.440504 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e452e2-62b4-4bdd-b917-89cfde7ff9f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65b688b202da44dd9fa9c6cbaab6627f)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:29.442470 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e452e2-62b4-4bdd-b917-89cfde7ff9f6 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:29.559677 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-93e452e2-62b4-4bdd-b917-89cfde7ff9f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65b688b202da44dd9fa9c6cbaab6627f', 'request_id': 'req-93e452e2-62b4-4bdd-b917-89cfde7ff9f6'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:29.565895 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-93e452e2-62b4-4bdd-b917-89cfde7ff9f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65b688b202da44dd9fa9c6cbaab6627f', 'request_id': 'req-93e452e2-62b4-4bdd-b917-89cfde7ff9f6'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:29.638273 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-93e452e2-62b4-4bdd-b917-89cfde7ff9f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65b688b202da44dd9fa9c6cbaab6627f', 'request_id': 'req-93e452e2-62b4-4bdd-b917-89cfde7ff9f6'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:29.649294 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-93e452e2-62b4-4bdd-b917-89cfde7ff9f6 admin admin] The token cache is being invalidate because project 65b688b202da44dd9fa9c6cbaab6627f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:42:29.649586 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-93e452e2-62b4-4bdd-b917-89cfde7ff9f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:29.650210 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-93e452e2-62b4-4bdd-b917-89cfde7ff9f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:29.651782 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1411/2838] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:42:29 2022] DELETE /identity/v3/projects/65b688b202da44dd9fa9c6cbaab6627f => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:42:29.656655 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da1cfa2-f389-4154-948a-41ee78c6a93d None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:29.660559 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da1cfa2-f389-4154-948a-41ee78c6a93d None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:29.660559 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da1cfa2-f389-4154-948a-41ee78c6a93d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:29.675779 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-7da1cfa2-f389-4154-948a-41ee78c6a93d None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:42:29.676974 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-7da1cfa2-f389-4154-948a-41ee78c6a93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:42:29.681188 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:42:29.735208 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1428/2839] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:42:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:42:29.743200 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437a6ad-f85b-445b-9962-bd5a7f7ff00b None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:29.743493 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437a6ad-f85b-445b-9962-bd5a7f7ff00b None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:29.743775 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437a6ad-f85b-445b-9962-bd5a7f7ff00b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:29.762403 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-0437a6ad-f85b-445b-9962-bd5a7f7ff00b None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:42:29.763605 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-0437a6ad-f85b-445b-9962-bd5a7f7ff00b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:42:29.771705 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1412/2840] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:42:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:42:29.776376 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da1cfa2-f389-4154-948a-41ee78c6a93d None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:29.785928 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da1cfa2-f389-4154-948a-41ee78c6a93d None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:29.791325 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad9ddde-7128-46fd-9d11-2bc2a0cbf6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:29.791984 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9ddde-7128-46fd-9d11-2bc2a0cbf6be admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:29.792271 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9ddde-7128-46fd-9d11-2bc2a0cbf6be admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:29.792547 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9ddde-7128-46fd-9d11-2bc2a0cbf6be admin admin] PATH_INFO: `/v3/domains` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:29.793276 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad9ddde-7128-46fd-9d11-2bc2a0cbf6be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:42:29.793589 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad9ddde-7128-46fd-9d11-2bc2a0cbf6be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:29.795228 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad9ddde-7128-46fd-9d11-2bc2a0cbf6be admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:29.807163 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1429/2841] 10.222.0.62 () {58 vars in 1152 bytes} [Fri May 27 16:42:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:42:29.811252 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0437a6ad-f85b-445b-9962-bd5a7f7ff00b None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:29.820451 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0437a6ad-f85b-445b-9962-bd5a7f7ff00b None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:29.824996 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8969b84e-a623-4e69-8d7b-68b1257d15c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:29.825634 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8969b84e-a623-4e69-8d7b-68b1257d15c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:29.825923 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8969b84e-a623-4e69-8d7b-68b1257d15c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:29.826200 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8969b84e-a623-4e69-8d7b-68b1257d15c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:29.826904 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8969b84e-a623-4e69-8d7b-68b1257d15c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:29.828797 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8969b84e-a623-4e69-8d7b-68b1257d15c7 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:29.943791 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1413/2842] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:42:29 2022] POST /identity/v3/projects => generated 383 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:42:29.947819 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad9ddde-7128-46fd-9d11-2bc2a0cbf6be admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:29.957834 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad9ddde-7128-46fd-9d11-2bc2a0cbf6be admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:30.014758 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73cee55-fe61-4a02-9c6d-155a118386c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:30.015460 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73cee55-fe61-4a02-9c6d-155a118386c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:30.015751 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73cee55-fe61-4a02-9c6d-155a118386c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:30.016030 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73cee55-fe61-4a02-9c6d-155a118386c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:30.016729 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73cee55-fe61-4a02-9c6d-155a118386c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:30.018814 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73cee55-fe61-4a02-9c6d-155a118386c9 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:30.116292 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1430/2843] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:42:29 2022] POST /identity/v3/users => generated 292 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:42:30.121820 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8969b84e-a623-4e69-8d7b-68b1257d15c7 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:30.132164 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8969b84e-a623-4e69-8d7b-68b1257d15c7 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:30.137095 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483f139c-d5b4-43f0-adb2-8109a8bd0d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:30.137755 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f139c-d5b4-43f0-adb2-8109a8bd0d62 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:30.138042 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f139c-d5b4-43f0-adb2-8109a8bd0d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:30.138352 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f139c-d5b4-43f0-adb2-8109a8bd0d62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:30.139079 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483f139c-d5b4-43f0-adb2-8109a8bd0d62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:30.140712 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483f139c-d5b4-43f0-adb2-8109a8bd0d62 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:30.151238 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1414/2844] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:42:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:42:30.156084 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73cee55-fe61-4a02-9c6d-155a118386c9 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:30.166531 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73cee55-fe61-4a02-9c6d-155a118386c9 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:30.171164 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1d0ec0-c363-4beb-928d-b224a3032751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:30.171818 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d0ec0-c363-4beb-928d-b224a3032751 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:30.172106 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d0ec0-c363-4beb-928d-b224a3032751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:30.172387 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d0ec0-c363-4beb-928d-b224a3032751 admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:30.173115 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1d0ec0-c363-4beb-928d-b224a3032751 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:30.174742 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1d0ec0-c363-4beb-928d-b224a3032751 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:30.185084 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1431/2845] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:42:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:42:30.188998 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483f139c-d5b4-43f0-adb2-8109a8bd0d62 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:30.198929 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483f139c-d5b4-43f0-adb2-8109a8bd0d62 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:30.203635 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aa6c4b-67e7-4798-8d26-1d0e586f9df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:30.204438 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa6c4b-67e7-4798-8d26-1d0e586f9df6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:30.204735 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa6c4b-67e7-4798-8d26-1d0e586f9df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:30.205003 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa6c4b-67e7-4798-8d26-1d0e586f9df6 admin admin] PATH_INFO: `/v3/projects/980ccb407597436ab8fa6c3f9cd5aaf2/users/d20faf285c874f5393918bbf7f0f4247/roles/c8ce6d197f654598ac45f6016ecccabd` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:30.220100 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aa6c4b-67e7-4798-8d26-1d0e586f9df6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=980ccb407597436ab8fa6c3f9cd5aaf2, user_id=d20faf285c874f5393918bbf7f0f4247, role_id=c8ce6d197f654598ac45f6016ecccabd)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:30.222800 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aa6c4b-67e7-4798-8d26-1d0e586f9df6 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:30.329728 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1415/2846] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:42:30 2022] PUT /identity/v3/projects/980ccb407597436ab8fa6c3f9cd5aaf2/users/d20faf285c874f5393918bbf7f0f4247/roles/c8ce6d197f654598ac45f6016ecccabd => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:42:30.340436 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98a9db-09d1-4c3d-83fe-4664b831dd6c None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:30.340736 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98a9db-09d1-4c3d-83fe-4664b831dd6c None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:30.341021 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98a9db-09d1-4c3d-83fe-4664b831dd6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:30.368522 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-7b98a9db-09d1-4c3d-83fe-4664b831dd6c None None] MFA Rules not processed for user `d20faf285c874f5393918bbf7f0f4247`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:42:30.369740 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-7b98a9db-09d1-4c3d-83fe-4664b831dd6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:42:30.432499 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1432/2847] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:42:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:42:30.436889 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aa6c4b-67e7-4798-8d26-1d0e586f9df6 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:30.457464 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:42:30.498111 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aa6c4b-67e7-4798-8d26-1d0e586f9df6 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:30.502848 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec9c32-4421-46df-919d-f85f8feae59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:30.503519 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec9c32-4421-46df-919d-f85f8feae59d admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:30.508707 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec9c32-4421-46df-919d-f85f8feae59d admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:30.508707 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec9c32-4421-46df-919d-f85f8feae59d admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:30.508707 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aec9c32-4421-46df-919d-f85f8feae59d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:30.508707 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aec9c32-4421-46df-919d-f85f8feae59d admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:30.591412 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1416/2848] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:42:30 2022] POST /identity/v3/projects => generated 383 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:42:30.595306 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b98a9db-09d1-4c3d-83fe-4664b831dd6c None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:30.602729 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:42:30.606795 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b98a9db-09d1-4c3d-83fe-4664b831dd6c None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:30.663930 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761e6861-a5a4-460f-b2d0-e022a8f5e367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:30.664617 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761e6861-a5a4-460f-b2d0-e022a8f5e367 admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:30.664872 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761e6861-a5a4-460f-b2d0-e022a8f5e367 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:30.665149 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761e6861-a5a4-460f-b2d0-e022a8f5e367 admin admin] PATH_INFO: `/v3/users` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:30.665835 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761e6861-a5a4-460f-b2d0-e022a8f5e367 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:30.667776 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761e6861-a5a4-460f-b2d0-e022a8f5e367 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:30.758380 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1433/2849] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:42:30 2022] POST /identity/v3/users => generated 298 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:42:30.760063 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec9c32-4421-46df-919d-f85f8feae59d admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:30.770441 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec9c32-4421-46df-919d-f85f8feae59d admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:30.775701 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e537e6ab-5e3a-4cd4-9f3c-9b0610af3afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:30.776356 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e537e6ab-5e3a-4cd4-9f3c-9b0610af3afa admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:30.776647 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e537e6ab-5e3a-4cd4-9f3c-9b0610af3afa admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:30.776916 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e537e6ab-5e3a-4cd4-9f3c-9b0610af3afa admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:30.777640 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e537e6ab-5e3a-4cd4-9f3c-9b0610af3afa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:30.779282 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e537e6ab-5e3a-4cd4-9f3c-9b0610af3afa admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:30.789925 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1417/2850] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:42:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:42:30.794182 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761e6861-a5a4-460f-b2d0-e022a8f5e367 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:30.804534 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761e6861-a5a4-460f-b2d0-e022a8f5e367 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:30.809230 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f90410-fabb-49ef-b282-c3d86235ce39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:30.810104 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f90410-fabb-49ef-b282-c3d86235ce39 admin admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:30.810416 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f90410-fabb-49ef-b282-c3d86235ce39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:30.810734 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f90410-fabb-49ef-b282-c3d86235ce39 admin admin] PATH_INFO: `/v3/projects/3c05829244794499a9f42304a78741ab/users/c3ca8b8e864d4ae7be72496ef5619632/roles/e04fe3eb1f714d74901ac83e33ea8a16` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:30.826071 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f90410-fabb-49ef-b282-c3d86235ce39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c05829244794499a9f42304a78741ab, user_id=c3ca8b8e864d4ae7be72496ef5619632, role_id=e04fe3eb1f714d74901ac83e33ea8a16)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:30.828790 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f90410-fabb-49ef-b282-c3d86235ce39 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:30.956214 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1434/2851] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:42:30 2022] PUT /identity/v3/projects/3c05829244794499a9f42304a78741ab/users/c3ca8b8e864d4ae7be72496ef5619632/roles/e04fe3eb1f714d74901ac83e33ea8a16 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:42:30.961061 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e537e6ab-5e3a-4cd4-9f3c-9b0610af3afa admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:30.970979 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e537e6ab-5e3a-4cd4-9f3c-9b0610af3afa admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:31.027206 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb43937-594c-4796-a2e0-5e97381694b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:31.027805 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb43937-594c-4796-a2e0-5e97381694b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:31.028096 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb43937-594c-4796-a2e0-5e97381694b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:31.028380 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb43937-594c-4796-a2e0-5e97381694b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:31.029102 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb43937-594c-4796-a2e0-5e97381694b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:31.030741 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb43937-594c-4796-a2e0-5e97381694b1 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:31.040413 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1418/2852] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:42:30 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 16:42:31.044554 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f90410-fabb-49ef-b282-c3d86235ce39 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:31.055341 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f90410-fabb-49ef-b282-c3d86235ce39 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:31.059979 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299fdc11-e0fd-423d-ba20-b8ff58ceefad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:31.060858 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299fdc11-e0fd-423d-ba20-b8ff58ceefad admin admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:31.061149 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299fdc11-e0fd-423d-ba20-b8ff58ceefad admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:31.061432 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299fdc11-e0fd-423d-ba20-b8ff58ceefad admin admin] PATH_INFO: `/v3/projects/3c05829244794499a9f42304a78741ab/users/c3ca8b8e864d4ae7be72496ef5619632/roles/e04fe3eb1f714d74901ac83e33ea8a16` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:31.063601 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299fdc11-e0fd-423d-ba20-b8ff58ceefad admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c05829244794499a9f42304a78741ab, user_id=c3ca8b8e864d4ae7be72496ef5619632, role_id=e04fe3eb1f714d74901ac83e33ea8a16)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:31.066241 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299fdc11-e0fd-423d-ba20-b8ff58ceefad admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:31.076978 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1435/2853] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:42:31 2022] PUT /identity/v3/projects/3c05829244794499a9f42304a78741ab/users/c3ca8b8e864d4ae7be72496ef5619632/roles/e04fe3eb1f714d74901ac83e33ea8a16 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:42:31.139438 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7a0c6-7c77-436f-b14b-77b9abfe70e3 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:31.139733 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7a0c6-7c77-436f-b14b-77b9abfe70e3 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:31.140022 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7a0c6-7c77-436f-b14b-77b9abfe70e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:31.167239 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-77a7a0c6-7c77-436f-b14b-77b9abfe70e3 None None] MFA Rules not processed for user `c3ca8b8e864d4ae7be72496ef5619632`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:42:31.168422 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-77a7a0c6-7c77-436f-b14b-77b9abfe70e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:42:31.246625 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1419/2854] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:42:31 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:42:31.259295 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299fdc11-e0fd-423d-ba20-b8ff58ceefad admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:31.261015 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-299fdc11-e0fd-423d-ba20-b8ff58ceefad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:42:31.340038 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299fdc11-e0fd-423d-ba20-b8ff58ceefad admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:31.343712 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30181868-00c2-4831-be9c-506c11d93c63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8693a1e72f14fdfb383f11e96330726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:31.344357 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30181868-00c2-4831-be9c-506c11d93c63 service cinder] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:31.344641 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30181868-00c2-4831-be9c-506c11d93c63 service cinder] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:31.344919 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30181868-00c2-4831-be9c-506c11d93c63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:31.353897 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30181868-00c2-4831-be9c-506c11d93c63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:31.355342 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30181868-00c2-4831-be9c-506c11d93c63 service cinder] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:31.364898 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1436/2855] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:42:31 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:42:31.573097 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a7a0c6-7c77-436f-b14b-77b9abfe70e3 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:31.582924 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a7a0c6-7c77-436f-b14b-77b9abfe70e3 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:31.586812 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fe7452-8a65-4a76-abf9-1cbc99e8009d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8693a1e72f14fdfb383f11e96330726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:31.587458 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe7452-8a65-4a76-abf9-1cbc99e8009d service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:31.587745 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe7452-8a65-4a76-abf9-1cbc99e8009d service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:31.588026 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe7452-8a65-4a76-abf9-1cbc99e8009d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:31.600729 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:42:31.644717 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fe7452-8a65-4a76-abf9-1cbc99e8009d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:31.646351 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fe7452-8a65-4a76-abf9-1cbc99e8009d service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:31.655547 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1420/2856] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:42:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:42:32.201773 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30181868-00c2-4831-be9c-506c11d93c63 service cinder] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:32.244303 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:42:32.263958 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30181868-00c2-4831-be9c-506c11d93c63 service cinder] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:32.268581 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9e6523-8449-46f7-8d1e-1bbe8b66e65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:32.269485 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e6523-8449-46f7-8d1e-1bbe8b66e65b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:32.269772 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e6523-8449-46f7-8d1e-1bbe8b66e65b admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:32.270053 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e6523-8449-46f7-8d1e-1bbe8b66e65b admin admin] PATH_INFO: `/v3/users/d20faf285c874f5393918bbf7f0f4247` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:32.271331 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9e6523-8449-46f7-8d1e-1bbe8b66e65b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d20faf285c874f5393918bbf7f0f4247)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:32.273974 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9e6523-8449-46f7-8d1e-1bbe8b66e65b admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:32.492070 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-9e9e6523-8449-46f7-8d1e-1bbe8b66e65b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd20faf285c874f5393918bbf7f0f4247'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:32.504198 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-9e9e6523-8449-46f7-8d1e-1bbe8b66e65b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd20faf285c874f5393918bbf7f0f4247'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:32.504873 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-9e9e6523-8449-46f7-8d1e-1bbe8b66e65b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd20faf285c874f5393918bbf7f0f4247'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:32.505473 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-9e9e6523-8449-46f7-8d1e-1bbe8b66e65b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd20faf285c874f5393918bbf7f0f4247'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:32.641086 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-9e9e6523-8449-46f7-8d1e-1bbe8b66e65b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd20faf285c874f5393918bbf7f0f4247'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:32.653656 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1437/2857] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:42:32 2022] DELETE /identity/v3/users/d20faf285c874f5393918bbf7f0f4247 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:42:32.664203 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83b3da3-68c6-4b20-b01b-c15df69c3391 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:32.664683 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83b3da3-68c6-4b20-b01b-c15df69c3391 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:32.664823 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83b3da3-68c6-4b20-b01b-c15df69c3391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:32.682152 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-f83b3da3-68c6-4b20-b01b-c15df69c3391 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:42:32.683377 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-f83b3da3-68c6-4b20-b01b-c15df69c3391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:42:32.742307 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1421/2858] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:42:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:42:32.751737 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9e6523-8449-46f7-8d1e-1bbe8b66e65b admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:32.753130 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-9e9e6523-8449-46f7-8d1e-1bbe8b66e65b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:42:32.811457 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9e6523-8449-46f7-8d1e-1bbe8b66e65b admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:32.815076 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd03372-9aa8-45e9-88ae-cc2809e63e51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:32.815715 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd03372-9aa8-45e9-88ae-cc2809e63e51 service neutron] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:32.815999 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd03372-9aa8-45e9-88ae-cc2809e63e51 service neutron] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:32.816275 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd03372-9aa8-45e9-88ae-cc2809e63e51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:32.825782 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd03372-9aa8-45e9-88ae-cc2809e63e51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:32.827247 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd03372-9aa8-45e9-88ae-cc2809e63e51 service neutron] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:32.836620 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1438/2859] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:42:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:42:33.248980 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83b3da3-68c6-4b20-b01b-c15df69c3391 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:33.250542 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-f83b3da3-68c6-4b20-b01b-c15df69c3391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:42:33.263385 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83b3da3-68c6-4b20-b01b-c15df69c3391 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:33.269971 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a4f0d3-2308-409a-87bf-81089f8a5473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:33.270826 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a4f0d3-2308-409a-87bf-81089f8a5473 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:33.271117 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a4f0d3-2308-409a-87bf-81089f8a5473 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:33.271399 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a4f0d3-2308-409a-87bf-81089f8a5473 admin admin] PATH_INFO: `/v3/projects/980ccb407597436ab8fa6c3f9cd5aaf2` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:33.273156 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a4f0d3-2308-409a-87bf-81089f8a5473 admin admin] RBAC: Authorizing `identity:delete_project(project_id=980ccb407597436ab8fa6c3f9cd5aaf2)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:33.277929 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a4f0d3-2308-409a-87bf-81089f8a5473 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:33.386376 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-c2a4f0d3-2308-409a-87bf-81089f8a5473 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '980ccb407597436ab8fa6c3f9cd5aaf2', 'request_id': 'req-c2a4f0d3-2308-409a-87bf-81089f8a5473'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:33.392512 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-c2a4f0d3-2308-409a-87bf-81089f8a5473 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '980ccb407597436ab8fa6c3f9cd5aaf2', 'request_id': 'req-c2a4f0d3-2308-409a-87bf-81089f8a5473'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:33.461100 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-c2a4f0d3-2308-409a-87bf-81089f8a5473 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '980ccb407597436ab8fa6c3f9cd5aaf2', 'request_id': 'req-c2a4f0d3-2308-409a-87bf-81089f8a5473'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:33.471635 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-c2a4f0d3-2308-409a-87bf-81089f8a5473 admin admin] The token cache is being invalidate because project 980ccb407597436ab8fa6c3f9cd5aaf2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:42:33.471932 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-c2a4f0d3-2308-409a-87bf-81089f8a5473 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:33.472559 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-c2a4f0d3-2308-409a-87bf-81089f8a5473 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:33.474170 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1422/2860] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:42:33 2022] DELETE /identity/v3/projects/980ccb407597436ab8fa6c3f9cd5aaf2 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:42:33.478971 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd03372-9aa8-45e9-88ae-cc2809e63e51 service neutron] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:33.488538 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd03372-9aa8-45e9-88ae-cc2809e63e51 service neutron] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:33.544166 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35adc44-aadc-493a-bd5f-577433010f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:33.544969 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35adc44-aadc-493a-bd5f-577433010f95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:33.545258 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35adc44-aadc-493a-bd5f-577433010f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:33.545542 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35adc44-aadc-493a-bd5f-577433010f95 admin admin] PATH_INFO: `/v3/users/c3ca8b8e864d4ae7be72496ef5619632` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:33.546756 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35adc44-aadc-493a-bd5f-577433010f95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3ca8b8e864d4ae7be72496ef5619632)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:33.548672 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35adc44-aadc-493a-bd5f-577433010f95 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:33.550964 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:42:33.739612 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-a35adc44-aadc-493a-bd5f-577433010f95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3ca8b8e864d4ae7be72496ef5619632'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:33.751702 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-a35adc44-aadc-493a-bd5f-577433010f95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3ca8b8e864d4ae7be72496ef5619632'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:33.752372 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-a35adc44-aadc-493a-bd5f-577433010f95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3ca8b8e864d4ae7be72496ef5619632'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:33.752973 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-a35adc44-aadc-493a-bd5f-577433010f95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3ca8b8e864d4ae7be72496ef5619632'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:33.823755 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-a35adc44-aadc-493a-bd5f-577433010f95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3ca8b8e864d4ae7be72496ef5619632'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:33.837311 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1439/2861] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:42:33 2022] DELETE /identity/v3/users/c3ca8b8e864d4ae7be72496ef5619632 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:42:34.273947 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a4f0d3-2308-409a-87bf-81089f8a5473 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:34.275518 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-c2a4f0d3-2308-409a-87bf-81089f8a5473 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:42:34.290873 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a4f0d3-2308-409a-87bf-81089f8a5473 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:34.326646 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:42:34.349054 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02800973-4db3-41d8-aae3-2dc2f46c48ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:34.349259 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02800973-4db3-41d8-aae3-2dc2f46c48ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:34.349498 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02800973-4db3-41d8-aae3-2dc2f46c48ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:34.349775 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02800973-4db3-41d8-aae3-2dc2f46c48ed admin admin] PATH_INFO: `/v3/projects/3c05829244794499a9f42304a78741ab` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:34.350995 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02800973-4db3-41d8-aae3-2dc2f46c48ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c05829244794499a9f42304a78741ab)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:34.352889 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02800973-4db3-41d8-aae3-2dc2f46c48ed admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:34.457697 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-02800973-4db3-41d8-aae3-2dc2f46c48ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c05829244794499a9f42304a78741ab', 'request_id': 'req-02800973-4db3-41d8-aae3-2dc2f46c48ed'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:34.463874 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-02800973-4db3-41d8-aae3-2dc2f46c48ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c05829244794499a9f42304a78741ab', 'request_id': 'req-02800973-4db3-41d8-aae3-2dc2f46c48ed'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:34.574995 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-02800973-4db3-41d8-aae3-2dc2f46c48ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c05829244794499a9f42304a78741ab', 'request_id': 'req-02800973-4db3-41d8-aae3-2dc2f46c48ed'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:34.586710 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-02800973-4db3-41d8-aae3-2dc2f46c48ed admin admin] The token cache is being invalidate because project 3c05829244794499a9f42304a78741ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:42:34.587009 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-02800973-4db3-41d8-aae3-2dc2f46c48ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:34.587672 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-02800973-4db3-41d8-aae3-2dc2f46c48ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:34.589287 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1423/2862] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:42:34 2022] DELETE /identity/v3/projects/3c05829244794499a9f42304a78741ab => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:42:34.594112 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10acc5-c347-4f63-a9b1-0863a77c7730 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:34.594624 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10acc5-c347-4f63-a9b1-0863a77c7730 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:34.594743 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10acc5-c347-4f63-a9b1-0863a77c7730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:34.612781 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-af10acc5-c347-4f63-a9b1-0863a77c7730 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:42:34.613924 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-af10acc5-c347-4f63-a9b1-0863a77c7730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:42:34.672972 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1440/2863] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:42:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:42:34.681208 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec2707-b0e9-473f-b097-f6c299dcf749 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:34.681508 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec2707-b0e9-473f-b097-f6c299dcf749 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:34.681794 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec2707-b0e9-473f-b097-f6c299dcf749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:34.699899 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-e3ec2707-b0e9-473f-b097-f6c299dcf749 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:42:34.701085 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-e3ec2707-b0e9-473f-b097-f6c299dcf749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:42:34.708870 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1424/2864] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:42:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:42:34.713073 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af10acc5-c347-4f63-a9b1-0863a77c7730 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:34.722935 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af10acc5-c347-4f63-a9b1-0863a77c7730 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:34.728100 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c176c3-6314-4014-b6e3-baa99841cdc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:34.728751 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c176c3-6314-4014-b6e3-baa99841cdc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:34.729042 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c176c3-6314-4014-b6e3-baa99841cdc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:34.729324 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c176c3-6314-4014-b6e3-baa99841cdc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:34.730054 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c176c3-6314-4014-b6e3-baa99841cdc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:42:34.730478 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c176c3-6314-4014-b6e3-baa99841cdc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:34.732078 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c176c3-6314-4014-b6e3-baa99841cdc1 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:34.744504 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1441/2865] 10.222.0.62 () {58 vars in 1152 bytes} [Fri May 27 16:42:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:42:34.748649 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec2707-b0e9-473f-b097-f6c299dcf749 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:34.757831 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec2707-b0e9-473f-b097-f6c299dcf749 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:34.762476 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c753ba8f-71e8-406f-a343-f67ea4f8778b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:34.763118 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c753ba8f-71e8-406f-a343-f67ea4f8778b admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:34.763404 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c753ba8f-71e8-406f-a343-f67ea4f8778b admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:34.763685 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c753ba8f-71e8-406f-a343-f67ea4f8778b admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:34.764365 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c753ba8f-71e8-406f-a343-f67ea4f8778b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:34.766264 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c753ba8f-71e8-406f-a343-f67ea4f8778b admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:34.857664 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1425/2866] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:42:34 2022] POST /identity/v3/projects => generated 373 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:42:34.861750 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c176c3-6314-4014-b6e3-baa99841cdc1 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:34.872512 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c176c3-6314-4014-b6e3-baa99841cdc1 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:34.928847 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fa592d-b624-4f20-b951-b6275189f44e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:34.929516 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa592d-b624-4f20-b951-b6275189f44e admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:34.929806 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa592d-b624-4f20-b951-b6275189f44e admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:34.930087 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa592d-b624-4f20-b951-b6275189f44e admin admin] PATH_INFO: `/v3/users` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:34.930818 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fa592d-b624-4f20-b951-b6275189f44e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:34.932719 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fa592d-b624-4f20-b951-b6275189f44e admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:34.998213 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:42:35.003990 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1442/2867] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:42:34 2022] POST /identity/v3/users => generated 287 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:42:35.008054 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c753ba8f-71e8-406f-a343-f67ea4f8778b admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:35.018239 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c753ba8f-71e8-406f-a343-f67ea4f8778b admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:35.023468 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4686a7-b6f1-4f22-bf3f-c607c558d88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:35.024121 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4686a7-b6f1-4f22-bf3f-c607c558d88d admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:35.024408 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4686a7-b6f1-4f22-bf3f-c607c558d88d admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:35.024699 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4686a7-b6f1-4f22-bf3f-c607c558d88d admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:35.025411 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4686a7-b6f1-4f22-bf3f-c607c558d88d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:35.027040 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4686a7-b6f1-4f22-bf3f-c607c558d88d admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:35.037255 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1426/2868] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:42:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:42:35.041920 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fa592d-b624-4f20-b951-b6275189f44e admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:35.051830 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fa592d-b624-4f20-b951-b6275189f44e admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:35.056546 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104898ff-1329-4840-8c4c-136c22a50d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:35.057201 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104898ff-1329-4840-8c4c-136c22a50d30 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:35.057491 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104898ff-1329-4840-8c4c-136c22a50d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:35.057819 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104898ff-1329-4840-8c4c-136c22a50d30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:35.058588 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104898ff-1329-4840-8c4c-136c22a50d30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:35.060184 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104898ff-1329-4840-8c4c-136c22a50d30 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:35.070707 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1443/2869] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:42:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:42:35.074742 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4686a7-b6f1-4f22-bf3f-c607c558d88d admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:35.085145 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4686a7-b6f1-4f22-bf3f-c607c558d88d admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:35.089686 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0268c4f4-905e-46ac-aee1-00ea0c28fe8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:35.090583 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0268c4f4-905e-46ac-aee1-00ea0c28fe8e admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:35.090873 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0268c4f4-905e-46ac-aee1-00ea0c28fe8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:35.091156 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0268c4f4-905e-46ac-aee1-00ea0c28fe8e admin admin] PATH_INFO: `/v3/projects/c48ccbdb457a4f8888f8f15b25c340a5/users/48c7fe55eb0140e6968d7f1e6fcbe4e6/roles/c8ce6d197f654598ac45f6016ecccabd` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:35.105932 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0268c4f4-905e-46ac-aee1-00ea0c28fe8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c48ccbdb457a4f8888f8f15b25c340a5, user_id=48c7fe55eb0140e6968d7f1e6fcbe4e6, role_id=c8ce6d197f654598ac45f6016ecccabd)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:35.108612 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0268c4f4-905e-46ac-aee1-00ea0c28fe8e admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:35.223724 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1427/2870] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:42:35 2022] PUT /identity/v3/projects/c48ccbdb457a4f8888f8f15b25c340a5/users/48c7fe55eb0140e6968d7f1e6fcbe4e6/roles/c8ce6d197f654598ac45f6016ecccabd => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:42:35.233603 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb0ebf2-9303-413b-b625-8929a9d3ad5f None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:35.233896 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb0ebf2-9303-413b-b625-8929a9d3ad5f None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:35.234180 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb0ebf2-9303-413b-b625-8929a9d3ad5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:35.260842 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-8fb0ebf2-9303-413b-b625-8929a9d3ad5f None None] MFA Rules not processed for user `48c7fe55eb0140e6968d7f1e6fcbe4e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:42:35.262055 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-8fb0ebf2-9303-413b-b625-8929a9d3ad5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:42:35.325006 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1444/2871] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:42:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:42:35.336571 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0268c4f4-905e-46ac-aee1-00ea0c28fe8e admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:35.338279 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-0268c4f4-905e-46ac-aee1-00ea0c28fe8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:42:35.393951 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0268c4f4-905e-46ac-aee1-00ea0c28fe8e admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:35.398178 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd5b0c7-a5f9-495a-8923-cb78b91e666b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8693a1e72f14fdfb383f11e96330726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:35.398848 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5b0c7-a5f9-495a-8923-cb78b91e666b service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:35.399136 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5b0c7-a5f9-495a-8923-cb78b91e666b service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:35.399418 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5b0c7-a5f9-495a-8923-cb78b91e666b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:35.407710 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd5b0c7-a5f9-495a-8923-cb78b91e666b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:35.409141 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd5b0c7-a5f9-495a-8923-cb78b91e666b service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:35.417841 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1428/2872] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:42:35 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:42:35.442501 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb0ebf2-9303-413b-b625-8929a9d3ad5f None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:35.505591 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb0ebf2-9303-413b-b625-8929a9d3ad5f None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:35.510737 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a1060-3d98-4fa8-bda5-8d9de0cb0f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:35.511599 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a1060-3d98-4fa8-bda5-8d9de0cb0f3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:35.511887 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a1060-3d98-4fa8-bda5-8d9de0cb0f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:35.512171 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a1060-3d98-4fa8-bda5-8d9de0cb0f3c admin admin] PATH_INFO: `/v3/users/48c7fe55eb0140e6968d7f1e6fcbe4e6` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:35.513363 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2a1060-3d98-4fa8-bda5-8d9de0cb0f3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=48c7fe55eb0140e6968d7f1e6fcbe4e6)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:35.515327 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2a1060-3d98-4fa8-bda5-8d9de0cb0f3c admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:35.728952 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-8d2a1060-3d98-4fa8-bda5-8d9de0cb0f3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48c7fe55eb0140e6968d7f1e6fcbe4e6'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:35.741591 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-8d2a1060-3d98-4fa8-bda5-8d9de0cb0f3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48c7fe55eb0140e6968d7f1e6fcbe4e6'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:35.742315 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-8d2a1060-3d98-4fa8-bda5-8d9de0cb0f3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48c7fe55eb0140e6968d7f1e6fcbe4e6'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:35.742940 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-8d2a1060-3d98-4fa8-bda5-8d9de0cb0f3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48c7fe55eb0140e6968d7f1e6fcbe4e6'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:35.800722 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-8d2a1060-3d98-4fa8-bda5-8d9de0cb0f3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48c7fe55eb0140e6968d7f1e6fcbe4e6'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:35.806722 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:42:35.813978 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1445/2873] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:42:35 2022] DELETE /identity/v3/users/48c7fe55eb0140e6968d7f1e6fcbe4e6 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:42:35.818486 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2586aad6-c676-46b7-b471-7f6221972e0e None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:35.818826 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2586aad6-c676-46b7-b471-7f6221972e0e None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:35.819652 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2586aad6-c676-46b7-b471-7f6221972e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:35.831263 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:42:35.836988 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-2586aad6-c676-46b7-b471-7f6221972e0e None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:42:35.838170 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-2586aad6-c676-46b7-b471-7f6221972e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:42:35.897781 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1429/2874] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:42:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:42:35.907351 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a1060-3d98-4fa8-bda5-8d9de0cb0f3c admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:35.908810 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-8d2a1060-3d98-4fa8-bda5-8d9de0cb0f3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:42:35.966288 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a1060-3d98-4fa8-bda5-8d9de0cb0f3c admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:35.969795 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4fceee-0aef-4da6-a3de-9ee11e826c46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:35.970463 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4fceee-0aef-4da6-a3de-9ee11e826c46 service neutron] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:35.970748 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4fceee-0aef-4da6-a3de-9ee11e826c46 service neutron] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:35.971023 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4fceee-0aef-4da6-a3de-9ee11e826c46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:35.980520 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4fceee-0aef-4da6-a3de-9ee11e826c46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:35.982036 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4fceee-0aef-4da6-a3de-9ee11e826c46 service neutron] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:35.993096 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1446/2875] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:42:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:42:36.348560 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2586aad6-c676-46b7-b471-7f6221972e0e None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:36.352467 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-2586aad6-c676-46b7-b471-7f6221972e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:42:36.367751 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2586aad6-c676-46b7-b471-7f6221972e0e None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:36.372417 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6ea783-7c09-4da5-a74f-c1e76d53b8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:36.373774 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ea783-7c09-4da5-a74f-c1e76d53b8b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:36.374391 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ea783-7c09-4da5-a74f-c1e76d53b8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:36.374768 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ea783-7c09-4da5-a74f-c1e76d53b8b3 admin admin] PATH_INFO: `/v3/projects/c48ccbdb457a4f8888f8f15b25c340a5` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:36.375978 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6ea783-7c09-4da5-a74f-c1e76d53b8b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c48ccbdb457a4f8888f8f15b25c340a5)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:36.377898 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6ea783-7c09-4da5-a74f-c1e76d53b8b3 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:36.487068 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-fa6ea783-7c09-4da5-a74f-c1e76d53b8b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c48ccbdb457a4f8888f8f15b25c340a5', 'request_id': 'req-fa6ea783-7c09-4da5-a74f-c1e76d53b8b3'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:36.494019 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-fa6ea783-7c09-4da5-a74f-c1e76d53b8b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c48ccbdb457a4f8888f8f15b25c340a5', 'request_id': 'req-fa6ea783-7c09-4da5-a74f-c1e76d53b8b3'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:36.572255 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-fa6ea783-7c09-4da5-a74f-c1e76d53b8b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c48ccbdb457a4f8888f8f15b25c340a5', 'request_id': 'req-fa6ea783-7c09-4da5-a74f-c1e76d53b8b3'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:36.582975 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-fa6ea783-7c09-4da5-a74f-c1e76d53b8b3 admin admin] The token cache is being invalidate because project c48ccbdb457a4f8888f8f15b25c340a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:42:36.583260 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-fa6ea783-7c09-4da5-a74f-c1e76d53b8b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:36.583871 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-fa6ea783-7c09-4da5-a74f-c1e76d53b8b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:36.585401 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1430/2876] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:42:36 2022] DELETE /identity/v3/projects/c48ccbdb457a4f8888f8f15b25c340a5 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:42:36.590320 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e06d3-668e-46eb-ae10-14a7df109fdf None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:36.590616 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e06d3-668e-46eb-ae10-14a7df109fdf None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:36.590897 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e06d3-668e-46eb-ae10-14a7df109fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:36.608335 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-0e2e06d3-668e-46eb-ae10-14a7df109fdf None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:42:36.609536 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-0e2e06d3-668e-46eb-ae10-14a7df109fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:42:36.669182 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1447/2877] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:42:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:42:36.678935 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2b11b5-57d5-41ab-a72c-17aff99fb652 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:36.679250 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2b11b5-57d5-41ab-a72c-17aff99fb652 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:36.679532 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2b11b5-57d5-41ab-a72c-17aff99fb652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:36.697523 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-fe2b11b5-57d5-41ab-a72c-17aff99fb652 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:42:36.698748 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-fe2b11b5-57d5-41ab-a72c-17aff99fb652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:42:36.706556 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1431/2878] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:42:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:42:36.710639 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2e06d3-668e-46eb-ae10-14a7df109fdf None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:36.720494 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2e06d3-668e-46eb-ae10-14a7df109fdf None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:36.725711 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645f6b8f-3918-4664-a749-ee1353ce3f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:36.726400 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f6b8f-3918-4664-a749-ee1353ce3f4e admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:36.726712 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f6b8f-3918-4664-a749-ee1353ce3f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:36.726985 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f6b8f-3918-4664-a749-ee1353ce3f4e admin admin] PATH_INFO: `/v3/domains` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:36.727708 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645f6b8f-3918-4664-a749-ee1353ce3f4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80288) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:42:36.728015 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645f6b8f-3918-4664-a749-ee1353ce3f4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:36.729628 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645f6b8f-3918-4664-a749-ee1353ce3f4e admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:36.742094 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1448/2879] 10.222.0.62 () {58 vars in 1152 bytes} [Fri May 27 16:42:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:42:36.746458 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2b11b5-57d5-41ab-a72c-17aff99fb652 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:36.755627 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2b11b5-57d5-41ab-a72c-17aff99fb652 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:36.760249 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb59d9f1-0e31-44d4-b417-549e3bd96d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:36.760899 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59d9f1-0e31-44d4-b417-549e3bd96d6a admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:36.761178 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59d9f1-0e31-44d4-b417-549e3bd96d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:36.770440 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59d9f1-0e31-44d4-b417-549e3bd96d6a admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:36.770440 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb59d9f1-0e31-44d4-b417-549e3bd96d6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:36.770440 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb59d9f1-0e31-44d4-b417-549e3bd96d6a admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:36.856782 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1432/2880] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:42:36 2022] POST /identity/v3/projects => generated 375 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:42:36.861267 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645f6b8f-3918-4664-a749-ee1353ce3f4e admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:36.872484 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645f6b8f-3918-4664-a749-ee1353ce3f4e admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:36.927210 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c5359d-e762-4667-9d3b-aaa43e81e1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:36.927878 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5359d-e762-4667-9d3b-aaa43e81e1cb admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:36.928731 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5359d-e762-4667-9d3b-aaa43e81e1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:36.929021 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5359d-e762-4667-9d3b-aaa43e81e1cb admin admin] PATH_INFO: `/v3/users` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:36.929732 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c5359d-e762-4667-9d3b-aaa43e81e1cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:36.931713 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c5359d-e762-4667-9d3b-aaa43e81e1cb admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:37.015181 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1449/2881] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:42:36 2022] POST /identity/v3/users => generated 288 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:42:37.019380 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb59d9f1-0e31-44d4-b417-549e3bd96d6a admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:37.030198 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb59d9f1-0e31-44d4-b417-549e3bd96d6a admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:37.034907 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a02d00-36e6-4e4f-a50f-5f68543022bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:37.035563 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a02d00-36e6-4e4f-a50f-5f68543022bf admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:37.035853 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a02d00-36e6-4e4f-a50f-5f68543022bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:37.036133 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a02d00-36e6-4e4f-a50f-5f68543022bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:37.037003 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a02d00-36e6-4e4f-a50f-5f68543022bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:37.039255 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a02d00-36e6-4e4f-a50f-5f68543022bf admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:37.049622 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1433/2882] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:42:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:42:37.053505 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c5359d-e762-4667-9d3b-aaa43e81e1cb admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:37.063586 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c5359d-e762-4667-9d3b-aaa43e81e1cb admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:37.068255 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6449d90d-3d2b-4704-a3f2-7f2cc2a10eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:37.078749 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449d90d-3d2b-4704-a3f2-7f2cc2a10eee admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:37.078749 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449d90d-3d2b-4704-a3f2-7f2cc2a10eee admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:37.078749 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449d90d-3d2b-4704-a3f2-7f2cc2a10eee admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:37.078749 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6449d90d-3d2b-4704-a3f2-7f2cc2a10eee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:37.078749 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6449d90d-3d2b-4704-a3f2-7f2cc2a10eee admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:37.082367 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1450/2883] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:42:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:42:37.086904 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a02d00-36e6-4e4f-a50f-5f68543022bf admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:37.096706 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a02d00-36e6-4e4f-a50f-5f68543022bf admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:37.103961 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ad849-aaa8-4464-ae5b-edc495899499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:37.104917 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ad849-aaa8-4464-ae5b-edc495899499 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:37.105260 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ad849-aaa8-4464-ae5b-edc495899499 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:37.105605 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ad849-aaa8-4464-ae5b-edc495899499 admin admin] PATH_INFO: `/v3/projects/cc78891205534aabb17884ef91643381/users/590f9338fd2448e8a9d8d24fc718c269/roles/c8ce6d197f654598ac45f6016ecccabd` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:37.122067 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631ad849-aaa8-4464-ae5b-edc495899499 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc78891205534aabb17884ef91643381, user_id=590f9338fd2448e8a9d8d24fc718c269, role_id=c8ce6d197f654598ac45f6016ecccabd)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:37.125287 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631ad849-aaa8-4464-ae5b-edc495899499 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:37.279054 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1434/2884] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:42:37 2022] PUT /identity/v3/projects/cc78891205534aabb17884ef91643381/users/590f9338fd2448e8a9d8d24fc718c269/roles/c8ce6d197f654598ac45f6016ecccabd => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:42:37.289812 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d901737d-3320-45f5-bc54-8de41ca2df7f None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:37.290107 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d901737d-3320-45f5-bc54-8de41ca2df7f None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:37.290433 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d901737d-3320-45f5-bc54-8de41ca2df7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:37.297226 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:42:37.316380 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-d901737d-3320-45f5-bc54-8de41ca2df7f None None] MFA Rules not processed for user `590f9338fd2448e8a9d8d24fc718c269`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:42:37.317672 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-d901737d-3320-45f5-bc54-8de41ca2df7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:42:37.383023 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1451/2885] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:42:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:42:37.393303 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ad849-aaa8-4464-ae5b-edc495899499 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:37.395093 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-631ad849-aaa8-4464-ae5b-edc495899499 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:42:37.425539 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:42:37.451097 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ad849-aaa8-4464-ae5b-edc495899499 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:37.454743 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bedc5cb-407b-4bb5-96fb-4ff5c4e73a58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8693a1e72f14fdfb383f11e96330726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:37.455384 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bedc5cb-407b-4bb5-96fb-4ff5c4e73a58 service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:37.455672 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bedc5cb-407b-4bb5-96fb-4ff5c4e73a58 service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:37.455953 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bedc5cb-407b-4bb5-96fb-4ff5c4e73a58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:37.464989 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bedc5cb-407b-4bb5-96fb-4ff5c4e73a58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:37.466483 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bedc5cb-407b-4bb5-96fb-4ff5c4e73a58 service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:37.475232 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1435/2886] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:42:37 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:42:39.248643 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b00739-292c-4942-8393-0e60b166d339 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:39.249179 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b00739-292c-4942-8393-0e60b166d339 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:39.249292 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b00739-292c-4942-8393-0e60b166d339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:39.266543 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-f9b00739-292c-4942-8393-0e60b166d339 None None] MFA Rules not processed for user `590f9338fd2448e8a9d8d24fc718c269`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:42:39.267751 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-f9b00739-292c-4942-8393-0e60b166d339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:42:39.275165 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1452/2887] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:42:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:42:47.529536 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=14 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:42:49.261289 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=33 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:42:56.896493 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da99048-e68c-4389-b0c6-919d8cf7e20b None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:56.896978 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da99048-e68c-4389-b0c6-919d8cf7e20b None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:56.897084 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da99048-e68c-4389-b0c6-919d8cf7e20b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:56.914736 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-1da99048-e68c-4389-b0c6-919d8cf7e20b None None] MFA Rules not processed for user `eb50bf5f39b04ab689b55f46d3dd2640`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:42:56.915909 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-1da99048-e68c-4389-b0c6-919d8cf7e20b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:42:56.977616 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1436/2888] 10.222.0.62 () {58 vars in 1009 bytes} [Fri May 27 16:42:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:42:57.130617 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b00739-292c-4942-8393-0e60b166d339 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:57.132142 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-f9b00739-292c-4942-8393-0e60b166d339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:42:57.199939 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b00739-292c-4942-8393-0e60b166d339 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:57.205831 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20457299-1729-4b62-b847-bf51e509cce0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8e6ec55445045fcac5623b9b6ffa9ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:57.206503 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20457299-1729-4b62-b847-bf51e509cce0 service swift] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:57.206795 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20457299-1729-4b62-b847-bf51e509cce0 service swift] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:57.207080 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20457299-1729-4b62-b847-bf51e509cce0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:57.215240 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20457299-1729-4b62-b847-bf51e509cce0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:57.216826 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20457299-1729-4b62-b847-bf51e509cce0 service swift] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:57.224915 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1453/2889] 10.222.0.62 () {60 vars in 1384 bytes} [Fri May 27 16:42:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 16:42:58.087557 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640717f0-c1db-42ab-bce3-8af81cc5745e None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:58.088102 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640717f0-c1db-42ab-bce3-8af81cc5745e None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:58.088102 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640717f0-c1db-42ab-bce3-8af81cc5745e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:58.106071 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-640717f0-c1db-42ab-bce3-8af81cc5745e None None] MFA Rules not processed for user `eb50bf5f39b04ab689b55f46d3dd2640`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:42:58.107377 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-640717f0-c1db-42ab-bce3-8af81cc5745e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:42:58.114963 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1437/2890] 10.222.0.62 () {58 vars in 967 bytes} [Fri May 27 16:42:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:42:58.127950 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20457299-1729-4b62-b847-bf51e509cce0 service swift] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:58.138540 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20457299-1729-4b62-b847-bf51e509cce0 service swift] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:58.144367 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ab66e6-8b75-4afa-b452-caab9fa12a91 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8e6ec55445045fcac5623b9b6ffa9ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:58.145016 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab66e6-8b75-4afa-b452-caab9fa12a91 service swift] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:58.145305 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab66e6-8b75-4afa-b452-caab9fa12a91 service swift] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:58.145584 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab66e6-8b75-4afa-b452-caab9fa12a91 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:58.153883 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ab66e6-8b75-4afa-b452-caab9fa12a91 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:58.155491 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ab66e6-8b75-4afa-b452-caab9fa12a91 service swift] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:58.163571 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1454/2891] 10.222.0.62 () {60 vars in 1384 bytes} [Fri May 27 16:42:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 16:42:58.801249 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccbb108-0bbb-4fba-81b5-d765a0b125e6 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:58.801546 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccbb108-0bbb-4fba-81b5-d765a0b125e6 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:58.801842 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccbb108-0bbb-4fba-81b5-d765a0b125e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:58.820020 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-0ccbb108-0bbb-4fba-81b5-d765a0b125e6 None None] MFA Rules not processed for user `eb50bf5f39b04ab689b55f46d3dd2640`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:42:58.821193 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-0ccbb108-0bbb-4fba-81b5-d765a0b125e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:42:58.828773 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1438/2892] 10.222.0.62 () {58 vars in 1009 bytes} [Fri May 27 16:42:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:42:58.840324 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ab66e6-8b75-4afa-b452-caab9fa12a91 service swift] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:58.855055 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ab66e6-8b75-4afa-b452-caab9fa12a91 service swift] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:58.860154 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539cec4a-8808-4496-8a89-023595bd60f0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8e6ec55445045fcac5623b9b6ffa9ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:58.860805 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539cec4a-8808-4496-8a89-023595bd60f0 service swift] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:58.861094 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539cec4a-8808-4496-8a89-023595bd60f0 service swift] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:58.861375 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539cec4a-8808-4496-8a89-023595bd60f0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:58.870053 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539cec4a-8808-4496-8a89-023595bd60f0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:58.871671 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539cec4a-8808-4496-8a89-023595bd60f0 service swift] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:58.880274 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1455/2893] 10.222.0.62 () {60 vars in 1384 bytes} [Fri May 27 16:42:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 16:42:59.461865 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c9ecf-ae61-4925-8b0b-cf9de2614f2f None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:59.462343 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c9ecf-ae61-4925-8b0b-cf9de2614f2f None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:59.462442 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c9ecf-ae61-4925-8b0b-cf9de2614f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:59.480527 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-337c9ecf-ae61-4925-8b0b-cf9de2614f2f None None] MFA Rules not processed for user `eb50bf5f39b04ab689b55f46d3dd2640`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:42:59.481700 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-337c9ecf-ae61-4925-8b0b-cf9de2614f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:42:59.489623 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1439/2894] 10.222.0.62 () {58 vars in 967 bytes} [Fri May 27 16:42:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:42:59.501350 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539cec4a-8808-4496-8a89-023595bd60f0 service swift] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:59.511838 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539cec4a-8808-4496-8a89-023595bd60f0 service swift] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:59.516839 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e65de06-6b0c-413a-a424-a911e21ec92a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8e6ec55445045fcac5623b9b6ffa9ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:59.517505 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e65de06-6b0c-413a-a424-a911e21ec92a service swift] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:59.517795 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e65de06-6b0c-413a-a424-a911e21ec92a service swift] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:59.518081 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e65de06-6b0c-413a-a424-a911e21ec92a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:59.526092 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e65de06-6b0c-413a-a424-a911e21ec92a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:59.527695 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e65de06-6b0c-413a-a424-a911e21ec92a service swift] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:59.536279 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1456/2895] 10.222.0.62 () {60 vars in 1384 bytes} [Fri May 27 16:42:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 16:43:02.251925 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c9ecf-ae61-4925-8b0b-cf9de2614f2f None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:43:02.315551 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c9ecf-ae61-4925-8b0b-cf9de2614f2f None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:43:02.320655 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e8723a-1350-4682-9082-39ec7daec5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:43:02.321536 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e8723a-1350-4682-9082-39ec7daec5bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:43:02.321831 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e8723a-1350-4682-9082-39ec7daec5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:43:02.322096 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e8723a-1350-4682-9082-39ec7daec5bd admin admin] PATH_INFO: `/v3/users/590f9338fd2448e8a9d8d24fc718c269` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:43:02.323323 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e8723a-1350-4682-9082-39ec7daec5bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=590f9338fd2448e8a9d8d24fc718c269)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:43:02.327928 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e8723a-1350-4682-9082-39ec7daec5bd admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:43:02.550273 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-65e8723a-1350-4682-9082-39ec7daec5bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '590f9338fd2448e8a9d8d24fc718c269'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:43:02.556967 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-65e8723a-1350-4682-9082-39ec7daec5bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '590f9338fd2448e8a9d8d24fc718c269'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:43:02.557620 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-65e8723a-1350-4682-9082-39ec7daec5bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '590f9338fd2448e8a9d8d24fc718c269'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:43:02.558218 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-65e8723a-1350-4682-9082-39ec7daec5bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '590f9338fd2448e8a9d8d24fc718c269'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:43:02.625842 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-65e8723a-1350-4682-9082-39ec7daec5bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '590f9338fd2448e8a9d8d24fc718c269'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:43:02.639376 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:43:02.645126 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1440/2896] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:43:02 2022] DELETE /identity/v3/users/590f9338fd2448e8a9d8d24fc718c269 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:43:02.649605 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d264aa-97ba-45ee-b04f-f6027c654915 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:43:02.650130 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d264aa-97ba-45ee-b04f-f6027c654915 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:43:02.650288 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d264aa-97ba-45ee-b04f-f6027c654915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:43:02.667750 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-64d264aa-97ba-45ee-b04f-f6027c654915 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:43:02.668967 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-64d264aa-97ba-45ee-b04f-f6027c654915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:43:02.727360 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1457/2897] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:43:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:43:02.737609 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e8723a-1350-4682-9082-39ec7daec5bd admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:43:02.739295 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-65e8723a-1350-4682-9082-39ec7daec5bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:43:02.796624 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e8723a-1350-4682-9082-39ec7daec5bd admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:43:02.800183 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40b033c-e1f4-4133-9492-e92307138566 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:43:02.800890 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b033c-e1f4-4133-9492-e92307138566 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:43:02.801101 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b033c-e1f4-4133-9492-e92307138566 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:43:02.801379 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b033c-e1f4-4133-9492-e92307138566 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:43:02.810176 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40b033c-e1f4-4133-9492-e92307138566 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:43:02.812184 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40b033c-e1f4-4133-9492-e92307138566 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:43:02.821392 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1441/2898] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:43:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:43:03.056082 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d264aa-97ba-45ee-b04f-f6027c654915 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:43:03.056261 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-64d264aa-97ba-45ee-b04f-f6027c654915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:43:03.069155 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d264aa-97ba-45ee-b04f-f6027c654915 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:43:03.073968 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2096c9-9871-4b5d-90db-050deb730f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:43:03.079329 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2096c9-9871-4b5d-90db-050deb730f7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:43:03.079329 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2096c9-9871-4b5d-90db-050deb730f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:43:03.079329 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2096c9-9871-4b5d-90db-050deb730f7f admin admin] PATH_INFO: `/v3/projects/cc78891205534aabb17884ef91643381` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:43:03.079329 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2096c9-9871-4b5d-90db-050deb730f7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc78891205534aabb17884ef91643381)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:43:03.079329 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2096c9-9871-4b5d-90db-050deb730f7f admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:43:03.183276 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:43:03.186110 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-5e2096c9-9871-4b5d-90db-050deb730f7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc78891205534aabb17884ef91643381', 'request_id': 'req-5e2096c9-9871-4b5d-90db-050deb730f7f'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:43:03.192210 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-5e2096c9-9871-4b5d-90db-050deb730f7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc78891205534aabb17884ef91643381', 'request_id': 'req-5e2096c9-9871-4b5d-90db-050deb730f7f'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:43:03.197732 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-5e2096c9-9871-4b5d-90db-050deb730f7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc78891205534aabb17884ef91643381', 'request_id': 'req-5e2096c9-9871-4b5d-90db-050deb730f7f'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:43:03.264534 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-5e2096c9-9871-4b5d-90db-050deb730f7f admin admin] The token cache is being invalidate because project cc78891205534aabb17884ef91643381 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80288) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:43:03.264826 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-5e2096c9-9871-4b5d-90db-050deb730f7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:43:03.265443 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-5e2096c9-9871-4b5d-90db-050deb730f7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:43:03.267022 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1458/2899] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:43:03 2022] DELETE /identity/v3/projects/cc78891205534aabb17884ef91643381 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:43:03.271993 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15c16b-1c56-4a23-8a90-b11e72cca6ea None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:43:03.272505 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15c16b-1c56-4a23-8a90-b11e72cca6ea None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:43:03.272613 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15c16b-1c56-4a23-8a90-b11e72cca6ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:43:03.290785 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-ef15c16b-1c56-4a23-8a90-b11e72cca6ea None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:43:03.291996 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-ef15c16b-1c56-4a23-8a90-b11e72cca6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:43:03.351340 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1442/2900] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:43:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:43:03.359804 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006e8902-0b95-4450-a870-44557601352a None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:43:03.360138 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006e8902-0b95-4450-a870-44557601352a None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:43:03.360427 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006e8902-0b95-4450-a870-44557601352a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:43:03.380141 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-006e8902-0b95-4450-a870-44557601352a None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:43:03.381358 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-006e8902-0b95-4450-a870-44557601352a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:43:03.389872 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1459/2901] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:43:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:43:03.393922 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef15c16b-1c56-4a23-8a90-b11e72cca6ea None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:43:03.403626 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef15c16b-1c56-4a23-8a90-b11e72cca6ea None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:43:03.408829 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0f0ed2-0cb3-44c3-9090-af7fe5e0c93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:43:03.409486 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f0ed2-0cb3-44c3-9090-af7fe5e0c93c admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:43:03.409774 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f0ed2-0cb3-44c3-9090-af7fe5e0c93c admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:43:03.410056 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f0ed2-0cb3-44c3-9090-af7fe5e0c93c admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:43:03.410819 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0f0ed2-0cb3-44c3-9090-af7fe5e0c93c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:43:03.411134 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0f0ed2-0cb3-44c3-9090-af7fe5e0c93c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:43:03.412761 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0f0ed2-0cb3-44c3-9090-af7fe5e0c93c admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:43:03.424268 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1443/2902] 10.222.0.62 () {58 vars in 1152 bytes} [Fri May 27 16:43:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:43:03.428268 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006e8902-0b95-4450-a870-44557601352a None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:43:03.437384 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006e8902-0b95-4450-a870-44557601352a None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:43:03.441957 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cdd632-9ced-4b0b-b323-8ad89b4171d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:43:03.442635 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cdd632-9ced-4b0b-b323-8ad89b4171d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:43:03.442919 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cdd632-9ced-4b0b-b323-8ad89b4171d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:43:03.443196 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cdd632-9ced-4b0b-b323-8ad89b4171d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:43:03.443873 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cdd632-9ced-4b0b-b323-8ad89b4171d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:43:03.445753 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cdd632-9ced-4b0b-b323-8ad89b4171d7 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:43:03.551876 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1460/2903] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 16:43:03 2022] POST /identity/v3/projects => generated 399 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:43:03.555875 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0f0ed2-0cb3-44c3-9090-af7fe5e0c93c admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:43:03.565771 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0f0ed2-0cb3-44c3-9090-af7fe5e0c93c admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:43:03.621735 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f0a4e6-a336-4bdd-85a4-b3c5951322db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:43:03.622348 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f0a4e6-a336-4bdd-85a4-b3c5951322db admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:43:03.622638 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f0a4e6-a336-4bdd-85a4-b3c5951322db admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:43:03.622916 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f0a4e6-a336-4bdd-85a4-b3c5951322db admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:43:03.623612 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f0a4e6-a336-4bdd-85a4-b3c5951322db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:43:03.625539 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f0a4e6-a336-4bdd-85a4-b3c5951322db admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:43:03.693675 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1444/2904] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 16:43:03 2022] POST /identity/v3/users => generated 300 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:43:03.697753 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cdd632-9ced-4b0b-b323-8ad89b4171d7 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:43:03.708724 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cdd632-9ced-4b0b-b323-8ad89b4171d7 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:43:03.713436 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea377af-5aae-4cd0-9707-03b9ccca2973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:43:03.714094 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea377af-5aae-4cd0-9707-03b9ccca2973 admin admin] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:43:03.714424 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea377af-5aae-4cd0-9707-03b9ccca2973 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:43:03.714706 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea377af-5aae-4cd0-9707-03b9ccca2973 admin admin] PATH_INFO: `/v3/roles` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:43:03.715460 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea377af-5aae-4cd0-9707-03b9ccca2973 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:43:03.717044 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea377af-5aae-4cd0-9707-03b9ccca2973 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:43:03.728023 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1461/2905] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:43:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:43:03.731959 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f0a4e6-a336-4bdd-85a4-b3c5951322db admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:43:03.742078 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f0a4e6-a336-4bdd-85a4-b3c5951322db admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:43:03.746702 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e1ae0e-decb-42fd-a8b7-2f0df1dcf4f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:43:03.747356 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e1ae0e-decb-42fd-a8b7-2f0df1dcf4f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:43:03.747644 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e1ae0e-decb-42fd-a8b7-2f0df1dcf4f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:43:03.747925 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e1ae0e-decb-42fd-a8b7-2f0df1dcf4f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:43:03.748639 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e1ae0e-decb-42fd-a8b7-2f0df1dcf4f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:43:03.750224 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e1ae0e-decb-42fd-a8b7-2f0df1dcf4f7 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:43:03.760129 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1445/2906] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 16:43:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:43:03.764150 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea377af-5aae-4cd0-9707-03b9ccca2973 admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:43:03.774615 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea377af-5aae-4cd0-9707-03b9ccca2973 admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:43:03.779231 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495b0a22-586e-4438-9a62-c97d029a0e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:43:03.780725 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495b0a22-586e-4438-9a62-c97d029a0e3a admin admin] REQUEST_METHOD: `PUT` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:43:03.781009 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495b0a22-586e-4438-9a62-c97d029a0e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:43:03.781285 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495b0a22-586e-4438-9a62-c97d029a0e3a admin admin] PATH_INFO: `/v3/projects/f18b77df3ec049318e4e74015257ccd1/users/d2858493c39f440682066578ca188b85/roles/c8ce6d197f654598ac45f6016ecccabd` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:43:03.795547 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495b0a22-586e-4438-9a62-c97d029a0e3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f18b77df3ec049318e4e74015257ccd1, user_id=d2858493c39f440682066578ca188b85, role_id=c8ce6d197f654598ac45f6016ecccabd)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:43:03.798171 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495b0a22-586e-4438-9a62-c97d029a0e3a admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:43:03.878066 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1462/2907] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 16:43:03 2022] PUT /identity/v3/projects/f18b77df3ec049318e4e74015257ccd1/users/d2858493c39f440682066578ca188b85/roles/c8ce6d197f654598ac45f6016ecccabd => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:43:03.888373 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d291943c-1f97-4625-bd51-e38d414319e7 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:43:03.897425 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d291943c-1f97-4625-bd51-e38d414319e7 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:43:03.897425 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d291943c-1f97-4625-bd51-e38d414319e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:43:03.902501 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:43:03.916383 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-d291943c-1f97-4625-bd51-e38d414319e7 None None] MFA Rules not processed for user `d2858493c39f440682066578ca188b85`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:43:03.917592 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-d291943c-1f97-4625-bd51-e38d414319e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:43:03.980539 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1446/2908] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:43:03 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:43:03.992312 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495b0a22-586e-4438-9a62-c97d029a0e3a admin admin] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:43:03.994002 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-495b0a22-586e-4438-9a62-c97d029a0e3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:43:04.065034 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495b0a22-586e-4438-9a62-c97d029a0e3a admin admin] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:43:04.069809 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3e0edb-9040-4f5f-8b4c-9ba5d225aea4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8693a1e72f14fdfb383f11e96330726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:43:04.070800 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3e0edb-9040-4f5f-8b4c-9ba5d225aea4 service cinder] REQUEST_METHOD: `GET` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:43:04.071221 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3e0edb-9040-4f5f-8b4c-9ba5d225aea4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:43:04.071640 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3e0edb-9040-4f5f-8b4c-9ba5d225aea4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:43:04.084046 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3e0edb-9040-4f5f-8b4c-9ba5d225aea4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:43:04.085817 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3e0edb-9040-4f5f-8b4c-9ba5d225aea4 service cinder] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:43:04.094593 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1463/2909] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:43:03 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:43:10.150442 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d291943c-1f97-4625-bd51-e38d414319e7 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:43:10.218490 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d291943c-1f97-4625-bd51-e38d414319e7 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:43:10.223349 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2631ad8-b978-4d72-bb8a-f8eea93818f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:43:10.224244 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2631ad8-b978-4d72-bb8a-f8eea93818f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:43:10.224530 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2631ad8-b978-4d72-bb8a-f8eea93818f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:43:10.224811 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2631ad8-b978-4d72-bb8a-f8eea93818f2 admin admin] PATH_INFO: `/v3/users/d2858493c39f440682066578ca188b85` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:43:10.225991 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2631ad8-b978-4d72-bb8a-f8eea93818f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2858493c39f440682066578ca188b85)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:43:10.227943 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2631ad8-b978-4d72-bb8a-f8eea93818f2 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:43:10.500105 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-f2631ad8-b978-4d72-bb8a-f8eea93818f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2858493c39f440682066578ca188b85'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:43:10.507343 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-f2631ad8-b978-4d72-bb8a-f8eea93818f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2858493c39f440682066578ca188b85'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:43:10.508002 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-f2631ad8-b978-4d72-bb8a-f8eea93818f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2858493c39f440682066578ca188b85'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:43:10.508601 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-f2631ad8-b978-4d72-bb8a-f8eea93818f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2858493c39f440682066578ca188b85'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:43:10.631166 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-f2631ad8-b978-4d72-bb8a-f8eea93818f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2858493c39f440682066578ca188b85'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:43:10.648754 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1447/2910] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 16:43:10 2022] DELETE /identity/v3/users/d2858493c39f440682066578ca188b85 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:43:10.653297 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa6ff8-e1bb-4249-9311-604451d009b0 None None] REQUEST_METHOD: `POST` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:43:10.653808 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa6ff8-e1bb-4249-9311-604451d009b0 None None] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:43:10.653925 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa6ff8-e1bb-4249-9311-604451d009b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:43:10.670729 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.auth.core [None req-61fa6ff8-e1bb-4249-9311-604451d009b0 None None] MFA Rules not processed for user `e26f01858edd43d6bd42a1a5a4965a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80288) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:43:10.671945 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-61fa6ff8-e1bb-4249-9311-604451d009b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:43:10.730232 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1464/2911] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 16:43:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:43:10.740557 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2631ad8-b978-4d72-bb8a-f8eea93818f2 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:43:10.741940 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-f2631ad8-b978-4d72-bb8a-f8eea93818f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:43:10.760438 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:43:10.797992 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2631ad8-b978-4d72-bb8a-f8eea93818f2 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:43:10.802413 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31f83b5-79af-434a-895b-b1bd2b745c63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b367ccea28d540a0b24ec4e42ebfef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:43:10.803058 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f83b5-79af-434a-895b-b1bd2b745c63 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:43:10.803341 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f83b5-79af-434a-895b-b1bd2b745c63 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:43:10.803617 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f83b5-79af-434a-895b-b1bd2b745c63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:43:10.812720 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31f83b5-79af-434a-895b-b1bd2b745c63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:43:10.814734 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31f83b5-79af-434a-895b-b1bd2b745c63 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:43:10.824197 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1448/2912] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:43:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:43:11.215247 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fa6ff8-e1bb-4249-9311-604451d009b0 None None] Authenticating user token {{(pid=80288) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:43:11.217625 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.fernet_utils [None req-61fa6ff8-e1bb-4249-9311-604451d009b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80288) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:43:11.229323 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fa6ff8-e1bb-4249-9311-604451d009b0 None None] Validating token access rules against request {{(pid=80288) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:43:11.235633 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454496ed-5170-44de-9497-0e08e0346e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26f01858edd43d6bd42a1a5a4965a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793e0b7f54284522b67bc42f3a9f9fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80288) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:43:11.236648 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454496ed-5170-44de-9497-0e08e0346e02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:43:11.236803 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454496ed-5170-44de-9497-0e08e0346e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:43:11.237084 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454496ed-5170-44de-9497-0e08e0346e02 admin admin] PATH_INFO: `/v3/projects/f18b77df3ec049318e4e74015257ccd1` {{(pid=80288) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:43:11.238536 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454496ed-5170-44de-9497-0e08e0346e02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f18b77df3ec049318e4e74015257ccd1)` {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:43:11.241470 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454496ed-5170-44de-9497-0e08e0346e02 admin admin] RBAC: Authorization granted {{(pid=80288) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:43:11.250412 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:43:11.377831 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-454496ed-5170-44de-9497-0e08e0346e02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f18b77df3ec049318e4e74015257ccd1', 'request_id': 'req-454496ed-5170-44de-9497-0e08e0346e02'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:43:11.384061 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-454496ed-5170-44de-9497-0e08e0346e02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f18b77df3ec049318e4e74015257ccd1', 'request_id': 'req-454496ed-5170-44de-9497-0e08e0346e02'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:43:11.389628 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-454496ed-5170-44de-9497-0e08e0346e02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f18b77df3ec049318e4e74015257ccd1', 'request_id': 'req-454496ed-5170-44de-9497-0e08e0346e02'} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:43:11.475812 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-454496ed-5170-44de-9497-0e08e0346e02 admin admin] The token cache is being invalidate because project f18b77df3ec049318e4e74015257ccd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80288) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:43:11.476099 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-454496ed-5170-44de-9497-0e08e0346e02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:43:11.476708 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG keystone.notifications [None req-454496ed-5170-44de-9497-0e08e0346e02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80288) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:43:11.478352 dv-cinder-840493-2-smb devstack@keystone.service[80288]: [pid: 80288|app: 0|req: 1465/2913] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 16:43:11 2022] DELETE /identity/v3/projects/f18b77df3ec049318e4e74015257ccd1 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:43:20.942730 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=19 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:43:21.472821 dv-cinder-840493-2-smb devstack@keystone.service[80288]: DEBUG dbcounter [-] [80288] Writing DB stats keystone:SELECT=21,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:44:05.606003 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31f83b5-79af-434a-895b-b1bd2b745c63 service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:44:05.607460 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-f31f83b5-79af-434a-895b-b1bd2b745c63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:44:05.697644 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31f83b5-79af-434a-895b-b1bd2b745c63 service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:44:05.754288 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa0f26-8025-4869-9f40-6a3d3896ff0e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35d98c4a2af546d8b655d649d655f447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd48d95a12587479ca5714f6ebd60dd9f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:44:05.754936 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa0f26-8025-4869-9f40-6a3d3896ff0e service placement] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:05.755220 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa0f26-8025-4869-9f40-6a3d3896ff0e service placement] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:05.755496 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa0f26-8025-4869-9f40-6a3d3896ff0e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:05.757237 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-9afa0f26-8025-4869-9f40-6a3d3896ff0e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:44:05.768674 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afa0f26-8025-4869-9f40-6a3d3896ff0e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:44:05.770341 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afa0f26-8025-4869-9f40-6a3d3896ff0e service placement] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:44:05.780065 dv-cinder-840493-2-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1449/2914] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 16:44:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:44:15.775837 dv-cinder-840493-2-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=67 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}